2023-09-28T04:03:57.946 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-28T04:03:57.946 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} --archive /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611 --verbose --name yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611/orig.config.yaml 2023-09-28T04:03:57.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T04:03:58.074 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611 branch: wip-yuri-testing-2023-09-27-0906-quincy description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} email: yweinste@redhat.com first_in_suite: false job_id: '7403611' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri-testing-2023-09-27-0906-quincy ceph: cephfs: max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - overall HEALTH_ - \(MON_DOWN\) - SLOW_OPS - slow request sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-09-27-0906-quincy sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 3538 sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri-testing-2023-09-27-0906-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 targets: smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEgkcbwfR7XZNPUcl8Ib/j/BLssG951PHYcBVnxPvirIsPyF0M5iGVpnESGHanAc2xAfzWwR76bDlWg7y/V7LTE= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIPrsYX5ysB2+tp7lWpx+f/U8mR/v1mV6w8mB0mI9ZYLfAI9MaFtRgE0T2pfWfkZ4YY469JtwKN0+4kGu2iMQwg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-27_19:23:53 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-28T04:03:58.075 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa; will attempt to use it 2023-09-28T04:03:58.075 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks 2023-09-28T04:03:58.076 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-28T04:03:58.077 INFO:teuthology.task.internal:Checking packages... 2023-09-28T04:03:58.100 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28' 2023-09-28T04:03:58.100 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-28T04:03:58.100 INFO:teuthology.packaging:ref: None 2023-09-28T04:03:58.100 INFO:teuthology.packaging:tag: None 2023-09-28T04:03:58.100 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-09-27-0906-quincy 2023-09-28T04:03:58.101 INFO:teuthology.packaging:sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T04:03:58.101 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-09-27-0906-quincy 2023-09-28T04:03:58.337 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1161.g471b6dfd 2023-09-28T04:03:58.338 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-28T04:03:58.344 INFO:teuthology.task.internal:no buildpackages task found 2023-09-28T04:03:58.344 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-28T04:03:58.350 INFO:teuthology.task.internal:Saving configuration 2023-09-28T04:03:58.367 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-28T04:03:58.372 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T04:03:58.397 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 03:58:26.683842', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEgkcbwfR7XZNPUcl8Ib/j/BLssG951PHYcBVnxPvirIsPyF0M5iGVpnESGHanAc2xAfzWwR76bDlWg7y/V7LTE='} 2023-09-28T04:03:58.419 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 03:58:26.682276', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIPrsYX5ysB2+tp7lWpx+f/U8mR/v1mV6w8mB0mI9ZYLfAI9MaFtRgE0T2pfWfkZ4YY469JtwKN0+4kGu2iMQwg='} 2023-09-28T04:03:58.419 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-28T04:03:58.426 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-09-28T04:03:58.426 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-09-28T04:03:58.426 INFO:teuthology.run_tasks:Running task console_log... 2023-09-28T04:03:58.495 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f08f267db80>, signals=[15]) 2023-09-28T04:03:58.496 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-28T04:03:58.504 INFO:teuthology.task.internal:Opening connections... 2023-09-28T04:03:58.504 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T04:03:58.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T04:03:58.576 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2023-09-28T04:03:58.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T04:03:58.645 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-28T04:03:58.651 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-09-28T04:03:58.673 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-09-28T04:03:58.674 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-09-28T04:03:58.735 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2023-09-28T04:03:58.735 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8" 2023-09-28T04:03:58.735 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2023-09-28T04:03:58.735 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2023-09-28T04:03:58.735 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8" 2023-09-28T04:03:58.735 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-09-28T04:03:58.735 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-28T04:03:58.736 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-09-28T04:03:58.736 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-28T04:03:58.736 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2023-09-28T04:03:58.736 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T04:03:58.736 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T04:03:58.736 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-28T04:03:58.737 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-09-28T04:03:58.766 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-09-28T04:03:58.788 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-09-28T04:03:58.788 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-09-28T04:03:58.849 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2023-09-28T04:03:58.849 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8" 2023-09-28T04:03:58.850 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2023-09-28T04:03:58.850 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2023-09-28T04:03:58.850 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8" 2023-09-28T04:03:58.850 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-09-28T04:03:58.850 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-28T04:03:58.850 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-09-28T04:03:58.850 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-28T04:03:58.850 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2023-09-28T04:03:58.850 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T04:03:58.850 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T04:03:58.850 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-28T04:03:58.851 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-09-28T04:03:58.873 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-28T04:03:58.883 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-28T04:03:59.003 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-28T04:03:59.003 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2023-09-28T04:03:59.006 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2023-09-28T04:03:59.027 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-28T04:03:59.033 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-28T04:03:59.034 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2023-09-28T04:03:59.067 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2023-09-28T04:03:59.105 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-28T04:03:59.160 INFO:teuthology.run_tasks:Running task kernel... 2023-09-28T04:03:59.178 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-09-28T04:03:59.179 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-09-28T04:03:59.179 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-09-28T04:03:59.179 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-28T04:03:59.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T04:03:59.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-09-28T04:03:59.438 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-28T04:03:59.438 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-09-28T04:03:59.439 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-09-28T04:03:59.461 INFO:teuthology.orchestra.run.smithi118.stdout:4.18.0-489.el8.x86_64 2023-09-28T04:03:59.461 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-28T04:03:59.461 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-09-28T04:03:59.462 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum upgrade -y linux-firmware 2023-09-28T04:04:08.873 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - AppStream 5.0 MB/s | 33 MB 00:06 2023-09-28T04:04:18.731 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 48 MB 00:03 2023-09-28T04:04:26.139 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - Extras 33 kB/s | 18 kB 00:00 2023-09-28T04:04:27.023 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - Extras common packages 9.8 kB/s | 6.9 kB 00:00 2023-09-28T04:04:27.316 INFO:teuthology.orchestra.run.smithi118.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-09-28T04:04:28.883 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-09-28T04:04:32.716 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 427 kB/s | 24 kB 00:00 2023-09-28T04:04:36.532 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-09-28T04:04:36.533 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-09-28T04:04:36.533 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repo Size 2023-09-28T04:04:36.533 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-09-28T04:04:36.533 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2023-09-28T04:04:36.533 INFO:teuthology.orchestra.run.smithi118.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-09-28T04:04:36.533 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:04:36.534 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-09-28T04:04:36.534 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-09-28T04:04:36.534 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 1 Package 2023-09-28T04:04:36.534 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:04:36.534 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 286 M 2023-09-28T04:04:36.534 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2023-09-28T04:04:50.150 INFO:teuthology.orchestra.run.smithi118.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 21 MB/s | 286 MB 00:13 2023-09-28T04:04:50.150 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2023-09-28T04:04:50.150 INFO:teuthology.orchestra.run.smithi118.stdout:Total 21 MB/s | 286 MB 00:13 2023-09-28T04:04:51.850 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2023-09-28T04:04:51.918 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2023-09-28T04:04:51.919 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2023-09-28T04:04:53.755 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2023-09-28T04:04:53.786 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2023-09-28T04:05:13.469 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2023-09-28T04:05:13.868 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-09-28T04:05:14.113 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-28T04:05:14.337 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-28T04:05:14.337 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-09-28T04:05:15.129 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-28T04:05:15.129 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:05:15.129 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2023-09-28T04:05:15.129 INFO:teuthology.orchestra.run.smithi118.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-09-28T04:05:15.129 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:05:15.130 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-09-28T04:05:15.291 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-28T04:05:15.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-28T04:05:15.436 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-09-28T04:05:15.437 DEBUG:teuthology.orchestra.run.smithi118:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-09-28T04:05:15.439 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi118.front.sepia.ceph.com to complete... 2023-09-28T04:05:30.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28 04:05:30 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-09-28T04:05:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:FINISHED --2023-09-28 04:05:30-- 2023-09-28T04:05:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:Total wall clock time: 15s 2023-09-28T04:05:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:Downloaded: 1 files, 363M in 15s (24.4 MB/s) 2023-09-28T04:05:30.914 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-28T04:05:30.914 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-09-28T04:05:32.579 INFO:teuthology.orchestra.run.smithi118.stdout:Verifying... ######################################## 2023-09-28T04:05:32.621 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing... ######################################## 2023-09-28T04:05:32.730 INFO:teuthology.orchestra.run.smithi118.stdout:Updating / installing... 2023-09-28T04:06:10.669 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-09-28T04:06:35.988 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi118.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-09-28T04:06:35.988 DEBUG:teuthology.orchestra.run.smithi118:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-09-28T04:06:36.044 INFO:teuthology.orchestra.run.smithi118.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-28T04:06:36.044 INFO:teuthology.orchestra.run.smithi118.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-09-28T04:06:36.044 INFO:teuthology.orchestra.run.smithi118.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-28T04:06:36.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-09-28T04:06:36.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-09-28T04:06:36.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-09-28T04:06:36.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-09-28T04:06:36.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-09-28T04:06:36.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-09-28T04:06:36.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-09-28T04:06:36.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-09-28T04:06:36.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-09-28T04:06:36.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-09-28T04:06:36.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-09-28T04:06:36.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-09-28T04:06:36.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-09-28T04:06:36.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-09-28T04:06:36.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-09-28T04:06:36.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-09-28T04:06:36.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-09-28T04:06:36.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-09-28T04:06:36.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-09-28T04:06:36.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-09-28T04:06:36.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-09-28T04:06:36.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-09-28T04:06:36.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-09-28T04:06:36.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-09-28T04:06:36.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-09-28T04:06:36.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-09-28T04:06:36.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-09-28T04:06:36.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-09-28T04:06:36.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-09-28T04:06:36.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-09-28T04:06:36.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-09-28T04:06:36.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-09-28T04:06:36.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-09-28T04:06:36.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-09-28T04:06:36.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-09-28T04:06:36.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-09-28T04:06:36.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-09-28T04:06:36.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-09-28T04:06:36.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-09-28T04:06:36.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-09-28T04:06:36.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-09-28T04:06:36.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-09-28T04:06:36.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-09-28T04:06:36.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-09-28T04:06:36.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-09-28T04:06:36.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-09-28T04:06:36.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-09-28T04:06:36.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-09-28T04:06:36.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-09-28T04:06:36.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-09-28T04:06:36.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-09-28T04:06:36.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-09-28T04:06:36.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-09-28T04:06:36.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-09-28T04:06:36.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-09-28T04:06:36.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-09-28T04:06:36.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-09-28T04:06:36.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-09-28T04:06:36.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-09-28T04:06:36.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-09-28T04:06:36.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-09-28T04:06:36.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-09-28T04:06:36.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-09-28T04:06:36.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-09-28T04:06:36.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-09-28T04:06:36.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-09-28T04:06:36.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-09-28T04:06:36.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-09-28T04:06:36.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-09-28T04:06:36.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-09-28T04:06:36.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-09-28T04:06:36.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-09-28T04:06:36.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-09-28T04:06:36.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-09-28T04:06:36.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-09-28T04:06:36.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-09-28T04:06:36.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-09-28T04:06:36.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-09-28T04:06:36.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-09-28T04:06:36.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-09-28T04:06:36.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-09-28T04:06:36.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-09-28T04:06:36.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-09-28T04:06:36.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-09-28T04:06:36.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-09-28T04:06:36.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-09-28T04:06:36.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-09-28T04:06:36.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-09-28T04:06:36.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-09-28T04:06:36.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-09-28T04:06:36.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-09-28T04:06:36.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-09-28T04:06:36.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-09-28T04:06:36.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-09-28T04:06:36.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-09-28T04:06:36.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-09-28T04:06:36.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-09-28T04:06:36.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-09-28T04:06:36.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-09-28T04:06:36.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-09-28T04:06:36.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-09-28T04:06:36.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-09-28T04:06:36.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-09-28T04:06:36.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-09-28T04:06:36.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-09-28T04:06:36.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-09-28T04:06:36.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-09-28T04:06:36.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-09-28T04:06:36.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-09-28T04:06:36.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-09-28T04:06:36.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-09-28T04:06:36.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-09-28T04:06:36.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-09-28T04:06:36.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-09-28T04:06:36.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-09-28T04:06:36.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-09-28T04:06:36.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-09-28T04:06:36.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-09-28T04:06:36.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-09-28T04:06:36.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-09-28T04:06:36.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-09-28T04:06:36.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-09-28T04:06:36.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-09-28T04:06:36.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-09-28T04:06:36.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-09-28T04:06:36.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-09-28T04:06:36.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-09-28T04:06:36.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-09-28T04:06:36.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-09-28T04:06:36.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-09-28T04:06:36.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-09-28T04:06:36.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-09-28T04:06:36.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-09-28T04:06:36.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-09-28T04:06:36.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-09-28T04:06:36.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-09-28T04:06:36.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-09-28T04:06:36.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-09-28T04:06:36.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-09-28T04:06:36.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-09-28T04:06:36.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-09-28T04:06:36.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-09-28T04:06:36.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-09-28T04:06:36.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-09-28T04:06:36.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-09-28T04:06:36.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-09-28T04:06:36.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-09-28T04:06:36.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-09-28T04:06:36.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-09-28T04:06:36.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-09-28T04:06:36.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-09-28T04:06:36.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-09-28T04:06:36.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-09-28T04:06:36.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-09-28T04:06:36.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-09-28T04:06:36.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-09-28T04:06:36.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-09-28T04:06:36.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-09-28T04:06:36.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-09-28T04:06:36.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-09-28T04:06:36.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-09-28T04:06:36.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-09-28T04:06:36.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-09-28T04:06:36.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-09-28T04:06:36.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-09-28T04:06:36.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-09-28T04:06:36.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-09-28T04:06:36.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-09-28T04:06:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-09-28T04:06:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-09-28T04:06:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-09-28T04:06:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-09-28T04:06:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-09-28T04:06:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-09-28T04:06:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-09-28T04:06:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-09-28T04:06:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-09-28T04:06:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-09-28T04:06:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-09-28T04:06:36.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-09-28T04:06:36.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-09-28T04:06:36.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-09-28T04:06:36.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-09-28T04:06:36.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-09-28T04:06:36.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-09-28T04:06:36.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-09-28T04:06:36.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-09-28T04:06:36.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-09-28T04:06:36.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-09-28T04:06:36.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-09-28T04:06:36.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-09-28T04:06:36.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-09-28T04:06:36.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-09-28T04:06:36.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-09-28T04:06:36.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-09-28T04:06:36.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-09-28T04:06:36.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-09-28T04:06:36.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-09-28T04:06:36.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-09-28T04:06:36.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-09-28T04:06:36.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-09-28T04:06:36.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-09-28T04:06:36.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-09-28T04:06:36.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-09-28T04:06:36.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-09-28T04:06:36.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-09-28T04:06:36.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-09-28T04:06:36.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-09-28T04:06:36.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-09-28T04:06:36.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-09-28T04:06:36.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-09-28T04:06:36.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-09-28T04:06:36.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-09-28T04:06:36.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-09-28T04:06:36.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-09-28T04:06:36.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-09-28T04:06:36.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-09-28T04:06:36.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-09-28T04:06:36.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-09-28T04:06:36.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-09-28T04:06:36.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-09-28T04:06:36.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-09-28T04:06:36.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-09-28T04:06:36.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-09-28T04:06:36.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-09-28T04:06:36.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-09-28T04:06:36.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-09-28T04:06:36.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-09-28T04:06:36.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-09-28T04:06:36.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-09-28T04:06:36.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-09-28T04:06:36.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-09-28T04:06:36.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-09-28T04:06:36.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-09-28T04:06:36.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-09-28T04:06:36.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-09-28T04:06:36.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-09-28T04:06:36.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-09-28T04:06:36.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-09-28T04:06:36.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-09-28T04:06:36.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-09-28T04:06:36.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-09-28T04:06:36.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-09-28T04:06:36.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-09-28T04:06:36.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-09-28T04:06:36.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-09-28T04:06:36.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-09-28T04:06:36.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-09-28T04:06:36.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-09-28T04:06:36.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-09-28T04:06:36.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-09-28T04:06:36.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-09-28T04:06:36.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-09-28T04:06:36.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-09-28T04:06:36.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-09-28T04:06:36.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-09-28T04:06:36.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-09-28T04:06:36.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-09-28T04:06:36.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-09-28T04:06:36.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-09-28T04:06:36.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-09-28T04:06:36.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-09-28T04:06:36.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-09-28T04:06:36.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-09-28T04:06:36.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-09-28T04:06:36.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-09-28T04:06:36.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-09-28T04:06:36.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-09-28T04:06:36.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-09-28T04:06:36.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-09-28T04:06:36.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-09-28T04:06:36.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-09-28T04:06:36.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-09-28T04:06:36.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-09-28T04:06:36.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-09-28T04:06:36.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-09-28T04:06:36.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-09-28T04:06:36.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-09-28T04:06:36.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-09-28T04:06:36.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-09-28T04:06:36.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-09-28T04:06:36.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-09-28T04:06:36.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-09-28T04:06:36.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-09-28T04:06:36.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-09-28T04:06:36.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-09-28T04:06:36.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-09-28T04:06:36.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-09-28T04:06:36.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-09-28T04:06:36.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-09-28T04:06:36.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-09-28T04:06:36.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-09-28T04:06:36.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-09-28T04:06:36.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-09-28T04:06:36.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-09-28T04:06:36.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-09-28T04:06:36.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-09-28T04:06:36.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-09-28T04:06:36.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-09-28T04:06:36.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-09-28T04:06:36.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-09-28T04:06:36.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-09-28T04:06:36.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-09-28T04:06:36.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-09-28T04:06:36.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-09-28T04:06:36.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-09-28T04:06:36.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-09-28T04:06:36.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-09-28T04:06:36.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-09-28T04:06:36.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-09-28T04:06:36.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-09-28T04:06:36.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-09-28T04:06:36.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-09-28T04:06:36.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-09-28T04:06:36.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-09-28T04:06:36.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-09-28T04:06:36.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-09-28T04:06:36.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-09-28T04:06:36.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-09-28T04:06:36.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-09-28T04:06:36.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-09-28T04:06:36.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-09-28T04:06:36.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-09-28T04:06:36.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-09-28T04:06:36.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-09-28T04:06:36.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-09-28T04:06:36.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-09-28T04:06:36.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-09-28T04:06:36.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-09-28T04:06:36.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-09-28T04:06:36.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-09-28T04:06:36.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-09-28T04:06:36.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-09-28T04:06:36.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-09-28T04:06:36.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-09-28T04:06:36.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-09-28T04:06:36.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-09-28T04:06:36.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-09-28T04:06:36.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-09-28T04:06:36.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-09-28T04:06:36.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-09-28T04:06:36.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-09-28T04:06:36.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-09-28T04:06:36.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-09-28T04:06:36.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-09-28T04:06:36.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-09-28T04:06:36.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-09-28T04:06:36.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-09-28T04:06:36.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-09-28T04:06:36.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-09-28T04:06:36.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-09-28T04:06:36.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-09-28T04:06:36.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-09-28T04:06:36.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-09-28T04:06:36.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-09-28T04:06:36.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-09-28T04:06:36.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-09-28T04:06:36.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-09-28T04:06:36.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-09-28T04:06:36.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-09-28T04:06:36.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-09-28T04:06:36.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-09-28T04:06:36.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-09-28T04:06:36.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-09-28T04:06:36.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-09-28T04:06:36.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-09-28T04:06:36.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-09-28T04:06:36.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-09-28T04:06:36.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-09-28T04:06:36.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-09-28T04:06:36.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-09-28T04:06:36.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-09-28T04:06:36.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-09-28T04:06:36.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-09-28T04:06:36.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-09-28T04:06:36.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-09-28T04:06:36.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-09-28T04:06:36.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-09-28T04:06:36.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-09-28T04:06:36.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-09-28T04:06:36.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-09-28T04:06:36.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-09-28T04:06:36.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-09-28T04:06:36.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-09-28T04:06:36.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-09-28T04:06:36.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-09-28T04:06:36.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-09-28T04:06:36.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-09-28T04:06:36.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-09-28T04:06:36.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-09-28T04:06:36.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-09-28T04:06:36.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-09-28T04:06:36.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-09-28T04:06:36.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-09-28T04:06:36.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-09-28T04:06:36.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-09-28T04:06:36.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-09-28T04:06:36.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-09-28T04:06:36.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-09-28T04:06:36.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-09-28T04:06:36.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-09-28T04:06:36.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-09-28T04:06:36.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-09-28T04:06:36.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-09-28T04:06:36.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-09-28T04:06:36.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-09-28T04:06:36.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-09-28T04:06:36.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-09-28T04:06:36.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-09-28T04:06:36.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-09-28T04:06:36.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-09-28T04:06:36.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-09-28T04:06:36.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-09-28T04:06:36.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-09-28T04:06:36.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-09-28T04:06:36.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-09-28T04:06:36.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-09-28T04:06:36.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-09-28T04:06:36.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-09-28T04:06:36.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-09-28T04:06:36.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-09-28T04:06:36.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-09-28T04:06:36.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-09-28T04:06:36.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-09-28T04:06:36.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-09-28T04:06:36.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-09-28T04:06:36.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-09-28T04:06:36.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-09-28T04:06:36.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-09-28T04:06:36.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-09-28T04:06:36.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-09-28T04:06:36.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-09-28T04:06:36.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-09-28T04:06:36.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-09-28T04:06:36.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-09-28T04:06:36.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-09-28T04:06:36.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-09-28T04:06:36.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-09-28T04:06:36.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-09-28T04:06:36.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-09-28T04:06:36.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-09-28T04:06:36.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-09-28T04:06:36.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-09-28T04:06:36.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-09-28T04:06:36.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-09-28T04:06:36.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-09-28T04:06:36.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-09-28T04:06:36.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-09-28T04:06:36.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-09-28T04:06:36.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-09-28T04:06:36.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-09-28T04:06:36.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-09-28T04:06:36.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-09-28T04:06:36.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-09-28T04:06:36.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-09-28T04:06:36.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-09-28T04:06:36.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-09-28T04:06:36.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-09-28T04:06:36.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-09-28T04:06:36.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-09-28T04:06:36.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-09-28T04:06:36.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-09-28T04:06:36.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-09-28T04:06:36.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-09-28T04:06:36.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-09-28T04:06:36.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-09-28T04:06:36.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-09-28T04:06:36.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-09-28T04:06:36.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-09-28T04:06:36.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-09-28T04:06:36.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-09-28T04:06:36.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-09-28T04:06:36.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-09-28T04:06:36.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-09-28T04:06:36.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-09-28T04:06:36.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-09-28T04:06:36.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-09-28T04:06:36.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-09-28T04:06:36.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-09-28T04:06:36.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-09-28T04:06:36.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-09-28T04:06:36.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-09-28T04:06:36.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-09-28T04:06:36.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-09-28T04:06:36.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-09-28T04:06:36.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-09-28T04:06:36.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-09-28T04:06:36.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-09-28T04:06:36.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-09-28T04:06:36.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-09-28T04:06:36.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-09-28T04:06:36.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-09-28T04:06:36.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-09-28T04:06:36.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-09-28T04:06:36.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-09-28T04:06:36.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-09-28T04:06:36.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-09-28T04:06:36.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-09-28T04:06:36.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-09-28T04:06:36.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-09-28T04:06:36.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-09-28T04:06:36.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-09-28T04:06:36.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-09-28T04:06:36.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-09-28T04:06:36.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-09-28T04:06:36.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-09-28T04:06:36.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-09-28T04:06:36.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-09-28T04:06:36.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-09-28T04:06:36.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-09-28T04:06:36.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-09-28T04:06:36.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-09-28T04:06:36.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-09-28T04:06:36.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-09-28T04:06:36.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-09-28T04:06:36.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-09-28T04:06:36.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-09-28T04:06:36.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-09-28T04:06:36.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-09-28T04:06:36.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-09-28T04:06:36.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-09-28T04:06:36.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-09-28T04:06:36.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-09-28T04:06:36.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-09-28T04:06:36.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-09-28T04:06:36.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-09-28T04:06:36.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-09-28T04:06:36.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-09-28T04:06:36.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-09-28T04:06:36.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-09-28T04:06:36.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-09-28T04:06:36.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-09-28T04:06:36.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-09-28T04:06:36.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-09-28T04:06:36.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-09-28T04:06:36.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-09-28T04:06:36.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-09-28T04:06:36.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-09-28T04:06:36.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-09-28T04:06:36.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-09-28T04:06:36.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-09-28T04:06:36.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-09-28T04:06:36.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-09-28T04:06:36.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-09-28T04:06:36.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-09-28T04:06:36.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-09-28T04:06:36.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-09-28T04:06:36.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-09-28T04:06:36.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-09-28T04:06:36.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-09-28T04:06:36.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-09-28T04:06:36.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-09-28T04:06:36.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-09-28T04:06:36.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-09-28T04:06:36.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-09-28T04:06:36.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-09-28T04:06:36.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-09-28T04:06:36.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-09-28T04:06:36.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-09-28T04:06:36.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-09-28T04:06:36.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-09-28T04:06:36.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-09-28T04:06:36.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-09-28T04:06:36.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-09-28T04:06:36.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-09-28T04:06:36.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-09-28T04:06:36.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-09-28T04:06:36.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-09-28T04:06:36.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-09-28T04:06:36.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-09-28T04:06:36.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-09-28T04:06:36.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-09-28T04:06:36.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-09-28T04:06:36.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-09-28T04:06:36.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-09-28T04:06:36.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-09-28T04:06:36.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-09-28T04:06:36.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-09-28T04:06:36.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-09-28T04:06:36.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-09-28T04:06:36.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-09-28T04:06:36.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-09-28T04:06:36.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-09-28T04:06:36.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-09-28T04:06:36.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-09-28T04:06:36.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-09-28T04:06:36.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-09-28T04:06:36.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-09-28T04:06:36.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-09-28T04:06:36.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-09-28T04:06:36.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-09-28T04:06:36.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-09-28T04:06:36.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-09-28T04:06:36.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-09-28T04:06:36.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-09-28T04:06:36.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-09-28T04:06:36.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-09-28T04:06:36.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-09-28T04:06:36.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-09-28T04:06:36.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-09-28T04:06:36.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-09-28T04:06:36.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-09-28T04:06:36.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-09-28T04:06:36.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-09-28T04:06:36.097 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-09-28T04:06:36.097 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-09-28T04:06:36.097 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-09-28T04:06:36.097 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-09-28T04:06:36.097 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-09-28T04:06:36.097 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-09-28T04:06:36.097 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-09-28T04:06:36.097 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-09-28T04:06:36.097 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-09-28T04:06:36.097 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-09-28T04:06:36.097 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-09-28T04:06:36.098 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-09-28T04:06:36.098 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-09-28T04:06:36.098 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-09-28T04:06:36.098 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-09-28T04:06:36.098 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-09-28T04:06:36.098 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-09-28T04:06:36.098 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-09-28T04:06:36.098 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-09-28T04:06:36.098 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-09-28T04:06:36.098 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-09-28T04:06:36.098 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-09-28T04:06:36.098 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-09-28T04:06:36.099 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-09-28T04:06:36.099 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-09-28T04:06:36.099 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-09-28T04:06:36.099 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-09-28T04:06:36.099 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-09-28T04:06:36.099 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-09-28T04:06:36.099 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-09-28T04:06:36.099 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-09-28T04:06:36.099 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-09-28T04:06:36.099 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-09-28T04:06:36.099 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-09-28T04:06:36.100 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-09-28T04:06:36.100 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-09-28T04:06:36.100 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-09-28T04:06:36.100 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-09-28T04:06:36.100 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-09-28T04:06:36.100 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-09-28T04:06:36.100 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-09-28T04:06:36.100 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-09-28T04:06:36.100 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-09-28T04:06:36.100 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-09-28T04:06:36.100 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-09-28T04:06:36.100 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-09-28T04:06:36.101 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-09-28T04:06:36.101 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-09-28T04:06:36.101 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-09-28T04:06:36.101 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-09-28T04:06:36.101 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-09-28T04:06:36.101 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-09-28T04:06:36.101 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-09-28T04:06:36.101 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-09-28T04:06:36.101 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-09-28T04:06:36.101 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-09-28T04:06:36.101 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-09-28T04:06:36.102 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-09-28T04:06:36.102 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-09-28T04:06:36.102 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-09-28T04:06:36.102 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-09-28T04:06:36.102 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-09-28T04:06:36.102 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-09-28T04:06:36.102 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-09-28T04:06:36.102 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-09-28T04:06:36.102 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-09-28T04:06:36.102 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-09-28T04:06:36.102 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-09-28T04:06:36.103 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-09-28T04:06:36.103 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-09-28T04:06:36.103 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-09-28T04:06:36.103 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-09-28T04:06:36.103 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-09-28T04:06:36.103 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-09-28T04:06:36.103 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-09-28T04:06:36.103 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-09-28T04:06:36.103 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-09-28T04:06:36.103 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-09-28T04:06:36.103 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-09-28T04:06:36.103 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-09-28T04:06:36.104 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-09-28T04:06:36.104 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-09-28T04:06:36.104 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-09-28T04:06:36.104 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-09-28T04:06:36.104 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-09-28T04:06:36.104 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-09-28T04:06:36.104 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-09-28T04:06:36.104 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-09-28T04:06:36.104 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-09-28T04:06:36.104 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-09-28T04:06:36.104 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-09-28T04:06:36.105 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-09-28T04:06:36.105 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-09-28T04:06:36.105 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-09-28T04:06:36.105 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-09-28T04:06:36.105 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-09-28T04:06:36.105 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-09-28T04:06:36.105 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-09-28T04:06:36.105 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-09-28T04:06:36.105 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-09-28T04:06:36.105 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-09-28T04:06:36.105 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-09-28T04:06:36.105 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-09-28T04:06:36.106 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-09-28T04:06:36.106 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-09-28T04:06:36.106 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-09-28T04:06:36.106 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-09-28T04:06:36.106 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-09-28T04:06:36.106 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-09-28T04:06:36.106 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-09-28T04:06:36.106 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-09-28T04:06:36.106 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-09-28T04:06:36.106 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-09-28T04:06:36.106 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-09-28T04:06:36.106 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-09-28T04:06:36.107 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-09-28T04:06:36.107 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-09-28T04:06:36.107 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-09-28T04:06:36.107 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-09-28T04:06:36.107 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-09-28T04:06:36.107 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-09-28T04:06:36.107 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-09-28T04:06:36.107 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-09-28T04:06:36.107 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-09-28T04:06:36.107 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-09-28T04:06:36.107 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-09-28T04:06:36.108 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-09-28T04:06:36.108 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-09-28T04:06:36.108 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-09-28T04:06:36.108 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-09-28T04:06:36.108 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-09-28T04:06:36.108 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-09-28T04:06:36.108 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-09-28T04:06:36.108 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-09-28T04:06:36.108 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-09-28T04:06:36.108 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-09-28T04:06:36.108 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-09-28T04:06:36.108 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-09-28T04:06:36.109 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-09-28T04:06:36.109 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-09-28T04:06:36.109 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-09-28T04:06:36.109 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-09-28T04:06:36.109 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-09-28T04:06:36.109 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-09-28T04:06:36.109 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-09-28T04:06:36.109 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-09-28T04:06:36.109 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-09-28T04:06:36.109 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-09-28T04:06:36.109 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-09-28T04:06:36.109 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-09-28T04:06:36.110 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-09-28T04:06:36.110 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-09-28T04:06:36.110 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-09-28T04:06:36.110 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-09-28T04:06:36.110 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-09-28T04:06:36.110 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-09-28T04:06:36.110 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-09-28T04:06:36.110 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-09-28T04:06:36.110 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-09-28T04:06:36.110 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-09-28T04:06:36.110 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-09-28T04:06:36.111 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-09-28T04:06:36.111 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-09-28T04:06:36.111 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-09-28T04:06:36.111 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-09-28T04:06:36.111 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-09-28T04:06:36.111 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-09-28T04:06:36.111 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-09-28T04:06:36.111 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-09-28T04:06:36.111 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-09-28T04:06:36.111 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-09-28T04:06:36.111 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-09-28T04:06:36.111 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-09-28T04:06:36.111 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-09-28T04:06:36.112 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-09-28T04:06:36.112 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-09-28T04:06:36.112 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-09-28T04:06:36.112 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-09-28T04:06:36.112 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-09-28T04:06:36.112 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-09-28T04:06:36.112 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-09-28T04:06:36.112 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-09-28T04:06:36.112 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-09-28T04:06:36.112 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-09-28T04:06:36.112 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-09-28T04:06:36.112 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-09-28T04:06:36.112 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-09-28T04:06:36.113 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-09-28T04:06:36.113 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-09-28T04:06:36.113 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-09-28T04:06:36.113 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-09-28T04:06:36.113 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-09-28T04:06:36.113 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-09-28T04:06:36.113 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-09-28T04:06:36.113 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-09-28T04:06:36.113 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-09-28T04:06:36.113 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-09-28T04:06:36.114 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-09-28T04:06:36.114 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-09-28T04:06:36.114 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-09-28T04:06:36.114 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-09-28T04:06:36.114 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-09-28T04:06:36.114 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-09-28T04:06:36.114 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-09-28T04:06:36.114 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-09-28T04:06:36.114 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-09-28T04:06:36.114 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-09-28T04:06:36.114 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-09-28T04:06:36.115 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-09-28T04:06:36.115 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-09-28T04:06:36.115 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-09-28T04:06:36.115 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-09-28T04:06:36.115 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-09-28T04:06:36.115 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-09-28T04:06:36.115 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-09-28T04:06:36.115 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-09-28T04:06:36.115 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-09-28T04:06:36.115 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-09-28T04:06:36.115 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-09-28T04:06:36.115 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-09-28T04:06:36.115 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-09-28T04:06:36.116 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-09-28T04:06:36.116 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-09-28T04:06:36.116 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-09-28T04:06:36.116 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-09-28T04:06:36.116 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-09-28T04:06:36.116 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-09-28T04:06:36.116 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-09-28T04:06:36.116 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-09-28T04:06:36.116 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-09-28T04:06:36.116 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-09-28T04:06:36.116 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-09-28T04:06:36.116 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-09-28T04:06:36.116 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-09-28T04:06:36.117 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-09-28T04:06:36.117 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-09-28T04:06:36.117 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-09-28T04:06:36.117 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-09-28T04:06:36.117 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-09-28T04:06:36.117 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-09-28T04:06:36.117 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-09-28T04:06:36.117 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-09-28T04:06:36.117 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-09-28T04:06:36.117 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-09-28T04:06:36.117 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-09-28T04:06:36.117 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-09-28T04:06:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-09-28T04:06:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-09-28T04:06:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-09-28T04:06:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-09-28T04:06:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-09-28T04:06:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-09-28T04:06:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-09-28T04:06:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-09-28T04:06:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-09-28T04:06:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-09-28T04:06:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-09-28T04:06:36.119 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-09-28T04:06:36.119 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-09-28T04:06:36.119 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-09-28T04:06:36.119 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-09-28T04:06:36.119 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-09-28T04:06:36.119 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-09-28T04:06:36.119 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-09-28T04:06:36.119 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-09-28T04:06:36.119 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-09-28T04:06:36.119 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-09-28T04:06:36.119 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-09-28T04:06:36.119 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-09-28T04:06:36.120 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-09-28T04:06:36.120 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-09-28T04:06:36.120 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-09-28T04:06:36.120 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-09-28T04:06:36.120 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-09-28T04:06:36.120 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-09-28T04:06:36.120 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-09-28T04:06:36.120 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-09-28T04:06:36.120 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-09-28T04:06:36.120 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-09-28T04:06:36.120 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-09-28T04:06:36.120 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-09-28T04:06:36.121 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-09-28T04:06:36.121 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-09-28T04:06:36.121 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-09-28T04:06:36.121 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-09-28T04:06:36.121 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-09-28T04:06:36.121 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-09-28T04:06:36.121 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-09-28T04:06:36.121 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-09-28T04:06:36.121 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-09-28T04:06:36.121 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-09-28T04:06:36.121 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-09-28T04:06:36.121 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-09-28T04:06:36.121 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-09-28T04:06:36.122 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-09-28T04:06:36.122 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-09-28T04:06:36.122 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-09-28T04:06:36.122 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-09-28T04:06:36.122 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-09-28T04:06:36.122 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-09-28T04:06:36.122 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-09-28T04:06:36.122 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-09-28T04:06:36.122 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-09-28T04:06:36.122 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-09-28T04:06:36.122 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-09-28T04:06:36.123 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-09-28T04:06:36.123 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-09-28T04:06:36.123 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-09-28T04:06:36.123 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-09-28T04:06:36.123 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-09-28T04:06:36.123 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-09-28T04:06:36.123 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-09-28T04:06:36.123 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-09-28T04:06:36.123 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-09-28T04:06:36.123 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-09-28T04:06:36.123 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-09-28T04:06:36.123 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-09-28T04:06:36.124 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-09-28T04:06:36.124 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-09-28T04:06:36.124 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-09-28T04:06:36.124 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-09-28T04:06:36.124 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-09-28T04:06:36.124 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-09-28T04:06:36.124 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-09-28T04:06:36.124 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-09-28T04:06:36.124 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-09-28T04:06:36.124 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-09-28T04:06:36.124 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-09-28T04:06:36.124 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-09-28T04:06:36.125 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-09-28T04:06:36.125 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-09-28T04:06:36.125 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-09-28T04:06:36.125 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-09-28T04:06:36.125 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-09-28T04:06:36.125 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-09-28T04:06:36.125 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-09-28T04:06:36.125 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-09-28T04:06:36.125 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-09-28T04:06:36.125 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-09-28T04:06:36.125 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-09-28T04:06:36.125 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-09-28T04:06:36.126 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-09-28T04:06:36.126 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-09-28T04:06:36.126 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-09-28T04:06:36.126 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-09-28T04:06:36.126 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-09-28T04:06:36.126 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-09-28T04:06:36.126 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-09-28T04:06:36.126 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-09-28T04:06:36.126 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-09-28T04:06:36.126 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-09-28T04:06:36.126 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-09-28T04:06:36.127 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-09-28T04:06:36.127 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-09-28T04:06:36.127 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-09-28T04:06:36.127 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-09-28T04:06:36.127 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-09-28T04:06:36.127 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-09-28T04:06:36.127 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-09-28T04:06:36.127 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-09-28T04:06:36.127 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-09-28T04:06:36.127 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-09-28T04:06:36.127 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-09-28T04:06:36.127 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-09-28T04:06:36.128 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-09-28T04:06:36.128 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-09-28T04:06:36.128 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-09-28T04:06:36.128 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-09-28T04:06:36.128 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-09-28T04:06:36.128 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-09-28T04:06:36.128 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-09-28T04:06:36.128 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-09-28T04:06:36.128 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-09-28T04:06:36.128 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-09-28T04:06:36.128 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-09-28T04:06:36.128 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-09-28T04:06:36.129 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-09-28T04:06:36.129 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-09-28T04:06:36.129 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-09-28T04:06:36.129 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-09-28T04:06:36.129 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-09-28T04:06:36.129 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-09-28T04:06:36.129 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-09-28T04:06:36.129 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-09-28T04:06:36.129 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-09-28T04:06:36.129 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-09-28T04:06:36.129 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-09-28T04:06:36.129 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-09-28T04:06:36.130 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-09-28T04:06:36.130 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-09-28T04:06:36.130 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-09-28T04:06:36.130 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-09-28T04:06:36.130 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-09-28T04:06:36.130 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-09-28T04:06:36.130 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-09-28T04:06:36.130 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-09-28T04:06:36.130 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-09-28T04:06:36.130 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-09-28T04:06:36.130 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-09-28T04:06:36.130 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-09-28T04:06:36.131 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-09-28T04:06:36.131 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-09-28T04:06:36.131 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-09-28T04:06:36.131 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-09-28T04:06:36.131 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-09-28T04:06:36.131 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-09-28T04:06:36.131 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-09-28T04:06:36.131 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-09-28T04:06:36.131 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-09-28T04:06:36.131 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-09-28T04:06:36.131 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-09-28T04:06:36.131 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-09-28T04:06:36.132 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-09-28T04:06:36.132 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-09-28T04:06:36.132 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-09-28T04:06:36.132 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-09-28T04:06:36.132 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-09-28T04:06:36.132 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-09-28T04:06:36.132 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-09-28T04:06:36.132 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-09-28T04:06:36.132 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-09-28T04:06:36.132 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-09-28T04:06:36.132 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-09-28T04:06:36.132 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-09-28T04:06:36.133 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-09-28T04:06:36.133 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-09-28T04:06:36.133 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-09-28T04:06:36.133 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-09-28T04:06:36.133 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-09-28T04:06:36.133 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-09-28T04:06:36.133 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-09-28T04:06:36.133 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-09-28T04:06:36.133 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-09-28T04:06:36.133 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-09-28T04:06:36.133 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-09-28T04:06:36.133 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-09-28T04:06:36.134 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-09-28T04:06:36.134 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-09-28T04:06:36.134 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-09-28T04:06:36.134 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-09-28T04:06:36.134 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-09-28T04:06:36.134 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-09-28T04:06:36.134 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-09-28T04:06:36.134 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-09-28T04:06:36.134 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-09-28T04:06:36.134 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-09-28T04:06:36.134 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-09-28T04:06:36.135 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-09-28T04:06:36.135 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-09-28T04:06:36.135 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-09-28T04:06:36.135 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-09-28T04:06:36.135 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-09-28T04:06:36.135 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-09-28T04:06:36.135 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-09-28T04:06:36.135 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-09-28T04:06:36.135 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-09-28T04:06:36.135 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-09-28T04:06:36.135 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-09-28T04:06:36.136 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-09-28T04:06:36.136 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-09-28T04:06:36.136 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-09-28T04:06:36.136 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-09-28T04:06:36.136 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-09-28T04:06:36.136 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-09-28T04:06:36.136 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-09-28T04:06:36.136 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-09-28T04:06:36.136 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-09-28T04:06:36.136 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-09-28T04:06:36.136 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-09-28T04:06:36.136 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-09-28T04:06:36.137 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-09-28T04:06:36.137 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-09-28T04:06:36.137 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-09-28T04:06:36.137 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-09-28T04:06:36.137 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-09-28T04:06:36.137 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-09-28T04:06:36.137 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-09-28T04:06:36.137 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-09-28T04:06:36.137 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-09-28T04:06:36.137 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-09-28T04:06:36.137 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-09-28T04:06:36.137 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-09-28T04:06:36.138 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-09-28T04:06:36.138 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-09-28T04:06:36.138 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-09-28T04:06:36.138 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-09-28T04:06:36.138 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-09-28T04:06:36.138 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-09-28T04:06:36.138 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-09-28T04:06:36.138 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-09-28T04:06:36.138 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-09-28T04:06:36.138 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-09-28T04:06:36.138 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-09-28T04:06:36.138 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-09-28T04:06:36.139 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-09-28T04:06:36.139 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-09-28T04:06:36.139 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-09-28T04:06:36.139 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-09-28T04:06:36.139 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-09-28T04:06:36.139 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-09-28T04:06:36.139 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-09-28T04:06:36.139 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-09-28T04:06:36.139 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-09-28T04:06:36.139 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-09-28T04:06:36.139 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-09-28T04:06:36.139 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-09-28T04:06:36.140 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-09-28T04:06:36.140 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-09-28T04:06:36.140 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-09-28T04:06:36.140 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-09-28T04:06:36.140 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-09-28T04:06:36.140 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-09-28T04:06:36.140 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-09-28T04:06:36.140 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-09-28T04:06:36.140 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-09-28T04:06:36.140 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-09-28T04:06:36.140 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-09-28T04:06:36.140 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-09-28T04:06:36.141 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-09-28T04:06:36.141 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-09-28T04:06:36.141 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-09-28T04:06:36.141 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-09-28T04:06:36.141 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-09-28T04:06:36.141 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-09-28T04:06:36.141 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-09-28T04:06:36.141 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-09-28T04:06:36.141 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-09-28T04:06:36.141 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-09-28T04:06:36.141 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-09-28T04:06:36.141 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-09-28T04:06:36.142 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-09-28T04:06:36.142 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-09-28T04:06:36.142 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-09-28T04:06:36.142 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-09-28T04:06:36.142 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-09-28T04:06:36.142 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-09-28T04:06:36.142 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-09-28T04:06:36.142 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-09-28T04:06:36.142 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-09-28T04:06:36.142 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-09-28T04:06:36.142 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-09-28T04:06:36.143 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-09-28T04:06:36.143 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-09-28T04:06:36.143 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-09-28T04:06:36.143 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-09-28T04:06:36.143 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-09-28T04:06:36.143 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-09-28T04:06:36.143 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-09-28T04:06:36.143 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-09-28T04:06:36.143 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-09-28T04:06:36.143 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-09-28T04:06:36.143 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-09-28T04:06:36.143 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-09-28T04:06:36.144 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-09-28T04:06:36.144 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-09-28T04:06:36.144 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-09-28T04:06:36.144 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-09-28T04:06:36.144 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-09-28T04:06:36.144 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-09-28T04:06:36.144 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-09-28T04:06:36.144 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-09-28T04:06:36.144 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-09-28T04:06:36.144 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-09-28T04:06:36.144 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-09-28T04:06:36.144 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-09-28T04:06:36.144 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-09-28T04:06:36.145 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-09-28T04:06:36.145 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-09-28T04:06:36.145 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-09-28T04:06:36.145 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-09-28T04:06:36.145 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-09-28T04:06:36.145 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-09-28T04:06:36.145 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-09-28T04:06:36.145 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-09-28T04:06:36.145 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-09-28T04:06:36.145 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-09-28T04:06:36.145 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-09-28T04:06:36.145 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-09-28T04:06:36.145 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-09-28T04:06:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-09-28T04:06:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-09-28T04:06:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-09-28T04:06:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-09-28T04:06:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-09-28T04:06:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-09-28T04:06:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-09-28T04:06:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-09-28T04:06:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-09-28T04:06:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-09-28T04:06:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-09-28T04:06:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-09-28T04:06:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-09-28T04:06:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-09-28T04:06:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-09-28T04:06:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-09-28T04:06:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-09-28T04:06:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-09-28T04:06:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-09-28T04:06:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-09-28T04:06:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-09-28T04:06:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-09-28T04:06:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-09-28T04:06:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-09-28T04:06:36.147 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-09-28T04:06:36.148 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-09-28T04:06:36.148 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-09-28T04:06:36.148 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-09-28T04:06:36.148 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-09-28T04:06:36.148 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-09-28T04:06:36.148 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-09-28T04:06:36.148 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-09-28T04:06:36.148 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-09-28T04:06:36.148 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-09-28T04:06:36.148 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-09-28T04:06:36.148 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-09-28T04:06:36.148 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-09-28T04:06:36.149 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-09-28T04:06:36.149 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-09-28T04:06:36.149 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-09-28T04:06:36.149 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-09-28T04:06:36.149 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-09-28T04:06:36.149 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-09-28T04:06:36.149 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-09-28T04:06:36.149 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-09-28T04:06:36.149 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-09-28T04:06:36.149 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-09-28T04:06:36.149 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-09-28T04:06:36.149 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-09-28T04:06:36.150 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-09-28T04:06:36.150 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-09-28T04:06:36.150 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-09-28T04:06:36.150 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-09-28T04:06:36.150 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-09-28T04:06:36.150 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-09-28T04:06:36.150 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-09-28T04:06:36.150 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-09-28T04:06:36.150 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-09-28T04:06:36.150 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-09-28T04:06:36.150 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-09-28T04:06:36.151 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-09-28T04:06:36.151 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-09-28T04:06:36.151 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-09-28T04:06:36.151 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-09-28T04:06:36.151 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-09-28T04:06:36.151 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-09-28T04:06:36.151 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-09-28T04:06:36.151 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-09-28T04:06:36.151 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-09-28T04:06:36.151 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-09-28T04:06:36.151 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-09-28T04:06:36.151 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-09-28T04:06:36.152 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-09-28T04:06:36.152 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-09-28T04:06:36.152 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-09-28T04:06:36.152 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-09-28T04:06:36.152 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-09-28T04:06:36.152 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-09-28T04:06:36.152 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-09-28T04:06:36.152 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-09-28T04:06:36.152 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-09-28T04:06:36.152 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-09-28T04:06:36.152 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-09-28T04:06:36.152 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-09-28T04:06:36.153 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-09-28T04:06:36.153 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-09-28T04:06:36.153 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-09-28T04:06:36.153 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-09-28T04:06:36.153 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-09-28T04:06:36.153 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-09-28T04:06:36.153 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-09-28T04:06:36.153 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-09-28T04:06:36.153 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-09-28T04:06:36.153 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-09-28T04:06:36.153 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-09-28T04:06:36.153 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-09-28T04:06:36.154 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-09-28T04:06:36.154 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-09-28T04:06:36.154 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-09-28T04:06:36.154 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-09-28T04:06:36.154 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-09-28T04:06:36.154 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-09-28T04:06:36.154 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-09-28T04:06:36.154 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-09-28T04:06:36.154 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-09-28T04:06:36.154 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-09-28T04:06:36.154 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-09-28T04:06:36.154 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-09-28T04:06:36.155 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-09-28T04:06:36.155 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-09-28T04:06:36.155 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-09-28T04:06:36.155 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-09-28T04:06:36.155 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-09-28T04:06:36.155 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-09-28T04:06:36.155 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-09-28T04:06:36.155 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-09-28T04:06:36.155 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-09-28T04:06:36.155 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-09-28T04:06:36.155 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-09-28T04:06:36.155 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-09-28T04:06:36.156 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-09-28T04:06:36.156 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-09-28T04:06:36.156 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-09-28T04:06:36.156 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-09-28T04:06:36.156 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-09-28T04:06:36.156 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-09-28T04:06:36.156 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-09-28T04:06:36.156 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-09-28T04:06:36.156 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-09-28T04:06:36.156 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-09-28T04:06:36.156 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-09-28T04:06:36.156 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-09-28T04:06:36.157 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-09-28T04:06:36.157 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-09-28T04:06:36.157 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-09-28T04:06:36.157 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-09-28T04:06:36.157 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-09-28T04:06:36.157 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-09-28T04:06:36.157 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-09-28T04:06:36.157 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-09-28T04:06:36.157 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-09-28T04:06:36.157 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-09-28T04:06:36.157 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-09-28T04:06:36.157 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-09-28T04:06:36.157 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-09-28T04:06:36.158 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-09-28T04:06:36.158 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-09-28T04:06:36.158 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-09-28T04:06:36.158 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-09-28T04:06:36.158 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-09-28T04:06:36.158 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-09-28T04:06:36.158 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-09-28T04:06:36.158 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-09-28T04:06:36.158 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-09-28T04:06:36.158 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-09-28T04:06:36.158 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-09-28T04:06:36.158 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-09-28T04:06:36.159 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-09-28T04:06:36.159 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-09-28T04:06:36.159 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-09-28T04:06:36.159 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-09-28T04:06:36.159 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-09-28T04:06:36.159 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-09-28T04:06:36.159 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-09-28T04:06:36.159 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-09-28T04:06:36.159 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-09-28T04:06:36.159 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-09-28T04:06:36.159 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-09-28T04:06:36.159 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-09-28T04:06:36.160 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-09-28T04:06:36.160 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-09-28T04:06:36.160 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-09-28T04:06:36.160 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-09-28T04:06:36.160 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-09-28T04:06:36.160 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-09-28T04:06:36.160 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-09-28T04:06:36.160 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-09-28T04:06:36.160 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-09-28T04:06:36.160 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-09-28T04:06:36.160 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-09-28T04:06:36.160 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-09-28T04:06:36.161 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-09-28T04:06:36.161 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-09-28T04:06:36.161 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-09-28T04:06:36.161 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-09-28T04:06:36.161 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-09-28T04:06:36.161 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-09-28T04:06:36.161 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-09-28T04:06:36.161 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-09-28T04:06:36.161 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-09-28T04:06:36.161 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-09-28T04:06:36.161 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-09-28T04:06:36.161 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-09-28T04:06:36.161 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-09-28T04:06:36.162 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-09-28T04:06:36.162 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-09-28T04:06:36.162 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-09-28T04:06:36.162 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-09-28T04:06:36.162 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-09-28T04:06:36.162 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-09-28T04:06:36.162 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-09-28T04:06:36.162 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-09-28T04:06:36.162 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-09-28T04:06:36.162 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-09-28T04:06:36.162 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-09-28T04:06:36.163 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-09-28T04:06:36.163 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-09-28T04:06:36.163 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-09-28T04:06:36.163 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-09-28T04:06:36.163 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-09-28T04:06:36.163 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-09-28T04:06:36.163 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-09-28T04:06:36.163 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-09-28T04:06:36.163 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-09-28T04:06:36.163 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-09-28T04:06:36.163 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-09-28T04:06:36.163 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-09-28T04:06:36.164 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-09-28T04:06:36.164 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-09-28T04:06:36.164 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-09-28T04:06:36.164 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-09-28T04:06:36.164 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-09-28T04:06:36.164 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-09-28T04:06:36.164 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-09-28T04:06:36.164 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-09-28T04:06:36.164 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-09-28T04:06:36.164 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-09-28T04:06:36.164 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-09-28T04:06:36.164 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-09-28T04:06:36.164 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-09-28T04:06:36.165 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-09-28T04:06:36.165 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-09-28T04:06:36.165 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-09-28T04:06:36.165 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-09-28T04:06:36.165 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-09-28T04:06:36.165 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-09-28T04:06:36.165 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-09-28T04:06:36.165 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-09-28T04:06:36.165 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-09-28T04:06:36.165 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-09-28T04:06:36.165 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-09-28T04:06:36.165 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-09-28T04:06:36.166 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-09-28T04:06:36.166 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-09-28T04:06:36.166 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-09-28T04:06:36.166 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-09-28T04:06:36.166 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-09-28T04:06:36.166 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-09-28T04:06:36.166 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-09-28T04:06:36.166 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-09-28T04:06:36.166 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-09-28T04:06:36.166 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-09-28T04:06:36.166 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-09-28T04:06:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-09-28T04:06:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-09-28T04:06:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-09-28T04:06:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-09-28T04:06:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-09-28T04:06:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-09-28T04:06:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-09-28T04:06:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-09-28T04:06:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-09-28T04:06:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-09-28T04:06:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-09-28T04:06:36.167 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-09-28T04:06:36.168 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-09-28T04:06:36.168 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-09-28T04:06:36.168 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-09-28T04:06:36.168 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-09-28T04:06:36.168 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-09-28T04:06:36.168 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-09-28T04:06:36.168 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-09-28T04:06:36.168 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-09-28T04:06:36.168 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-09-28T04:06:36.168 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-09-28T04:06:36.168 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-09-28T04:06:36.168 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-09-28T04:06:36.169 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-09-28T04:06:36.169 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-09-28T04:06:36.169 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-09-28T04:06:36.169 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-09-28T04:06:36.169 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-09-28T04:06:36.169 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-09-28T04:06:36.169 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-09-28T04:06:36.169 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-09-28T04:06:36.169 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-09-28T04:06:36.169 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-09-28T04:06:36.169 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-09-28T04:06:36.169 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-09-28T04:06:36.170 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-09-28T04:06:36.170 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-09-28T04:06:36.170 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-09-28T04:06:36.170 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-09-28T04:06:36.170 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-09-28T04:06:36.170 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-09-28T04:06:36.170 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-09-28T04:06:36.170 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-09-28T04:06:36.170 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-09-28T04:06:36.170 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-09-28T04:06:36.170 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-09-28T04:06:36.170 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-09-28T04:06:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-09-28T04:06:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-09-28T04:06:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-09-28T04:06:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-09-28T04:06:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-09-28T04:06:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-09-28T04:06:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-09-28T04:06:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-09-28T04:06:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-09-28T04:06:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-09-28T04:06:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-09-28T04:06:36.171 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-09-28T04:06:36.172 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-09-28T04:06:36.172 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-09-28T04:06:36.172 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-09-28T04:06:36.172 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-09-28T04:06:36.172 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-09-28T04:06:36.172 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-09-28T04:06:36.172 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-09-28T04:06:36.172 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-09-28T04:06:36.172 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-09-28T04:06:36.172 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-09-28T04:06:36.172 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-09-28T04:06:36.172 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-09-28T04:06:36.172 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-09-28T04:06:36.173 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-09-28T04:06:36.173 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-09-28T04:06:36.173 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-09-28T04:06:36.173 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-09-28T04:06:36.173 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-09-28T04:06:36.173 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-09-28T04:06:36.173 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-09-28T04:06:36.173 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-09-28T04:06:36.173 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-09-28T04:06:36.173 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-09-28T04:06:36.173 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-09-28T04:06:36.173 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-09-28T04:06:36.174 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-09-28T04:06:36.174 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-09-28T04:06:36.174 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-09-28T04:06:36.174 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-09-28T04:06:36.174 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-09-28T04:06:36.174 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-09-28T04:06:36.174 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-09-28T04:06:36.174 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-09-28T04:06:36.174 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-09-28T04:06:36.174 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-09-28T04:06:36.174 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-09-28T04:06:36.174 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-09-28T04:06:36.175 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-09-28T04:06:36.175 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-09-28T04:06:36.175 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-09-28T04:06:36.175 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-09-28T04:06:36.175 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-09-28T04:06:36.175 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-09-28T04:06:36.175 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-09-28T04:06:36.175 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-09-28T04:06:36.175 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-09-28T04:06:36.175 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-09-28T04:06:36.175 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-09-28T04:06:36.175 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-09-28T04:06:36.176 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-09-28T04:06:36.176 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-09-28T04:06:36.176 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-09-28T04:06:36.176 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-09-28T04:06:36.176 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-09-28T04:06:36.176 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-09-28T04:06:36.176 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-09-28T04:06:36.176 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-09-28T04:06:36.176 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-09-28T04:06:36.176 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-09-28T04:06:36.176 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-09-28T04:06:36.176 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-09-28T04:06:36.177 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-09-28T04:06:36.177 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-09-28T04:06:36.177 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-09-28T04:06:36.177 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-09-28T04:06:36.177 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-09-28T04:06:36.177 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-09-28T04:06:36.177 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-09-28T04:06:36.177 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-09-28T04:06:36.177 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-09-28T04:06:36.177 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-09-28T04:06:36.177 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-09-28T04:06:36.177 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-09-28T04:06:36.178 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-09-28T04:06:36.178 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-09-28T04:06:36.178 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-09-28T04:06:36.178 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-09-28T04:06:36.178 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-09-28T04:06:36.178 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-09-28T04:06:36.178 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-09-28T04:06:36.178 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-09-28T04:06:36.178 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-09-28T04:06:36.178 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-09-28T04:06:36.178 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-09-28T04:06:36.178 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-09-28T04:06:36.179 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-09-28T04:06:36.179 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-09-28T04:06:36.179 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-09-28T04:06:36.179 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-09-28T04:06:36.179 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-09-28T04:06:36.179 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-09-28T04:06:36.179 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-09-28T04:06:36.179 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-09-28T04:06:36.179 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-09-28T04:06:36.179 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-09-28T04:06:36.179 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-09-28T04:06:36.180 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-09-28T04:06:36.180 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-09-28T04:06:36.180 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-09-28T04:06:36.180 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-09-28T04:06:36.180 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-09-28T04:06:36.180 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-09-28T04:06:36.180 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-09-28T04:06:36.180 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-09-28T04:06:36.180 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-09-28T04:06:36.180 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-09-28T04:06:36.180 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-09-28T04:06:36.180 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-09-28T04:06:36.180 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-09-28T04:06:36.181 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-09-28T04:06:36.181 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-09-28T04:06:36.181 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-09-28T04:06:36.181 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-09-28T04:06:36.181 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-09-28T04:06:36.181 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-09-28T04:06:36.181 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-09-28T04:06:36.181 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-09-28T04:06:36.181 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-09-28T04:06:36.181 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-09-28T04:06:36.181 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-09-28T04:06:36.181 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-09-28T04:06:36.182 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-09-28T04:06:36.182 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-09-28T04:06:36.182 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-09-28T04:06:36.182 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-09-28T04:06:36.182 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-09-28T04:06:36.182 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-09-28T04:06:36.182 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-09-28T04:06:36.182 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-09-28T04:06:36.182 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-09-28T04:06:36.182 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-09-28T04:06:36.182 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-09-28T04:06:36.182 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-09-28T04:06:36.183 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-09-28T04:06:36.183 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-09-28T04:06:36.183 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-09-28T04:06:36.183 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-09-28T04:06:36.183 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-09-28T04:06:36.183 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-09-28T04:06:36.183 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-09-28T04:06:36.183 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-09-28T04:06:36.183 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-09-28T04:06:36.183 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-09-28T04:06:36.183 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-09-28T04:06:36.183 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-09-28T04:06:36.184 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-09-28T04:06:36.184 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-09-28T04:06:36.184 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-09-28T04:06:36.184 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-09-28T04:06:36.184 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-09-28T04:06:36.184 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-09-28T04:06:36.184 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-09-28T04:06:36.184 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-09-28T04:06:36.184 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-09-28T04:06:36.184 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-09-28T04:06:36.184 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-09-28T04:06:36.184 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-09-28T04:06:36.185 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-09-28T04:06:36.185 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-09-28T04:06:36.185 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-09-28T04:06:36.185 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-09-28T04:06:36.185 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-09-28T04:06:36.185 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-09-28T04:06:36.185 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-09-28T04:06:36.185 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-09-28T04:06:36.185 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-09-28T04:06:36.185 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-09-28T04:06:36.185 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-09-28T04:06:36.186 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-09-28T04:06:36.186 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-09-28T04:06:36.186 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-09-28T04:06:36.186 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-09-28T04:06:36.186 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-09-28T04:06:36.186 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-09-28T04:06:36.186 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-09-28T04:06:36.186 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-09-28T04:06:36.186 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-09-28T04:06:36.186 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-09-28T04:06:36.186 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-09-28T04:06:36.186 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-09-28T04:06:36.187 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-09-28T04:06:36.187 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-09-28T04:06:36.187 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-09-28T04:06:36.187 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-09-28T04:06:36.187 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-09-28T04:06:36.187 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-09-28T04:06:36.187 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-09-28T04:06:36.187 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-09-28T04:06:36.187 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-09-28T04:06:36.187 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-09-28T04:06:36.187 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-09-28T04:06:36.187 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-09-28T04:06:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-09-28T04:06:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-09-28T04:06:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-09-28T04:06:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-09-28T04:06:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-09-28T04:06:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-09-28T04:06:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-09-28T04:06:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-09-28T04:06:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-09-28T04:06:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-09-28T04:06:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-09-28T04:06:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-09-28T04:06:36.188 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-09-28T04:06:36.189 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-09-28T04:06:36.189 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-09-28T04:06:36.189 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-09-28T04:06:36.189 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-09-28T04:06:36.189 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-09-28T04:06:36.189 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-09-28T04:06:36.189 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-09-28T04:06:36.189 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-09-28T04:06:36.189 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-09-28T04:06:36.189 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-09-28T04:06:36.189 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-09-28T04:06:36.189 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-09-28T04:06:36.190 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-09-28T04:06:36.190 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-09-28T04:06:36.190 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-09-28T04:06:36.190 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-09-28T04:06:36.190 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-09-28T04:06:36.190 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-09-28T04:06:36.190 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-09-28T04:06:36.190 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-09-28T04:06:36.190 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-09-28T04:06:36.190 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-09-28T04:06:36.190 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-09-28T04:06:36.191 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-09-28T04:06:36.191 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-09-28T04:06:36.191 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-09-28T04:06:36.191 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-09-28T04:06:36.191 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-09-28T04:06:36.191 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-09-28T04:06:36.191 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-09-28T04:06:36.191 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-09-28T04:06:36.191 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-09-28T04:06:36.191 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-09-28T04:06:36.191 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-09-28T04:06:36.191 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-09-28T04:06:36.192 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-09-28T04:06:36.192 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-09-28T04:06:36.192 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-09-28T04:06:36.192 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-09-28T04:06:36.192 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-09-28T04:06:36.192 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-09-28T04:06:36.192 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-09-28T04:06:36.192 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-09-28T04:06:36.192 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-09-28T04:06:36.192 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-09-28T04:06:36.192 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-09-28T04:06:36.192 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-09-28T04:06:36.193 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-09-28T04:06:36.193 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-09-28T04:06:36.193 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-09-28T04:06:36.193 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-09-28T04:06:36.193 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-09-28T04:06:36.193 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-09-28T04:06:36.193 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-09-28T04:06:36.193 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-09-28T04:06:36.193 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-09-28T04:06:36.193 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-09-28T04:06:36.193 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-09-28T04:06:36.193 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-09-28T04:06:36.193 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-09-28T04:06:36.194 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-09-28T04:06:36.194 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-09-28T04:06:36.194 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-09-28T04:06:36.194 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-09-28T04:06:36.194 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-09-28T04:06:36.194 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-09-28T04:06:36.194 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-09-28T04:06:36.194 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-09-28T04:06:36.194 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-09-28T04:06:36.194 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-09-28T04:06:36.194 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-09-28T04:06:36.195 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-09-28T04:06:36.195 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-09-28T04:06:36.195 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-09-28T04:06:36.195 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-09-28T04:06:36.195 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-09-28T04:06:36.195 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-09-28T04:06:36.195 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-09-28T04:06:36.195 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-09-28T04:06:36.195 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-09-28T04:06:36.195 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-09-28T04:06:36.195 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-09-28T04:06:36.195 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-09-28T04:06:36.195 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-09-28T04:06:36.196 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-09-28T04:06:36.196 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-09-28T04:06:36.196 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-09-28T04:06:36.196 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-09-28T04:06:36.196 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-09-28T04:06:36.196 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-09-28T04:06:36.196 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-09-28T04:06:36.196 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-09-28T04:06:36.196 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-09-28T04:06:36.196 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-09-28T04:06:36.196 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-09-28T04:06:36.196 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-09-28T04:06:36.197 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-09-28T04:06:36.197 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-09-28T04:06:36.197 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-09-28T04:06:36.197 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-09-28T04:06:36.197 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-09-28T04:06:36.197 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-09-28T04:06:36.197 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-09-28T04:06:36.197 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-09-28T04:06:36.197 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-09-28T04:06:36.197 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-09-28T04:06:36.197 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-09-28T04:06:36.197 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-09-28T04:06:36.198 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-09-28T04:06:36.198 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-09-28T04:06:36.198 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-09-28T04:06:36.198 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-09-28T04:06:36.198 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-09-28T04:06:36.198 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-09-28T04:06:36.198 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-09-28T04:06:36.198 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-09-28T04:06:36.198 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-09-28T04:06:36.198 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-09-28T04:06:36.198 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-09-28T04:06:36.198 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-09-28T04:06:36.199 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-09-28T04:06:36.199 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-09-28T04:06:36.199 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-09-28T04:06:36.199 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-09-28T04:06:36.199 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-09-28T04:06:36.199 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-09-28T04:06:36.199 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-09-28T04:06:36.199 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-09-28T04:06:36.199 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-09-28T04:06:36.199 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-09-28T04:06:36.199 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-09-28T04:06:36.200 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-09-28T04:06:36.200 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-09-28T04:06:36.200 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-09-28T04:06:36.200 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-09-28T04:06:36.200 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-09-28T04:06:36.200 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-09-28T04:06:36.200 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-09-28T04:06:36.200 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-09-28T04:06:36.200 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-09-28T04:06:36.200 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-09-28T04:06:36.200 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-09-28T04:06:36.200 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-09-28T04:06:36.201 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-09-28T04:06:36.201 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-09-28T04:06:36.201 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-09-28T04:06:36.201 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-09-28T04:06:36.201 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-09-28T04:06:36.201 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-09-28T04:06:36.201 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-09-28T04:06:36.201 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-09-28T04:06:36.201 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-09-28T04:06:36.201 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-09-28T04:06:36.201 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-09-28T04:06:36.202 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-09-28T04:06:36.202 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-09-28T04:06:36.202 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-09-28T04:06:36.202 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-09-28T04:06:36.202 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-09-28T04:06:36.202 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-09-28T04:06:36.202 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-09-28T04:06:36.202 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-09-28T04:06:36.202 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-09-28T04:06:36.202 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-09-28T04:06:36.202 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-09-28T04:06:36.202 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-09-28T04:06:36.203 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-09-28T04:06:36.203 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-09-28T04:06:36.203 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-09-28T04:06:36.203 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-09-28T04:06:36.203 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-09-28T04:06:36.203 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-09-28T04:06:36.203 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-09-28T04:06:36.203 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-09-28T04:06:36.203 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-09-28T04:06:36.203 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-09-28T04:06:36.203 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-09-28T04:06:36.203 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-09-28T04:06:36.204 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-09-28T04:06:36.204 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-09-28T04:06:36.204 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-09-28T04:06:36.204 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-09-28T04:06:36.204 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-09-28T04:06:36.204 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-09-28T04:06:36.204 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-09-28T04:06:36.204 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-09-28T04:06:36.204 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-09-28T04:06:36.204 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-09-28T04:06:36.204 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-09-28T04:06:36.204 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-09-28T04:06:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-09-28T04:06:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-09-28T04:06:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-09-28T04:06:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-09-28T04:06:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-09-28T04:06:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-09-28T04:06:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-09-28T04:06:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-09-28T04:06:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-09-28T04:06:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-09-28T04:06:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-09-28T04:06:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-09-28T04:06:36.206 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-09-28T04:06:36.206 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-09-28T04:06:36.206 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-09-28T04:06:36.206 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-09-28T04:06:36.206 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-09-28T04:06:36.206 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-09-28T04:06:36.206 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-09-28T04:06:36.206 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-09-28T04:06:36.206 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-09-28T04:06:36.206 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-09-28T04:06:36.206 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-09-28T04:06:36.206 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-09-28T04:06:36.207 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-09-28T04:06:36.207 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-09-28T04:06:36.207 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-09-28T04:06:36.207 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-09-28T04:06:36.207 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-09-28T04:06:36.207 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-09-28T04:06:36.207 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-09-28T04:06:36.207 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-09-28T04:06:36.207 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-09-28T04:06:36.207 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-09-28T04:06:36.207 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-09-28T04:06:36.208 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-09-28T04:06:36.208 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-09-28T04:06:36.208 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-09-28T04:06:36.208 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-09-28T04:06:36.208 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-09-28T04:06:36.208 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-09-28T04:06:36.208 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-09-28T04:06:36.208 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-09-28T04:06:36.208 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-09-28T04:06:36.208 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-09-28T04:06:36.208 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-09-28T04:06:36.208 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-09-28T04:06:36.209 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-09-28T04:06:36.209 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-09-28T04:06:36.209 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-09-28T04:06:36.209 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-09-28T04:06:36.209 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-09-28T04:06:36.209 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-09-28T04:06:36.209 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-09-28T04:06:36.209 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-09-28T04:06:36.209 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-09-28T04:06:36.209 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-09-28T04:06:36.209 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-09-28T04:06:36.210 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-09-28T04:06:36.210 DEBUG:teuthology.orchestra.run.smithi118:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-09-28T04:06:36.239 INFO:teuthology.orchestra.run.smithi118.stdout:postinstall scriptlet (using /bin/sh): 2023-09-28T04:06:36.239 INFO:teuthology.orchestra.run.smithi118.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-09-28T04:06:36.239 INFO:teuthology.orchestra.run.smithi118.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-28T04:06:36.239 INFO:teuthology.orchestra.run.smithi118.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-28T04:06:36.239 INFO:teuthology.orchestra.run.smithi118.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-28T04:06:36.239 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-28T04:06:36.239 INFO:teuthology.orchestra.run.smithi118.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-28T04:06:36.239 INFO:teuthology.orchestra.run.smithi118.stdout:fi 2023-09-28T04:06:36.239 INFO:teuthology.orchestra.run.smithi118.stdout:preuninstall scriptlet (using /bin/sh): 2023-09-28T04:06:36.239 INFO:teuthology.orchestra.run.smithi118.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-09-28T04:06:36.240 INFO:teuthology.orchestra.run.smithi118.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-09-28T04:06:36.240 INFO:teuthology.orchestra.run.smithi118.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-09-28T04:06:36.240 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-09-28T04:06:36.240 INFO:teuthology.orchestra.run.smithi118.stdout:fi 2023-09-28T04:06:36.240 INFO:teuthology.orchestra.run.smithi118.stdout:postuninstall scriptlet (using /bin/sh): 2023-09-28T04:06:36.240 INFO:teuthology.orchestra.run.smithi118.stdout:if [ -x /sbin/update-bootloader ]; then 2023-09-28T04:06:36.240 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-09-28T04:06:36.240 INFO:teuthology.orchestra.run.smithi118.stdout:fi 2023-09-28T04:06:36.241 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -qi grub2-tools 2023-09-28T04:06:36.320 INFO:teuthology.orchestra.run.smithi118.stdout:Name : grub2-tools 2023-09-28T04:06:36.321 INFO:teuthology.orchestra.run.smithi118.stdout:Epoch : 1 2023-09-28T04:06:36.321 INFO:teuthology.orchestra.run.smithi118.stdout:Version : 2.02 2023-09-28T04:06:36.321 INFO:teuthology.orchestra.run.smithi118.stdout:Release : 129.el8 2023-09-28T04:06:36.321 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: x86_64 2023-09-28T04:06:36.321 INFO:teuthology.orchestra.run.smithi118.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-09-28T04:06:36.321 INFO:teuthology.orchestra.run.smithi118.stdout:Group : System Environment/Base 2023-09-28T04:06:36.321 INFO:teuthology.orchestra.run.smithi118.stdout:Size : 9265586 2023-09-28T04:06:36.321 INFO:teuthology.orchestra.run.smithi118.stdout:License : GPLv3+ 2023-09-28T04:06:36.321 INFO:teuthology.orchestra.run.smithi118.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-09-28T04:06:36.321 INFO:teuthology.orchestra.run.smithi118.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-09-28T04:06:36.321 INFO:teuthology.orchestra.run.smithi118.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-09-28T04:06:36.322 INFO:teuthology.orchestra.run.smithi118.stdout:Build Host : kbuilder.bsys.centos.org 2023-09-28T04:06:36.322 INFO:teuthology.orchestra.run.smithi118.stdout:Relocations : (not relocatable) 2023-09-28T04:06:36.322 INFO:teuthology.orchestra.run.smithi118.stdout:Packager : CentOS BuildSystem 2023-09-28T04:06:36.322 INFO:teuthology.orchestra.run.smithi118.stdout:Vendor : CentOS 2023-09-28T04:06:36.322 INFO:teuthology.orchestra.run.smithi118.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-28T04:06:36.322 INFO:teuthology.orchestra.run.smithi118.stdout:Summary : Support tools for GRUB. 2023-09-28T04:06:36.322 INFO:teuthology.orchestra.run.smithi118.stdout:Description : 2023-09-28T04:06:36.322 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:06:36.322 INFO:teuthology.orchestra.run.smithi118.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-28T04:06:36.322 INFO:teuthology.orchestra.run.smithi118.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-28T04:06:36.322 INFO:teuthology.orchestra.run.smithi118.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-28T04:06:36.323 INFO:teuthology.orchestra.run.smithi118.stdout:hardware devices. 2023-09-28T04:06:36.323 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:06:36.323 INFO:teuthology.orchestra.run.smithi118.stdout:This subpackage provides tools for support of all platforms. 2023-09-28T04:06:36.323 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-28T04:06:36.324 INFO:teuthology.task.kernel:Updating grub on smithi118 to boot 6.5.0-rc7-gfef64f93da2b 2023-09-28T04:06:36.324 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-28T04:06:39.254 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2023-09-28T04:06:41.444 INFO:teuthology.orchestra.run.smithi118.stderr:done 2023-09-28T04:06:41.446 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-09-28T04:06:41.484 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.IU5JpYm0Fr 2023-09-28T04:06:41.485 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IU5JpYm0Fr 2023-09-28T04:06:41.558 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.IU5JpYm0Fr 2023-09-28T04:06:41.723 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.IU5JpYm0Fr is 6KB 2023-09-28T04:06:41.771 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.IU5JpYm0Fr 2023-09-28T04:06:41.788 DEBUG:teuthology.orchestra.run.smithi118:> sudo /bin/ls /boot/loader/entries || true 2023-09-28T04:06:41.867 INFO:teuthology.orchestra.run.smithi118.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-09-28T04:06:41.867 INFO:teuthology.orchestra.run.smithi118.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-09-28T04:06:41.867 INFO:teuthology.orchestra.run.smithi118.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-09-28T04:06:41.868 INFO:teuthology.orchestra.run.smithi118.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b.conf 2023-09-28T04:06:41.869 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b 2023-09-28T04:06:42.037 DEBUG:teuthology.orchestra.run.smithi118:> sudo shutdown -r now 2023-09-28T04:07:12.041 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-09-28T04:07:12.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-09-28T04:07:12.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T04:07:46.554 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-09-28T04:07:55.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-09-28T04:07:55.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T04:08:55.559 DEBUG:teuthology.orchestra.remote:timed out 2023-09-28T04:09:07.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-09-28T04:09:07.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T04:09:07.878 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-09-28T04:09:08.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-09-28T04:09:08.300 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-09-28T04:09:08.300 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-09-28T04:09:08.348 INFO:teuthology.orchestra.run.smithi118.stdout:6.5.0-rc7-gfef64f93da2b 2023-09-28T04:09:08.348 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-09-28T04:09:08.348 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-28T04:09:08.348 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-28T04:09:09.349 DEBUG:teuthology.parallel:result is None 2023-09-28T04:09:09.349 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-28T04:09:09.359 INFO:teuthology.task.internal:Creating test directory... 2023-09-28T04:09:09.359 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-28T04:09:09.364 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-28T04:09:09.411 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-28T04:09:09.419 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-28T04:09:09.429 INFO:teuthology.task.internal:Creating archive directory... 2023-09-28T04:09:09.429 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-28T04:09:09.434 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-28T04:09:09.500 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-28T04:09:09.509 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-28T04:09:09.509 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-28T04:09:09.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T04:09:09.532 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-28T04:09:09.536 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-28T04:09:09.631 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T04:09:09.652 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T04:09:09.712 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T04:09:09.753 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T04:09:09.756 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-28T04:09:09.764 INFO:teuthology.task.internal:Configuring sudo... 2023-09-28T04:09:09.764 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-28T04:09:09.768 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-28T04:09:09.838 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-28T04:09:09.847 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-28T04:09:09.847 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-28T04:09:09.851 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-28T04:09:09.893 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T04:09:10.008 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T04:09:10.077 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T04:09:10.151 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T04:09:10.219 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:09:10.220 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-28T04:09:10.288 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T04:09:10.335 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T04:09:10.396 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T04:09:10.482 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T04:09:10.527 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:09:10.527 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-28T04:09:10.596 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2023-09-28T04:09:10.600 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2023-09-28T04:09:10.687 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T04:09:10.711 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T04:09:11.068 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-28T04:09:11.078 INFO:teuthology.task.internal:Starting timer... 2023-09-28T04:09:11.078 INFO:teuthology.run_tasks:Running task pcp... 2023-09-28T04:09:11.091 INFO:teuthology.run_tasks:Running task selinux... 2023-09-28T04:09:11.103 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-09-28T04:09:11.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2023-09-28T04:09:11.240 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: 2023-09-28T04:09:11.243 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2023-09-28T04:09:11.298 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: 2023-09-28T04:09:11.300 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-28T04:09:11.300 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2023-09-28T04:09:11.349 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2023-09-28T04:09:11.349 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2023-09-28T04:09:11.372 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2023-09-28T04:09:11.372 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi118.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive'} 2023-09-28T04:09:11.372 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T04:09:11.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T04:09:11.442 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T04:09:11.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T04:09:11.469 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-28T04:09:11.469 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2023-09-28T04:09:11.537 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2023-09-28T04:09:11.567 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-28T04:09:11.578 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-28T04:09:11.584 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-28T04:09:11.693 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-28T04:09:11.717 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-28T04:09:11.718 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi118.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-28T04:19:27.640 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi118.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2023-09-28T04:19:27.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-09-28T04:19:27.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T04:19:27.728 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-09-28T04:19:27.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-09-28T04:19:27.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-09-28T04:19:27.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T04:19:27.922 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-09-28T04:19:27.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-09-28T04:19:27.995 INFO:teuthology.run_tasks:Running task clock... 2023-09-28T04:19:28.009 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-28T04:19:28.009 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-28T04:19:28.009 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T04:19:28.014 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-28T04:19:28.014 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T04:19:28.070 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-28T04:19:28.085 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-28T04:19:28.086 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-28T04:19:28.118 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-28T04:19:28.162 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2023-09-28T04:19:28.173 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2023-09-28T04:19:28.187 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-28T04:19:28.201 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-28T04:19:28.210 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2023-09-28T04:19:28.238 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2023-09-28T04:19:28.269 INFO:teuthology.orchestra.run.smithi174.stderr:bash: ntpq: command not found 2023-09-28T04:19:28.270 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-28T04:19:28.272 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T04:19:28.273 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2023-09-28T04:19:28.273 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T04:19:28.273 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T04:19:28.273 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T04:19:28.273 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T04:19:28.302 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-28T04:19:28.397 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-09-28T04:19:28.404 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T04:19:28.404 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-09-28T04:19:28.404 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T04:19:28.404 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T04:19:28.405 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T04:19:28.405 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T04:19:28.406 INFO:teuthology.run_tasks:Running task install... 2023-09-28T04:19:28.413 DEBUG:teuthology.task.install:project ceph 2023-09-28T04:19:28.413 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}} 2023-09-28T04:19:28.414 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'} 2023-09-28T04:19:28.414 INFO:teuthology.task.install:Using flavor: default 2023-09-28T04:19:28.419 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-28T04:19:28.420 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-28T04:19:28.420 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28', 'tag': None, 'wait_for_package': False} 2023-09-28T04:19:28.420 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T04:19:28.422 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28', 'tag': None, 'wait_for_package': False} 2023-09-28T04:19:28.422 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T04:19:28.559 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/ 2023-09-28T04:19:28.559 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1161.g471b6dfd 2023-09-28T04:19:28.654 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/ 2023-09-28T04:19:28.654 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1161.g471b6dfd 2023-09-28T04:19:28.671 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-28T04:19:28.671 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:19:28.671 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-28T04:19:28.740 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-09-28T04:19:28.740 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-28T04:19:28.831 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-28T04:19:28.831 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:19:28.831 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-28T04:19:28.851 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-28T04:19:28.862 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-09-28T04:19:28.862 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-28T04:19:28.932 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-28T04:19:28.947 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-28T04:19:29.012 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-28T04:19:29.014 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2023-09-28T04:19:29.017 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2023-09-28T04:19:29.079 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2023-09-28T04:19:29.080 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2023-09-28T04:19:29.354 INFO:teuthology.orchestra.run.smithi174.stdout:76 files removed 2023-09-28T04:19:29.368 INFO:teuthology.orchestra.run.smithi118.stdout:76 files removed 2023-09-28T04:19:29.382 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-09-28T04:19:29.406 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-09-28T04:19:30.254 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 159 kB/s | 78 kB 00:00 2023-09-28T04:19:30.374 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 181 kB/s | 78 kB 00:00 2023-09-28T04:19:30.588 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 31 kB/s | 9.2 kB 00:00 2023-09-28T04:19:30.783 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 25 kB/s | 9.2 kB 00:00 2023-09-28T04:19:30.955 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 4.2 kB/s | 1.4 kB 00:00 2023-09-28T04:19:31.075 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 5.4 kB/s | 1.4 kB 00:00 2023-09-28T04:19:40.432 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - AppStream 3.5 MB/s | 33 MB 00:09 2023-09-28T04:19:47.374 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - AppStream 2.0 MB/s | 33 MB 00:16 2023-09-28T04:19:48.730 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 48 MB 00:02 2023-09-28T04:19:55.997 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - Extras 61 kB/s | 18 kB 00:00 2023-09-28T04:19:56.817 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 48 MB 00:02 2023-09-28T04:19:56.888 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - Extras common packages 9.7 kB/s | 6.9 kB 00:00 2023-09-28T04:19:58.123 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - PowerTools 6.0 MB/s | 6.5 MB 00:01 2023-09-28T04:19:59.591 INFO:teuthology.orchestra.run.smithi174.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-09-28T04:20:00.569 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-09-28T04:20:04.166 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - Extras 122 kB/s | 18 kB 00:00 2023-09-28T04:20:04.492 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 290 kB/s | 24 kB 00:00 2023-09-28T04:20:04.975 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 6.9 kB 00:00 2023-09-28T04:20:06.252 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - PowerTools 5.8 MB/s | 6.5 MB 00:01 2023-09-28T04:20:07.787 INFO:teuthology.orchestra.run.smithi118.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-09-28T04:20:08.612 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-09-28T04:20:08.758 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-28T04:20:08.759 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-28T04:20:08.773 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-28T04:20:08.773 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-28T04:20:08.774 INFO:teuthology.orchestra.run.smithi174.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-28T04:20:08.775 INFO:teuthology.orchestra.run.smithi174.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-28T04:20:08.776 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-28T04:20:08.778 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-28T04:20:08.781 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-28T04:20:08.782 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-28T04:20:08.997 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2023-09-28T04:20:09.010 INFO:teuthology.orchestra.run.smithi174.stdout:==================================================================================================== 2023-09-28T04:20:09.010 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2023-09-28T04:20:09.010 INFO:teuthology.orchestra.run.smithi174.stdout:==================================================================================================== 2023-09-28T04:20:09.010 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2023-09-28T04:20:09.011 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-28T04:20:09.011 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 6.4 k 2023-09-28T04:20:09.011 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 5.2 M 2023-09-28T04:20:09.011 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 874 k 2023-09-28T04:20:09.011 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 162 k 2023-09-28T04:20:09.011 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 1.6 M 2023-09-28T04:20:09.011 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 121 k 2023-09-28T04:20:09.011 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 1.7 M 2023-09-28T04:20:09.011 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 7.4 M 2023-09-28T04:20:09.011 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 47 k 2023-09-28T04:20:09.011 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 17 M 2023-09-28T04:20:09.012 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 52 M 2023-09-28T04:20:09.012 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 267 k 2023-09-28T04:20:09.012 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 80 k 2023-09-28T04:20:09.012 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 255 k 2023-09-28T04:20:09.012 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 18 k 2023-09-28T04:20:09.012 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-28T04:20:09.012 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-28T04:20:09.012 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-09-28T04:20:09.012 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 25 k 2023-09-28T04:20:09.012 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 796 k 2023-09-28T04:20:09.012 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 130 k 2023-09-28T04:20:09.013 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-09-28T04:20:09.013 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-09-28T04:20:09.013 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-28T04:20:09.013 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 190 k 2023-09-28T04:20:09.013 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 371 k 2023-09-28T04:20:09.013 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 359 k 2023-09-28T04:20:09.013 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 107 k 2023-09-28T04:20:09.013 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 91 k 2023-09-28T04:20:09.013 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.5 M 2023-09-28T04:20:09.013 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 173 k 2023-09-28T04:20:09.013 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-09-28T04:20:09.014 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2023-09-28T04:20:09.014 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-28T04:20:09.014 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-28T04:20:09.014 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-28T04:20:09.014 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-28T04:20:09.014 INFO:teuthology.orchestra.run.smithi174.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-28T04:20:09.014 INFO:teuthology.orchestra.run.smithi174.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-28T04:20:09.014 INFO:teuthology.orchestra.run.smithi174.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-28T04:20:09.014 INFO:teuthology.orchestra.run.smithi174.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-28T04:20:09.014 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.5 M 2023-09-28T04:20:09.014 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.6 M 2023-09-28T04:20:09.015 INFO:teuthology.orchestra.run.smithi174.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-28T04:20:09.015 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-28T04:20:09.015 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-28T04:20:09.015 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-28T04:20:09.015 INFO:teuthology.orchestra.run.smithi174.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-09-28T04:20:09.015 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-09-28T04:20:09.015 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2023-09-28T04:20:09.015 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-09-28T04:20:09.015 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 23 M 2023-09-28T04:20:09.015 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 23 k 2023-09-28T04:20:09.015 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 2.3 M 2023-09-28T04:20:09.016 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 238 k 2023-09-28T04:20:09.016 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.9 M 2023-09-28T04:20:09.016 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 17 M 2023-09-28T04:20:09.016 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 14 k 2023-09-28T04:20:09.016 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 24 k 2023-09-28T04:20:09.016 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-28T04:20:09.016 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-28T04:20:09.016 INFO:teuthology.orchestra.run.smithi174.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-28T04:20:09.016 INFO:teuthology.orchestra.run.smithi174.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-28T04:20:09.016 INFO:teuthology.orchestra.run.smithi174.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-28T04:20:09.016 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 175 k 2023-09-28T04:20:09.017 INFO:teuthology.orchestra.run.smithi174.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-28T04:20:09.017 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-28T04:20:09.017 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-28T04:20:09.017 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-28T04:20:09.017 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-28T04:20:09.017 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 507 k 2023-09-28T04:20:09.017 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-28T04:20:09.017 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 5.6 M 2023-09-28T04:20:09.017 INFO:teuthology.orchestra.run.smithi174.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-28T04:20:09.018 INFO:teuthology.orchestra.run.smithi174.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-28T04:20:09.018 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-28T04:20:09.018 INFO:teuthology.orchestra.run.smithi174.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-28T04:20:09.018 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-28T04:20:09.018 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-28T04:20:09.018 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-28T04:20:09.019 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-28T04:20:09.019 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-28T04:20:09.019 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-28T04:20:09.019 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-28T04:20:09.019 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-28T04:20:09.019 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-28T04:20:09.019 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-09-28T04:20:09.020 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-28T04:20:09.020 INFO:teuthology.orchestra.run.smithi174.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-28T04:20:09.020 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-28T04:20:09.020 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 45 k 2023-09-28T04:20:09.020 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 115 k 2023-09-28T04:20:09.020 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-28T04:20:09.021 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-28T04:20:09.021 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-28T04:20:09.021 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-28T04:20:09.021 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-28T04:20:09.021 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-28T04:20:09.022 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-28T04:20:09.022 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-28T04:20:09.022 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-09-28T04:20:09.022 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-28T04:20:09.022 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-28T04:20:09.022 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-28T04:20:09.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-28T04:20:09.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-28T04:20:09.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-28T04:20:09.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-28T04:20:09.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-28T04:20:09.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-28T04:20:09.023 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-28T04:20:09.024 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-28T04:20:09.024 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-28T04:20:09.024 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-28T04:20:09.024 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-28T04:20:09.024 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-28T04:20:09.024 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-28T04:20:09.025 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-28T04:20:09.025 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-28T04:20:09.025 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-28T04:20:09.025 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-28T04:20:09.025 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-28T04:20:09.025 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-28T04:20:09.026 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-28T04:20:09.026 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-28T04:20:09.026 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-28T04:20:09.026 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-28T04:20:09.026 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-28T04:20:09.027 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-28T04:20:09.027 INFO:teuthology.orchestra.run.smithi174.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-28T04:20:09.027 INFO:teuthology.orchestra.run.smithi174.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-28T04:20:09.027 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-28T04:20:09.027 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-28T04:20:09.027 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-28T04:20:09.027 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-28T04:20:09.027 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-28T04:20:09.027 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-28T04:20:09.027 INFO:teuthology.orchestra.run.smithi174.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-28T04:20:09.028 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-28T04:20:09.028 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-28T04:20:09.028 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:20:09.028 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2023-09-28T04:20:09.028 INFO:teuthology.orchestra.run.smithi174.stdout:==================================================================================================== 2023-09-28T04:20:09.028 INFO:teuthology.orchestra.run.smithi174.stdout:Install 123 Packages 2023-09-28T04:20:09.028 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 16 Packages 2023-09-28T04:20:09.028 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:20:09.029 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 209 M 2023-09-28T04:20:09.029 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2023-09-28T04:20:11.935 INFO:teuthology.orchestra.run.smithi174.stdout:(1/139): ceph-17.2.6-1161.g471b6dfd.el8.x86_64. 32 kB/s | 6.4 kB 00:00 2023-09-28T04:20:12.568 INFO:teuthology.orchestra.run.smithi174.stdout:(2/139): ceph-fuse-17.2.6-1161.g471b6dfd.el8.x8 1.3 MB/s | 874 kB 00:00 2023-09-28T04:20:12.668 INFO:teuthology.orchestra.run.smithi174.stdout:(3/139): ceph-base-17.2.6-1161.g471b6dfd.el8.x8 5.5 MB/s | 5.2 MB 00:00 2023-09-28T04:20:12.727 INFO:teuthology.orchestra.run.smithi174.stdout:(4/139): ceph-immutable-object-cache-17.2.6-116 1.0 MB/s | 162 kB 00:00 2023-09-28T04:20:12.985 INFO:teuthology.orchestra.run.smithi174.stdout:(5/139): ceph-mds-17.2.6-1161.g471b6dfd.el8.x86 7.3 MB/s | 2.3 MB 00:00 2023-09-28T04:20:13.012 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 538 kB/s | 24 kB 00:00 2023-09-28T04:20:13.319 INFO:teuthology.orchestra.run.smithi174.stdout:(6/139): ceph-common-17.2.6-1161.g471b6dfd.el8. 15 MB/s | 23 MB 00:01 2023-09-28T04:20:13.403 INFO:teuthology.orchestra.run.smithi174.stdout:(7/139): ceph-mgr-17.2.6-1161.g471b6dfd.el8.x86 2.3 MB/s | 1.6 MB 00:00 2023-09-28T04:20:13.753 INFO:teuthology.orchestra.run.smithi174.stdout:(8/139): ceph-mon-17.2.6-1161.g471b6dfd.el8.x86 5.1 MB/s | 3.9 MB 00:00 2023-09-28T04:20:13.845 INFO:teuthology.orchestra.run.smithi174.stdout:(9/139): ceph-selinux-17.2.6-1161.g471b6dfd.el8 265 kB/s | 24 kB 00:00 2023-09-28T04:20:14.334 INFO:teuthology.orchestra.run.smithi174.stdout:(10/139): ceph-osd-17.2.6-1161.g471b6dfd.el8.x8 16 MB/s | 17 MB 00:01 2023-09-28T04:20:14.412 INFO:teuthology.orchestra.run.smithi174.stdout:(11/139): cephfs-mirror-17.2.6-1161.g471b6dfd.e 3.2 MB/s | 255 kB 00:00 2023-09-28T04:20:14.470 INFO:teuthology.orchestra.run.smithi174.stdout:(12/139): libcephfs-devel-17.2.6-1161.g471b6dfd 428 kB/s | 25 kB 00:00 2023-09-28T04:20:14.571 INFO:teuthology.orchestra.run.smithi174.stdout:(13/139): libcephfs2-17.2.6-1161.g471b6dfd.el8. 7.8 MB/s | 796 kB 00:00 2023-09-28T04:20:14.637 INFO:teuthology.orchestra.run.smithi174.stdout:(14/139): libcephsqlite-17.2.6-1161.g471b6dfd.e 2.6 MB/s | 175 kB 00:00 2023-09-28T04:20:14.704 INFO:teuthology.orchestra.run.smithi174.stdout:(15/139): librados-devel-17.2.6-1161.g471b6dfd. 1.9 MB/s | 130 kB 00:00 2023-09-28T04:20:14.779 INFO:teuthology.orchestra.run.smithi174.stdout:(16/139): libradosstriper1-17.2.6-1161.g471b6df 6.6 MB/s | 507 kB 00:00 2023-09-28T04:20:15.238 INFO:teuthology.orchestra.run.smithi174.stdout:(17/139): librgw2-17.2.6-1161.g471b6dfd.el8.x86 12 MB/s | 5.6 MB 00:00 2023-09-28T04:20:15.297 INFO:teuthology.orchestra.run.smithi174.stdout:(18/139): python3-ceph-argparse-17.2.6-1161.g47 770 kB/s | 45 kB 00:00 2023-09-28T04:20:15.363 INFO:teuthology.orchestra.run.smithi174.stdout:(19/139): python3-ceph-common-17.2.6-1161.g471b 1.7 MB/s | 115 kB 00:00 2023-09-28T04:20:15.497 INFO:teuthology.orchestra.run.smithi174.stdout:(20/139): python3-cephfs-17.2.6-1161.g471b6dfd. 1.4 MB/s | 190 kB 00:00 2023-09-28T04:20:15.573 INFO:teuthology.orchestra.run.smithi174.stdout:(21/139): python3-rados-17.2.6-1161.g471b6dfd.e 4.8 MB/s | 371 kB 00:00 2023-09-28T04:20:15.781 INFO:teuthology.orchestra.run.smithi174.stdout:(22/139): ceph-radosgw-17.2.6-1161.g471b6dfd.el 7.0 MB/s | 17 MB 00:02 2023-09-28T04:20:15.807 INFO:teuthology.orchestra.run.smithi174.stdout:(23/139): python3-rbd-17.2.6-1161.g471b6dfd.el8 1.5 MB/s | 359 kB 00:00 2023-09-28T04:20:15.857 INFO:teuthology.orchestra.run.smithi174.stdout:(24/139): rbd-fuse-17.2.6-1161.g471b6dfd.el8.x8 1.8 MB/s | 91 kB 00:00 2023-09-28T04:20:15.882 INFO:teuthology.orchestra.run.smithi174.stdout:(25/139): python3-rgw-17.2.6-1161.g471b6dfd.el8 1.0 MB/s | 107 kB 00:00 2023-09-28T04:20:16.216 INFO:teuthology.orchestra.run.smithi174.stdout:(26/139): rbd-nbd-17.2.6-1161.g471b6dfd.el8.x86 519 kB/s | 173 kB 00:00 2023-09-28T04:20:16.291 INFO:teuthology.orchestra.run.smithi174.stdout:(27/139): rbd-mirror-17.2.6-1161.g471b6dfd.el8. 8.0 MB/s | 3.5 MB 00:00 2023-09-28T04:20:16.308 INFO:teuthology.orchestra.run.smithi174.stdout:(28/139): ceph-grafana-dashboards-17.2.6-1161.g 251 kB/s | 23 kB 00:00 2023-09-28T04:20:16.350 INFO:teuthology.orchestra.run.smithi174.stdout:(29/139): ceph-mgr-cephadm-17.2.6-1161.g471b6df 2.0 MB/s | 121 kB 00:00 2023-09-28T04:20:16.600 INFO:teuthology.orchestra.run.smithi174.stdout:(30/139): ceph-mgr-dashboard-17.2.6-1161.g471b6 5.8 MB/s | 1.7 MB 00:00 2023-09-28T04:20:16.717 INFO:teuthology.orchestra.run.smithi174.stdout:(31/139): ceph-mgr-modules-core-17.2.6-1161.g47 2.0 MB/s | 238 kB 00:00 2023-09-28T04:20:16.801 INFO:teuthology.orchestra.run.smithi174.stdout:(32/139): ceph-mgr-rook-17.2.6-1161.g471b6dfd.e 569 kB/s | 47 kB 00:00 2023-09-28T04:20:16.918 INFO:teuthology.orchestra.run.smithi174.stdout:(33/139): ceph-mgr-diskprediction-local-17.2.6- 13 MB/s | 7.4 MB 00:00 2023-09-28T04:20:16.968 INFO:teuthology.orchestra.run.smithi174.stdout:(34/139): ceph-prometheus-alerts-17.2.6-1161.g4 87 kB/s | 14 kB 00:00 2023-09-28T04:20:17.001 INFO:teuthology.orchestra.run.smithi174.stdout:(35/139): ceph-volume-17.2.6-1161.g471b6dfd.el8 3.1 MB/s | 267 kB 00:00 2023-09-28T04:20:17.027 INFO:teuthology.orchestra.run.smithi174.stdout:(36/139): cephadm-17.2.6-1161.g471b6dfd.el8.noa 1.3 MB/s | 80 kB 00:00 2023-09-28T04:20:17.060 INFO:teuthology.orchestra.run.smithi174.stdout:(37/139): cephfs-top-17.2.6-1161.g471b6dfd.el8. 309 kB/s | 18 kB 00:00 2023-09-28T04:20:17.439 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-28T04:20:17.440 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-28T04:20:17.454 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-28T04:20:17.454 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-28T04:20:17.455 INFO:teuthology.orchestra.run.smithi118.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-28T04:20:17.456 INFO:teuthology.orchestra.run.smithi118.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-28T04:20:17.457 INFO:teuthology.orchestra.run.smithi118.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-28T04:20:17.459 INFO:teuthology.orchestra.run.smithi118.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-28T04:20:17.462 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-28T04:20:17.463 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-28T04:20:17.685 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-09-28T04:20:17.698 INFO:teuthology.orchestra.run.smithi118.stdout:==================================================================================================== 2023-09-28T04:20:17.699 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2023-09-28T04:20:17.699 INFO:teuthology.orchestra.run.smithi118.stdout:==================================================================================================== 2023-09-28T04:20:17.699 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2023-09-28T04:20:17.699 INFO:teuthology.orchestra.run.smithi118.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-28T04:20:17.699 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 6.4 k 2023-09-28T04:20:17.699 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 5.2 M 2023-09-28T04:20:17.699 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 874 k 2023-09-28T04:20:17.699 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 162 k 2023-09-28T04:20:17.699 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 1.6 M 2023-09-28T04:20:17.699 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 121 k 2023-09-28T04:20:17.699 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 1.7 M 2023-09-28T04:20:17.700 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 7.4 M 2023-09-28T04:20:17.700 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 47 k 2023-09-28T04:20:17.700 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 17 M 2023-09-28T04:20:17.700 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 52 M 2023-09-28T04:20:17.700 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 267 k 2023-09-28T04:20:17.700 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 80 k 2023-09-28T04:20:17.700 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 255 k 2023-09-28T04:20:17.700 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 18 k 2023-09-28T04:20:17.700 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-28T04:20:17.700 INFO:teuthology.orchestra.run.smithi118.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-28T04:20:17.700 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-09-28T04:20:17.700 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 25 k 2023-09-28T04:20:17.701 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 796 k 2023-09-28T04:20:17.701 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 130 k 2023-09-28T04:20:17.701 INFO:teuthology.orchestra.run.smithi118.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-09-28T04:20:17.701 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-09-28T04:20:17.701 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-28T04:20:17.701 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 190 k 2023-09-28T04:20:17.701 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 371 k 2023-09-28T04:20:17.701 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 359 k 2023-09-28T04:20:17.701 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 107 k 2023-09-28T04:20:17.701 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 91 k 2023-09-28T04:20:17.701 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.5 M 2023-09-28T04:20:17.701 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 173 k 2023-09-28T04:20:17.702 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-09-28T04:20:17.702 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2023-09-28T04:20:17.702 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-28T04:20:17.702 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-28T04:20:17.702 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-28T04:20:17.702 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-28T04:20:17.702 INFO:teuthology.orchestra.run.smithi118.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-28T04:20:17.702 INFO:teuthology.orchestra.run.smithi118.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-28T04:20:17.702 INFO:teuthology.orchestra.run.smithi118.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-28T04:20:17.702 INFO:teuthology.orchestra.run.smithi118.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-28T04:20:17.702 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.5 M 2023-09-28T04:20:17.702 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.6 M 2023-09-28T04:20:17.703 INFO:teuthology.orchestra.run.smithi118.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-28T04:20:17.703 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-28T04:20:17.703 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-28T04:20:17.703 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-28T04:20:17.703 INFO:teuthology.orchestra.run.smithi118.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-09-28T04:20:17.703 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-09-28T04:20:17.703 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2023-09-28T04:20:17.703 INFO:teuthology.orchestra.run.smithi118.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-09-28T04:20:17.703 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 23 M 2023-09-28T04:20:17.703 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 23 k 2023-09-28T04:20:17.703 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 2.3 M 2023-09-28T04:20:17.704 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 238 k 2023-09-28T04:20:17.704 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.9 M 2023-09-28T04:20:17.704 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 17 M 2023-09-28T04:20:17.704 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 14 k 2023-09-28T04:20:17.704 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 24 k 2023-09-28T04:20:17.704 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-28T04:20:17.704 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-28T04:20:17.704 INFO:teuthology.orchestra.run.smithi118.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-28T04:20:17.704 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-28T04:20:17.704 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-28T04:20:17.704 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 175 k 2023-09-28T04:20:17.704 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-28T04:20:17.704 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-28T04:20:17.705 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-28T04:20:17.705 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-28T04:20:17.705 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-28T04:20:17.705 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 507 k 2023-09-28T04:20:17.705 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-28T04:20:17.705 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 5.6 M 2023-09-28T04:20:17.705 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-28T04:20:17.705 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-28T04:20:17.705 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-28T04:20:17.705 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-28T04:20:17.705 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-28T04:20:17.706 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-28T04:20:17.706 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-28T04:20:17.706 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-28T04:20:17.706 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-28T04:20:17.706 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-28T04:20:17.706 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-28T04:20:17.706 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-28T04:20:17.706 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-28T04:20:17.706 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-09-28T04:20:17.706 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-28T04:20:17.706 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-28T04:20:17.706 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-28T04:20:17.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 45 k 2023-09-28T04:20:17.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 115 k 2023-09-28T04:20:17.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-28T04:20:17.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-28T04:20:17.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-28T04:20:17.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-28T04:20:17.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-28T04:20:17.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-28T04:20:17.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-28T04:20:17.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-28T04:20:17.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-09-28T04:20:17.707 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-28T04:20:17.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-28T04:20:17.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-28T04:20:17.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-28T04:20:17.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-28T04:20:17.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-28T04:20:17.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-28T04:20:17.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-28T04:20:17.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-28T04:20:17.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-28T04:20:17.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-28T04:20:17.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-28T04:20:17.708 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-28T04:20:17.709 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-28T04:20:17.709 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-28T04:20:17.709 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-28T04:20:17.709 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-28T04:20:17.709 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-28T04:20:17.709 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-28T04:20:17.709 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-28T04:20:17.709 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-28T04:20:17.709 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-28T04:20:17.709 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-28T04:20:17.709 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-28T04:20:17.709 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-28T04:20:17.709 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-28T04:20:17.710 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-28T04:20:17.710 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-28T04:20:17.710 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-28T04:20:17.710 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-28T04:20:17.710 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-28T04:20:17.710 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-28T04:20:17.710 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-28T04:20:17.710 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-28T04:20:17.710 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-28T04:20:17.710 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-28T04:20:17.710 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-28T04:20:17.710 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-28T04:20:17.711 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-28T04:20:17.711 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:20:17.711 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-09-28T04:20:17.711 INFO:teuthology.orchestra.run.smithi118.stdout:==================================================================================================== 2023-09-28T04:20:17.711 INFO:teuthology.orchestra.run.smithi118.stdout:Install 123 Packages 2023-09-28T04:20:17.711 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 16 Packages 2023-09-28T04:20:17.711 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:20:17.711 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 209 M 2023-09-28T04:20:17.712 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2023-09-28T04:20:18.389 INFO:teuthology.orchestra.run.smithi118.stdout:(1/139): ceph-17.2.6-1161.g471b6dfd.el8.x86_64. 32 kB/s | 6.4 kB 00:00 2023-09-28T04:20:18.586 INFO:teuthology.orchestra.run.smithi174.stdout:(38/139): ceph-test-17.2.6-1161.g471b6dfd.el8.x 11 MB/s | 52 MB 00:04 2023-09-28T04:20:18.619 INFO:teuthology.orchestra.run.smithi174.stdout:(39/139): bison-3.0.4-10.el8.x86_64.rpm 442 kB/s | 688 kB 00:01 2023-09-28T04:20:18.644 INFO:teuthology.orchestra.run.smithi174.stdout:(40/139): automake-1.16.1-8.el8.noarch.rpm 457 kB/s | 740 kB 00:01 2023-09-28T04:20:18.798 INFO:teuthology.orchestra.run.smithi118.stdout:(2/139): ceph-fuse-17.2.6-1161.g471b6dfd.el8.x8 2.1 MB/s | 874 kB 00:00 2023-09-28T04:20:18.890 INFO:teuthology.orchestra.run.smithi118.stdout:(3/139): ceph-immutable-object-cache-17.2.6-116 1.7 MB/s | 162 kB 00:00 2023-09-28T04:20:18.953 INFO:teuthology.orchestra.run.smithi174.stdout:(41/139): jq-1.6-7.el8.x86_64.rpm 607 kB/s | 202 kB 00:00 2023-09-28T04:20:19.007 INFO:teuthology.orchestra.run.smithi118.stdout:(4/139): ceph-base-17.2.6-1161.g471b6dfd.el8.x8 6.3 MB/s | 5.2 MB 00:00 2023-09-28T04:20:19.199 INFO:teuthology.orchestra.run.smithi118.stdout:(5/139): ceph-mgr-17.2.6-1161.g471b6dfd.el8.x86 8.2 MB/s | 1.6 MB 00:00 2023-09-28T04:20:19.278 INFO:teuthology.orchestra.run.smithi174.stdout:(42/139): librdkafka-0.11.4-3.el8.x86_64.rpm 558 kB/s | 354 kB 00:00 2023-09-28T04:20:19.507 INFO:teuthology.orchestra.run.smithi118.stdout:(6/139): ceph-mds-17.2.6-1161.g471b6dfd.el8.x86 3.7 MB/s | 2.3 MB 00:00 2023-09-28T04:20:19.624 INFO:teuthology.orchestra.run.smithi118.stdout:(7/139): ceph-mon-17.2.6-1161.g471b6dfd.el8.x86 9.3 MB/s | 3.9 MB 00:00 2023-09-28T04:20:19.728 INFO:teuthology.orchestra.run.smithi174.stdout:(43/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 577 kB/s | 259 kB 00:00 2023-09-28T04:20:19.845 INFO:teuthology.orchestra.run.smithi174.stdout:(44/139): flex-2.6.1-9.el8.x86_64.rpm 254 kB/s | 320 kB 00:01 2023-09-28T04:20:19.962 INFO:teuthology.orchestra.run.smithi174.stdout:(45/139): oniguruma-6.8.2-2.el8.x86_64.rpm 802 kB/s | 187 kB 00:00 2023-09-28T04:20:19.987 INFO:teuthology.orchestra.run.smithi174.stdout:(46/139): libtool-2.4.6-25.el8.x86_64.rpm 685 kB/s | 709 kB 00:01 2023-09-28T04:20:20.558 INFO:teuthology.orchestra.run.smithi118.stdout:(8/139): ceph-common-17.2.6-1161.g471b6dfd.el8. 9.9 MB/s | 23 MB 00:02 2023-09-28T04:20:20.616 INFO:teuthology.orchestra.run.smithi118.stdout:(9/139): ceph-selinux-17.2.6-1161.g471b6dfd.el8 420 kB/s | 24 kB 00:00 2023-09-28T04:20:21.692 INFO:teuthology.orchestra.run.smithi118.stdout:(10/139): ceph-radosgw-17.2.6-1161.g471b6dfd.el 8.1 MB/s | 17 MB 00:02 2023-09-28T04:20:22.033 INFO:teuthology.orchestra.run.smithi118.stdout:(11/139): cephfs-mirror-17.2.6-1161.g471b6dfd.e 749 kB/s | 255 kB 00:00 2023-09-28T04:20:22.284 INFO:teuthology.orchestra.run.smithi118.stdout:(12/139): ceph-osd-17.2.6-1161.g471b6dfd.el8.x8 6.0 MB/s | 17 MB 00:02 2023-09-28T04:20:22.309 INFO:teuthology.orchestra.run.smithi118.stdout:(13/139): libcephfs-devel-17.2.6-1161.g471b6dfd 90 kB/s | 25 kB 00:00 2023-09-28T04:20:22.417 INFO:teuthology.orchestra.run.smithi118.stdout:(14/139): libcephfs2-17.2.6-1161.g471b6dfd.el8. 5.8 MB/s | 796 kB 00:00 2023-09-28T04:20:22.501 INFO:teuthology.orchestra.run.smithi118.stdout:(15/139): librados-devel-17.2.6-1161.g471b6dfd. 1.5 MB/s | 130 kB 00:00 2023-09-28T04:20:22.535 INFO:teuthology.orchestra.run.smithi118.stdout:(16/139): libcephsqlite-17.2.6-1161.g471b6dfd.e 776 kB/s | 175 kB 00:00 2023-09-28T04:20:22.627 INFO:teuthology.orchestra.run.smithi118.stdout:(17/139): libradosstriper1-17.2.6-1161.g471b6df 4.0 MB/s | 507 kB 00:00 2023-09-28T04:20:22.702 INFO:teuthology.orchestra.run.smithi118.stdout:(18/139): python3-ceph-argparse-17.2.6-1161.g47 595 kB/s | 45 kB 00:00 2023-09-28T04:20:22.769 INFO:teuthology.orchestra.run.smithi118.stdout:(19/139): python3-ceph-common-17.2.6-1161.g471b 1.7 MB/s | 115 kB 00:00 2023-09-28T04:20:22.844 INFO:teuthology.orchestra.run.smithi118.stdout:(20/139): python3-cephfs-17.2.6-1161.g471b6dfd. 2.5 MB/s | 190 kB 00:00 2023-09-28T04:20:22.936 INFO:teuthology.orchestra.run.smithi118.stdout:(21/139): python3-rados-17.2.6-1161.g471b6dfd.e 4.0 MB/s | 371 kB 00:00 2023-09-28T04:20:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:(22/139): python3-rbd-17.2.6-1161.g471b6dfd.el8 3.5 MB/s | 359 kB 00:00 2023-09-28T04:20:23.121 INFO:teuthology.orchestra.run.smithi118.stdout:(23/139): python3-rgw-17.2.6-1161.g471b6dfd.el8 1.2 MB/s | 107 kB 00:00 2023-09-28T04:20:23.196 INFO:teuthology.orchestra.run.smithi118.stdout:(24/139): rbd-fuse-17.2.6-1161.g471b6dfd.el8.x8 1.2 MB/s | 91 kB 00:00 2023-09-28T04:20:23.345 INFO:teuthology.orchestra.run.smithi174.stdout:(47/139): openblas-threads-0.3.15-4.el8.x86_64. 1.4 MB/s | 4.9 MB 00:03 2023-09-28T04:20:23.421 INFO:teuthology.orchestra.run.smithi174.stdout:(48/139): python3-babel-2.5.1-7.el8.noarch.rpm 1.4 MB/s | 4.8 MB 00:03 2023-09-28T04:20:23.654 INFO:teuthology.orchestra.run.smithi174.stdout:(49/139): python3-jsonpatch-1.21-2.el8.noarch.r 114 kB/s | 27 kB 00:00 2023-09-28T04:20:23.671 INFO:teuthology.orchestra.run.smithi118.stdout:(25/139): rbd-mirror-17.2.6-1161.g471b6dfd.el8. 7.3 MB/s | 3.5 MB 00:00 2023-09-28T04:20:23.679 INFO:teuthology.orchestra.run.smithi174.stdout:(50/139): python3-jinja2-2.10.1-3.el8.noarch.rp 1.6 MB/s | 538 kB 00:00 2023-09-28T04:20:23.746 INFO:teuthology.orchestra.run.smithi118.stdout:(26/139): rbd-nbd-17.2.6-1161.g471b6dfd.el8.x86 2.3 MB/s | 173 kB 00:00 2023-09-28T04:20:23.913 INFO:teuthology.orchestra.run.smithi174.stdout:(51/139): python3-jsonpointer-1.10-11.el8.noarc 77 kB/s | 20 kB 00:00 2023-09-28T04:20:24.289 INFO:teuthology.orchestra.run.smithi118.stdout:(27/139): ceph-test-17.2.6-1161.g471b6dfd.el8.x 14 MB/s | 52 MB 00:03 2023-09-28T04:20:24.297 INFO:teuthology.orchestra.run.smithi174.stdout:(52/139): python3-markupsafe-0.23-19.el8.x86_64 101 kB/s | 39 kB 00:00 2023-09-28T04:20:24.314 INFO:teuthology.orchestra.run.smithi118.stdout:(28/139): ceph-grafana-dashboards-17.2.6-1161.g 41 kB/s | 23 kB 00:00 2023-09-28T04:20:24.356 INFO:teuthology.orchestra.run.smithi118.stdout:(29/139): ceph-mgr-cephadm-17.2.6-1161.g471b6df 1.8 MB/s | 121 kB 00:00 2023-09-28T04:20:24.555 INFO:teuthology.orchestra.run.smithi174.stdout:(53/139): python3-mako-1.0.6-14.el8.noarch.rpm 179 kB/s | 157 kB 00:00 2023-09-28T04:20:24.581 INFO:teuthology.orchestra.run.smithi118.stdout:(30/139): librgw2-17.2.6-1161.g471b6dfd.el8.x86 2.7 MB/s | 5.6 MB 00:02 2023-09-28T04:20:24.623 INFO:teuthology.orchestra.run.smithi118.stdout:(31/139): ceph-mgr-dashboard-17.2.6-1161.g471b6 5.5 MB/s | 1.7 MB 00:00 2023-09-28T04:20:24.648 INFO:teuthology.orchestra.run.smithi118.stdout:(32/139): ceph-mgr-modules-core-17.2.6-1161.g47 3.5 MB/s | 238 kB 00:00 2023-09-28T04:20:24.681 INFO:teuthology.orchestra.run.smithi174.stdout:(54/139): openblas-0.3.15-4.el8.x86_64.rpm 1.0 MB/s | 4.7 MB 00:04 2023-09-28T04:20:24.707 INFO:teuthology.orchestra.run.smithi118.stdout:(33/139): ceph-mgr-rook-17.2.6-1161.g471b6dfd.e 567 kB/s | 47 kB 00:00 2023-09-28T04:20:24.724 INFO:teuthology.orchestra.run.smithi118.stdout:(34/139): ceph-prometheus-alerts-17.2.6-1161.g4 192 kB/s | 14 kB 00:00 2023-09-28T04:20:24.791 INFO:teuthology.orchestra.run.smithi118.stdout:(35/139): ceph-volume-17.2.6-1161.g471b6dfd.el8 3.1 MB/s | 267 kB 00:00 2023-09-28T04:20:24.816 INFO:teuthology.orchestra.run.smithi118.stdout:(36/139): cephadm-17.2.6-1161.g471b6dfd.el8.noa 874 kB/s | 80 kB 00:00 2023-09-28T04:20:24.866 INFO:teuthology.orchestra.run.smithi118.stdout:(37/139): cephfs-top-17.2.6-1161.g471b6dfd.el8. 240 kB/s | 18 kB 00:00 2023-09-28T04:20:24.948 INFO:teuthology.orchestra.run.smithi174.stdout:(55/139): python3-prettytable-0.7.2-14.el8.noar 165 kB/s | 44 kB 00:00 2023-09-28T04:20:24.958 INFO:teuthology.orchestra.run.smithi118.stdout:(38/139): ceph-mgr-diskprediction-local-17.2.6- 12 MB/s | 7.4 MB 00:00 2023-09-28T04:20:25.389 INFO:teuthology.orchestra.run.smithi174.stdout:(56/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 270 kB/s | 225 kB 00:00 2023-09-28T04:20:25.598 INFO:teuthology.orchestra.run.smithi174.stdout:(57/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 159 kB/s | 103 kB 00:00 2023-09-28T04:20:26.092 INFO:teuthology.orchestra.run.smithi118.stdout:(39/139): bison-3.0.4-10.el8.x86_64.rpm 562 kB/s | 688 kB 00:01 2023-09-28T04:20:26.142 INFO:teuthology.orchestra.run.smithi118.stdout:(40/139): flex-2.6.1-9.el8.x86_64.rpm 270 kB/s | 320 kB 00:01 2023-09-28T04:20:26.340 INFO:teuthology.orchestra.run.smithi174.stdout:(58/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 133 kB/s | 126 kB 00:00 2023-09-28T04:20:26.532 INFO:teuthology.orchestra.run.smithi174.stdout:(59/139): python3-pyasn1-modules-0.3.7-6.el8.no 118 kB/s | 110 kB 00:00 2023-09-28T04:20:26.668 INFO:teuthology.orchestra.run.smithi118.stdout:(41/139): jq-1.6-7.el8.x86_64.rpm 352 kB/s | 202 kB 00:00 2023-09-28T04:20:26.901 INFO:teuthology.orchestra.run.smithi118.stdout:(42/139): automake-1.16.1-8.el8.noarch.rpm 355 kB/s | 740 kB 00:02 2023-09-28T04:20:26.915 INFO:teuthology.orchestra.run.smithi174.stdout:(60/139): python3-pytz-2017.2-11.el8.noarch.rpm 99 kB/s | 57 kB 00:00 2023-09-28T04:20:27.627 INFO:teuthology.orchestra.run.smithi118.stdout:(43/139): librdkafka-0.11.4-3.el8.x86_64.rpm 238 kB/s | 354 kB 00:01 2023-09-28T04:20:27.649 INFO:teuthology.orchestra.run.smithi174.stdout:(61/139): python3-numpy-1.14.3-10.el8.x86_64.rp 1.1 MB/s | 3.7 MB 00:03 2023-09-28T04:20:27.833 INFO:teuthology.orchestra.run.smithi174.stdout:(62/139): python3-werkzeug-0.12.2-4.el8.noarch. 499 kB/s | 457 kB 00:00 2023-09-28T04:20:28.243 INFO:teuthology.orchestra.run.smithi118.stdout:(44/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 193 kB/s | 259 kB 00:01 2023-09-28T04:20:28.325 INFO:teuthology.orchestra.run.smithi174.stdout:(63/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 144 kB/s | 71 kB 00:00 2023-09-28T04:20:28.343 INFO:teuthology.orchestra.run.smithi118.stdout:(45/139): libtool-2.4.6-25.el8.x86_64.rpm 423 kB/s | 709 kB 00:01 2023-09-28T04:20:28.392 INFO:teuthology.orchestra.run.smithi174.stdout:(64/139): socat-1.7.4.1-1.el8.x86_64.rpm 435 kB/s | 323 kB 00:00 2023-09-28T04:20:28.684 INFO:teuthology.orchestra.run.smithi174.stdout:(65/139): elfutils-libelf-devel-0.189-3.el8.x86 172 kB/s | 62 kB 00:00 2023-09-28T04:20:28.702 INFO:teuthology.orchestra.run.smithi118.stdout:(46/139): oniguruma-6.8.2-2.el8.x86_64.rpm 174 kB/s | 187 kB 00:01 2023-09-28T04:20:28.759 INFO:teuthology.orchestra.run.smithi174.stdout:(66/139): fuse-2.9.7-17.el8.x86_64.rpm 226 kB/s | 83 kB 00:00 2023-09-28T04:20:28.792 INFO:teuthology.orchestra.run.smithi174.stdout:(67/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 443 kB/s | 48 kB 00:00 2023-09-28T04:20:28.928 INFO:teuthology.orchestra.run.smithi174.stdout:(68/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 138 kB/s | 19 kB 00:00 2023-09-28T04:20:29.043 INFO:teuthology.orchestra.run.smithi174.stdout:(69/139): libcom_err-devel-1.45.6-5.el8.x86_64. 339 kB/s | 39 kB 00:00 2023-09-28T04:20:29.076 INFO:teuthology.orchestra.run.smithi174.stdout:(70/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.7 MB/s | 561 kB 00:00 2023-09-28T04:20:29.207 INFO:teuthology.orchestra.run.smithi174.stdout:(71/139): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2023-09-28T04:20:29.327 INFO:teuthology.orchestra.run.smithi174.stdout:(72/139): libgfortran-8.5.0-20.el8.x86_64.rpm 2.2 MB/s | 645 kB 00:00 2023-09-28T04:20:29.352 INFO:teuthology.orchestra.run.smithi174.stdout:(73/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 324 kB/s | 47 kB 00:00 2023-09-28T04:20:29.436 INFO:teuthology.orchestra.run.smithi174.stdout:(74/139): libselinux-devel-2.9-8.el8.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2023-09-28T04:20:29.461 INFO:teuthology.orchestra.run.smithi174.stdout:(75/139): libsepol-devel-2.9-3.el8.x86_64.rpm 800 kB/s | 87 kB 00:00 2023-09-28T04:20:29.553 INFO:teuthology.orchestra.run.smithi174.stdout:(76/139): libuuid-devel-2.32.1-43.el8.x86_64.rp 852 kB/s | 100 kB 00:00 2023-09-28T04:20:29.578 INFO:teuthology.orchestra.run.smithi174.stdout:(77/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 154 kB/s | 18 kB 00:00 2023-09-28T04:20:29.662 INFO:teuthology.orchestra.run.smithi174.stdout:(78/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 404 kB/s | 44 kB 00:00 2023-09-28T04:20:29.804 INFO:teuthology.orchestra.run.smithi174.stdout:(79/139): pcre2-devel-10.32-3.el8.x86_64.rpm 4.2 MB/s | 605 kB 00:00 2023-09-28T04:20:29.912 INFO:teuthology.orchestra.run.smithi174.stdout:(80/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.1 MB/s | 229 kB 00:00 2023-09-28T04:20:29.963 INFO:teuthology.orchestra.run.smithi174.stdout:(81/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 8.3 MB/s | 3.2 MB 00:00 2023-09-28T04:20:30.021 INFO:teuthology.orchestra.run.smithi174.stdout:(82/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-09-28T04:20:30.080 INFO:teuthology.orchestra.run.smithi174.stdout:(83/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.1 MB/s | 249 kB 00:00 2023-09-28T04:20:30.130 INFO:teuthology.orchestra.run.smithi174.stdout:(84/139): python3-cryptography-3.2.1-6.el8.x86_ 5.8 MB/s | 641 kB 00:00 2023-09-28T04:20:30.180 INFO:teuthology.orchestra.run.smithi174.stdout:(85/139): python3-jwt-1.6.1-2.el8.noarch.rpm 426 kB/s | 43 kB 00:00 2023-09-28T04:20:30.239 INFO:teuthology.orchestra.run.smithi174.stdout:(86/139): python3-oauthlib-2.1.0-1.el8.noarch.r 1.4 MB/s | 155 kB 00:00 2023-09-28T04:20:30.289 INFO:teuthology.orchestra.run.smithi174.stdout:(87/139): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2023-09-28T04:20:30.356 INFO:teuthology.orchestra.run.smithi174.stdout:(88/139): python3-requests-oauthlib-1.0.0-1.el8 365 kB/s | 43 kB 00:00 2023-09-28T04:20:30.398 INFO:teuthology.orchestra.run.smithi174.stdout:(89/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 686 kB/s | 74 kB 00:00 2023-09-28T04:20:30.465 INFO:teuthology.orchestra.run.smithi174.stdout:(90/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 535 kB/s | 58 kB 00:00 2023-09-28T04:20:30.632 INFO:teuthology.orchestra.run.smithi174.stdout:(91/139): liboath-2.6.2-3.el8.x86_64.rpm 354 kB/s | 59 kB 00:00 2023-09-28T04:20:30.657 INFO:teuthology.orchestra.run.smithi174.stdout:(92/139): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-09-28T04:20:30.674 INFO:teuthology.orchestra.run.smithi174.stdout:(93/139): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2023-09-28T04:20:30.725 INFO:teuthology.orchestra.run.smithi174.stdout:(94/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 872 kB/s | 44 kB 00:00 2023-09-28T04:20:30.816 INFO:teuthology.orchestra.run.smithi174.stdout:(95/139): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2023-09-28T04:20:30.858 INFO:teuthology.orchestra.run.smithi174.stdout:(96/139): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2023-09-28T04:20:30.909 INFO:teuthology.orchestra.run.smithi174.stdout:(97/139): python3-cachetools-3.1.1-4.el8.noarch 359 kB/s | 33 kB 00:00 2023-09-28T04:20:30.934 INFO:teuthology.orchestra.run.smithi174.stdout:(98/139): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2023-09-28T04:20:31.001 INFO:teuthology.orchestra.run.smithi174.stdout:(99/139): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-09-28T04:20:31.051 INFO:teuthology.orchestra.run.smithi174.stdout:(100/139): python3-google-auth-1.1.1-10.el8.noa 1.6 MB/s | 81 kB 00:00 2023-09-28T04:20:31.093 INFO:teuthology.orchestra.run.smithi174.stdout:(101/139): python3-cherrypy-18.4.0-1.el8.noarch 2.4 MB/s | 384 kB 00:00 2023-09-28T04:20:31.119 INFO:teuthology.orchestra.run.smithi174.stdout:(102/139): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-09-28T04:20:31.143 INFO:teuthology.orchestra.run.smithi174.stdout:(103/139): python3-jaraco-functools-2.0-4.el8.n 350 kB/s | 18 kB 00:00 2023-09-28T04:20:31.202 INFO:teuthology.orchestra.run.smithi174.stdout:(104/139): python3-logutils-0.3.5-11.el8.noarch 835 kB/s | 49 kB 00:00 2023-09-28T04:20:31.252 INFO:teuthology.orchestra.run.smithi174.stdout:(105/139): python3-more-itertools-7.2.0-3.el8.n 1.2 MB/s | 59 kB 00:00 2023-09-28T04:20:31.303 INFO:teuthology.orchestra.run.smithi174.stdout:(106/139): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2023-09-28T04:20:31.420 INFO:teuthology.orchestra.run.smithi174.stdout:(107/139): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-09-28T04:20:31.487 INFO:teuthology.orchestra.run.smithi174.stdout:(108/139): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2023-09-28T04:20:31.537 INFO:teuthology.orchestra.run.smithi174.stdout:(109/139): python3-repoze-lru-0.7-6.el8.noarch. 674 kB/s | 34 kB 00:00 2023-09-28T04:20:31.596 INFO:teuthology.orchestra.run.smithi174.stdout:(110/139): python3-kubernetes-11.0.0-6.el8.noar 2.4 MB/s | 1.2 MB 00:00 2023-09-28T04:20:31.619 INFO:teuthology.orchestra.run.smithi118.stdout:(47/139): openblas-0.3.15-4.el8.x86_64.rpm 1.4 MB/s | 4.7 MB 00:03 2023-09-28T04:20:31.646 INFO:teuthology.orchestra.run.smithi174.stdout:(111/139): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-09-28T04:20:31.671 INFO:teuthology.orchestra.run.smithi174.stdout:(112/139): python3-routes-2.4.1-12.el8.noarch.r 1.4 MB/s | 196 kB 00:00 2023-09-28T04:20:31.696 INFO:teuthology.orchestra.run.smithi174.stdout:(113/139): python3-simplegeneric-0.8.1-17.el8.n 373 kB/s | 19 kB 00:00 2023-09-28T04:20:31.750 INFO:teuthology.orchestra.run.smithi174.stdout:(114/139): python3-singledispatch-3.4.0.3-18.el 306 kB/s | 24 kB 00:00 2023-09-28T04:20:31.781 INFO:teuthology.orchestra.run.smithi174.stdout:(115/139): python3-tempora-1.14.1-5.el8.noarch. 350 kB/s | 29 kB 00:00 2023-09-28T04:20:31.806 INFO:teuthology.orchestra.run.smithi174.stdout:(116/139): python3-trustme-0.6.0-4.el8.noarch.r 495 kB/s | 27 kB 00:00 2023-09-28T04:20:31.817 INFO:teuthology.orchestra.run.smithi118.stdout:(48/139): python3-babel-2.5.1-7.el8.noarch.rpm 1.5 MB/s | 4.8 MB 00:03 2023-09-28T04:20:31.861 INFO:teuthology.orchestra.run.smithi118.stdout:(49/139): python3-jinja2-2.10.1-3.el8.noarch.rp 2.2 MB/s | 538 kB 00:00 2023-09-28T04:20:31.897 INFO:teuthology.orchestra.run.smithi174.stdout:(117/139): python3-waitress-1.4.3-1.el8.noarch. 2.1 MB/s | 255 kB 00:00 2023-09-28T04:20:31.911 INFO:teuthology.orchestra.run.smithi118.stdout:(50/139): python3-jsonpatch-1.21-2.el8.noarch.r 283 kB/s | 27 kB 00:00 2023-09-28T04:20:31.940 INFO:teuthology.orchestra.run.smithi174.stdout:(118/139): python3-webob-1.8.5-1.el8.1.noarch.r 1.8 MB/s | 251 kB 00:00 2023-09-28T04:20:31.965 INFO:teuthology.orchestra.run.smithi174.stdout:(119/139): python3-websocket-client-0.56.0-5.el 914 kB/s | 61 kB 00:00 2023-09-28T04:20:31.990 INFO:teuthology.orchestra.run.smithi174.stdout:(120/139): python3-webtest-2.0.33-1.el8.noarch. 1.7 MB/s | 85 kB 00:00 2023-09-28T04:20:32.039 INFO:teuthology.orchestra.run.smithi174.stdout:(121/139): python3-zc-lockfile-2.0-2.el8.noarch 310 kB/s | 23 kB 00:00 2023-09-28T04:20:32.112 INFO:teuthology.orchestra.run.smithi118.stdout:(51/139): python3-jsonpointer-1.10-11.el8.noarc 80 kB/s | 20 kB 00:00 2023-09-28T04:20:32.387 INFO:teuthology.orchestra.run.smithi118.stdout:(52/139): python3-mako-1.0.6-14.el8.noarch.rpm 330 kB/s | 157 kB 00:00 2023-09-28T04:20:32.474 INFO:teuthology.orchestra.run.smithi174.stdout:(122/139): librados2-17.2.6-1161.g471b6dfd.el8. 8.0 MB/s | 3.5 MB 00:00 2023-09-28T04:20:32.521 INFO:teuthology.orchestra.run.smithi118.stdout:(53/139): python3-markupsafe-0.23-19.el8.x86_64 95 kB/s | 39 kB 00:00 2023-09-28T04:20:32.683 INFO:teuthology.orchestra.run.smithi174.stdout:(123/139): thrift-0.13.0-2.el8.x86_64.rpm 2.5 MB/s | 1.7 MB 00:00 2023-09-28T04:20:32.741 INFO:teuthology.orchestra.run.smithi174.stdout:(124/139): librbd1-17.2.6-1161.g471b6dfd.el8.x8 13 MB/s | 3.6 MB 00:00 2023-09-28T04:20:32.902 INFO:teuthology.orchestra.run.smithi174.stdout:(125/139): python3-scipy-1.0.0-21.module_el8.5. 2.1 MB/s | 14 MB 00:06 2023-09-28T04:20:33.092 INFO:teuthology.orchestra.run.smithi118.stdout:(54/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 394 kB/s | 225 kB 00:00 2023-09-28T04:20:33.192 INFO:teuthology.orchestra.run.smithi174.stdout:(126/139): elfutils-debuginfod-client-0.189-3.e 169 kB/s | 76 kB 00:00 2023-09-28T04:20:33.204 INFO:teuthology.orchestra.run.smithi118.stdout:(55/139): python3-prettytable-0.7.2-14.el8.noar 393 kB/s | 44 kB 00:00 2023-09-28T04:20:33.267 INFO:teuthology.orchestra.run.smithi174.stdout:(127/139): NetworkManager-initscripts-updown-1. 246 kB/s | 143 kB 00:00 2023-09-28T04:20:33.271 INFO:teuthology.orchestra.run.smithi118.stdout:(56/139): openblas-threads-0.3.15-4.el8.x86_64. 1.0 MB/s | 4.9 MB 00:04 2023-09-28T04:20:33.405 INFO:teuthology.orchestra.run.smithi118.stdout:(57/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 517 kB/s | 103 kB 00:00 2023-09-28T04:20:33.451 INFO:teuthology.orchestra.run.smithi174.stdout:(128/139): elfutils-libelf-0.189-3.el8.x86_64.r 422 kB/s | 232 kB 00:00 2023-09-28T04:20:33.476 INFO:teuthology.orchestra.run.smithi174.stdout:(129/139): elfutils-libs-0.189-3.el8.x86_64.rpm 1.0 MB/s | 303 kB 00:00 2023-09-28T04:20:33.568 INFO:teuthology.orchestra.run.smithi174.stdout:(130/139): iproute-6.2.0-2.el8.x86_64.rpm 2.9 MB/s | 880 kB 00:00 2023-09-28T04:20:33.593 INFO:teuthology.orchestra.run.smithi174.stdout:(131/139): libfdisk-2.32.1-43.el8.x86_64.rpm 2.1 MB/s | 254 kB 00:00 2023-09-28T04:20:33.622 INFO:teuthology.orchestra.run.smithi118.stdout:(58/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 361 kB/s | 126 kB 00:00 2023-09-28T04:20:33.652 INFO:teuthology.orchestra.run.smithi174.stdout:(132/139): libblkid-2.32.1-43.el8.x86_64.rpm 1.1 MB/s | 220 kB 00:00 2023-09-28T04:20:33.677 INFO:teuthology.orchestra.run.smithi174.stdout:(133/139): libmount-2.32.1-43.el8.x86_64.rpm 2.1 MB/s | 236 kB 00:00 2023-09-28T04:20:33.744 INFO:teuthology.orchestra.run.smithi174.stdout:(134/139): libsmartcols-2.32.1-43.el8.x86_64.rp 1.2 MB/s | 179 kB 00:00 2023-09-28T04:20:33.769 INFO:teuthology.orchestra.run.smithi174.stdout:(135/139): libuuid-2.32.1-43.el8.x86_64.rpm 845 kB/s | 99 kB 00:00 2023-09-28T04:20:33.806 INFO:teuthology.orchestra.run.smithi118.stdout:(59/139): python3-pyasn1-modules-0.3.7-6.el8.no 275 kB/s | 110 kB 00:00 2023-09-28T04:20:33.853 INFO:teuthology.orchestra.run.smithi174.stdout:(136/139): util-linux-user-2.32.1-43.el8.x86_64 945 kB/s | 103 kB 00:00 2023-09-28T04:20:33.886 INFO:teuthology.orchestra.run.smithi174.stdout:(137/139): xfsdump-3.1.8-6.el8.x86_64.rpm 2.8 MB/s | 334 kB 00:00 2023-09-28T04:20:34.003 INFO:teuthology.orchestra.run.smithi174.stdout:(138/139): util-linux-2.32.1-43.el8.x86_64.rpm 7.6 MB/s | 2.5 MB 00:00 2023-09-28T04:20:34.006 INFO:teuthology.orchestra.run.smithi118.stdout:(60/139): python3-pytz-2017.2-11.el8.noarch.rpm 149 kB/s | 57 kB 00:00 2023-09-28T04:20:34.103 INFO:teuthology.orchestra.run.smithi174.stdout:(139/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.3 MB/s | 1.1 MB 00:00 2023-09-28T04:20:34.107 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2023-09-28T04:20:34.107 INFO:teuthology.orchestra.run.smithi174.stdout:Total 8.3 MB/s | 209 MB 00:25 2023-09-28T04:20:34.140 INFO:teuthology.orchestra.run.smithi118.stdout:(61/139): python3-numpy-1.14.3-10.el8.x86_64.rp 2.1 MB/s | 3.7 MB 00:01 2023-09-28T04:20:34.673 INFO:teuthology.orchestra.run.smithi118.stdout:(62/139): python3-werkzeug-0.12.2-4.el8.noarch. 686 kB/s | 457 kB 00:00 2023-09-28T04:20:34.773 INFO:teuthology.orchestra.run.smithi118.stdout:(63/139): socat-1.7.4.1-1.el8.x86_64.rpm 510 kB/s | 323 kB 00:00 2023-09-28T04:20:34.799 INFO:teuthology.orchestra.run.smithi118.stdout:(64/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 564 kB/s | 71 kB 00:00 2023-09-28T04:20:34.925 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2023-09-28T04:20:35.173 INFO:teuthology.orchestra.run.smithi118.stdout:(65/139): elfutils-libelf-devel-0.189-3.el8.x86 154 kB/s | 62 kB 00:00 2023-09-28T04:20:35.208 INFO:teuthology.orchestra.run.smithi118.stdout:(66/139): fuse-2.9.7-17.el8.x86_64.rpm 203 kB/s | 83 kB 00:00 2023-09-28T04:20:35.281 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2023-09-28T04:20:35.281 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2023-09-28T04:20:35.300 INFO:teuthology.orchestra.run.smithi118.stdout:(67/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 382 kB/s | 48 kB 00:00 2023-09-28T04:20:35.417 INFO:teuthology.orchestra.run.smithi118.stdout:(68/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 160 kB/s | 19 kB 00:00 2023-09-28T04:20:35.500 INFO:teuthology.orchestra.run.smithi118.stdout:(69/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.9 MB/s | 561 kB 00:00 2023-09-28T04:20:35.525 INFO:teuthology.orchestra.run.smithi118.stdout:(70/139): libcom_err-devel-1.45.6-5.el8.x86_64. 357 kB/s | 39 kB 00:00 2023-09-28T04:20:35.709 INFO:teuthology.orchestra.run.smithi118.stdout:(71/139): libgfortran-8.5.0-20.el8.x86_64.rpm 3.0 MB/s | 645 kB 00:00 2023-09-28T04:20:35.734 INFO:teuthology.orchestra.run.smithi118.stdout:(72/139): libquadmath-8.5.0-20.el8.x86_64.rpm 827 kB/s | 172 kB 00:00 2023-09-28T04:20:35.818 INFO:teuthology.orchestra.run.smithi118.stdout:(73/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 433 kB/s | 47 kB 00:00 2023-09-28T04:20:35.852 INFO:teuthology.orchestra.run.smithi118.stdout:(74/139): libselinux-devel-2.9-8.el8.x86_64.rpm 1.7 MB/s | 200 kB 00:00 2023-09-28T04:20:35.927 INFO:teuthology.orchestra.run.smithi118.stdout:(75/139): libsepol-devel-2.9-3.el8.x86_64.rpm 799 kB/s | 87 kB 00:00 2023-09-28T04:20:35.961 INFO:teuthology.orchestra.run.smithi118.stdout:(76/139): libuuid-devel-2.32.1-43.el8.x86_64.rp 919 kB/s | 100 kB 00:00 2023-09-28T04:20:36.036 INFO:teuthology.orchestra.run.smithi118.stdout:(77/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 166 kB/s | 18 kB 00:00 2023-09-28T04:20:36.070 INFO:teuthology.orchestra.run.smithi118.stdout:(78/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 404 kB/s | 44 kB 00:00 2023-09-28T04:20:36.262 INFO:teuthology.orchestra.run.smithi118.stdout:(79/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 14 MB/s | 3.2 MB 00:00 2023-09-28T04:20:36.296 INFO:teuthology.orchestra.run.smithi118.stdout:(80/139): pcre2-devel-10.32-3.el8.x86_64.rpm 2.6 MB/s | 605 kB 00:00 2023-09-28T04:20:36.371 INFO:teuthology.orchestra.run.smithi118.stdout:(81/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.1 MB/s | 229 kB 00:00 2023-09-28T04:20:36.433 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2023-09-28T04:20:36.436 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2023-09-28T04:20:36.455 INFO:teuthology.orchestra.run.smithi118.stdout:(82/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-09-28T04:20:36.480 INFO:teuthology.orchestra.run.smithi118.stdout:(83/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.2 MB/s | 249 kB 00:00 2023-09-28T04:20:36.864 INFO:teuthology.orchestra.run.smithi118.stdout:(84/139): python3-cryptography-3.2.1-6.el8.x86_ 1.5 MB/s | 641 kB 00:00 2023-09-28T04:20:36.889 INFO:teuthology.orchestra.run.smithi118.stdout:(85/139): python3-jwt-1.6.1-2.el8.noarch.rpm 104 kB/s | 43 kB 00:00 2023-09-28T04:20:37.040 INFO:teuthology.orchestra.run.smithi118.stdout:(86/139): python3-scipy-1.0.0-21.module_el8.5.0 4.2 MB/s | 14 MB 00:03 2023-09-28T04:20:37.065 INFO:teuthology.orchestra.run.smithi118.stdout:(87/139): python3-pycparser-2.14-14.el8.noarch. 622 kB/s | 109 kB 00:00 2023-09-28T04:20:37.090 INFO:teuthology.orchestra.run.smithi118.stdout:(88/139): python3-oauthlib-2.1.0-1.el8.noarch.r 686 kB/s | 155 kB 00:00 2023-09-28T04:20:37.174 INFO:teuthology.orchestra.run.smithi118.stdout:(89/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 687 kB/s | 74 kB 00:00 2023-09-28T04:20:37.199 INFO:teuthology.orchestra.run.smithi118.stdout:(90/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 535 kB/s | 58 kB 00:00 2023-09-28T04:20:37.400 INFO:teuthology.orchestra.run.smithi118.stdout:(91/139): python3-requests-oauthlib-1.0.0-1.el8 119 kB/s | 43 kB 00:00 2023-09-28T04:20:37.775 INFO:teuthology.orchestra.run.smithi118.stdout:(92/139): liboath-2.6.2-3.el8.x86_64.rpm 102 kB/s | 59 kB 00:00 2023-09-28T04:20:37.967 INFO:teuthology.orchestra.run.smithi118.stdout:(93/139): libunwind-1.3.1-3.el8.x86_64.rpm 132 kB/s | 75 kB 00:00 2023-09-28T04:20:38.067 INFO:teuthology.orchestra.run.smithi118.stdout:(94/139): gperftools-libs-2.7-9.el8.x86_64.rpm 343 kB/s | 306 kB 00:00 2023-09-28T04:20:38.125 INFO:teuthology.orchestra.run.smithi118.stdout:(95/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 276 kB/s | 44 kB 00:00 2023-09-28T04:20:38.243 INFO:teuthology.orchestra.run.smithi118.stdout:(96/139): python3-cachetools-3.1.1-4.el8.noarch 282 kB/s | 33 kB 00:00 2023-09-28T04:20:38.343 INFO:teuthology.orchestra.run.smithi118.stdout:(97/139): python3-beautifulsoup4-4.6.3-2.el8.1. 672 kB/s | 185 kB 00:00 2023-09-28T04:20:38.368 INFO:teuthology.orchestra.run.smithi118.stdout:(98/139): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2023-09-28T04:20:38.411 INFO:teuthology.orchestra.run.smithi118.stdout:(99/139): python3-asyncssh-2.7.0-2.el8.noarch.r 749 kB/s | 476 kB 00:00 2023-09-28T04:20:38.611 INFO:teuthology.orchestra.run.smithi118.stdout:(100/139): python3-google-auth-1.1.1-10.el8.noa 406 kB/s | 81 kB 00:00 2023-09-28T04:20:38.636 INFO:teuthology.orchestra.run.smithi118.stdout:(101/139): python3-cheroot-8.5.2-1.el8.noarch.r 589 kB/s | 173 kB 00:00 2023-09-28T04:20:38.719 INFO:teuthology.orchestra.run.smithi118.stdout:(102/139): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-09-28T04:20:38.745 INFO:teuthology.orchestra.run.smithi118.stdout:(103/139): python3-jaraco-functools-2.0-4.el8.n 162 kB/s | 18 kB 00:00 2023-09-28T04:20:38.853 INFO:teuthology.orchestra.run.smithi118.stdout:(104/139): python3-logutils-0.3.5-11.el8.noarch 450 kB/s | 49 kB 00:00 2023-09-28T04:20:38.979 INFO:teuthology.orchestra.run.smithi118.stdout:(105/139): python3-more-itertools-7.2.0-3.el8.n 469 kB/s | 59 kB 00:00 2023-09-28T04:20:39.004 INFO:teuthology.orchestra.run.smithi118.stdout:(106/139): python3-cherrypy-18.4.0-1.el8.noarch 605 kB/s | 384 kB 00:00 2023-09-28T04:20:39.088 INFO:teuthology.orchestra.run.smithi118.stdout:(107/139): python3-natsort-7.1.1-2.el8.noarch.r 555 kB/s | 60 kB 00:00 2023-09-28T04:20:39.196 INFO:teuthology.orchestra.run.smithi118.stdout:(108/139): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-09-28T04:20:39.305 INFO:teuthology.orchestra.run.smithi118.stdout:(109/139): python3-repoze-lru-0.7-6.el8.noarch. 311 kB/s | 34 kB 00:00 2023-09-28T04:20:39.397 INFO:teuthology.orchestra.run.smithi118.stdout:(110/139): python3-pecan-1.3.2-9.el8.noarch.rpm 721 kB/s | 283 kB 00:00 2023-09-28T04:20:39.505 INFO:teuthology.orchestra.run.smithi118.stdout:(111/139): python3-rsa-4.9-2.el8.noarch.rpm 594 kB/s | 64 kB 00:00 2023-09-28T04:20:39.589 INFO:teuthology.orchestra.run.smithi118.stdout:(112/139): python3-routes-2.4.1-12.el8.noarch.r 692 kB/s | 196 kB 00:00 2023-09-28T04:20:39.614 INFO:teuthology.orchestra.run.smithi118.stdout:(113/139): python3-simplegeneric-0.8.1-17.el8.n 172 kB/s | 19 kB 00:00 2023-09-28T04:20:39.698 INFO:teuthology.orchestra.run.smithi118.stdout:(114/139): python3-singledispatch-3.4.0.3-18.el 220 kB/s | 24 kB 00:00 2023-09-28T04:20:39.723 INFO:teuthology.orchestra.run.smithi118.stdout:(115/139): python3-tempora-1.14.1-5.el8.noarch. 269 kB/s | 29 kB 00:00 2023-09-28T04:20:39.807 INFO:teuthology.orchestra.run.smithi118.stdout:(116/139): python3-trustme-0.6.0-4.el8.noarch.r 253 kB/s | 27 kB 00:00 2023-09-28T04:20:40.099 INFO:teuthology.orchestra.run.smithi118.stdout:(117/139): python3-waitress-1.4.3-1.el8.noarch. 680 kB/s | 255 kB 00:00 2023-09-28T04:20:40.198 INFO:teuthology.orchestra.run.smithi118.stdout:(118/139): python3-webob-1.8.5-1.el8.1.noarch.r 644 kB/s | 251 kB 00:00 2023-09-28T04:20:40.233 INFO:teuthology.orchestra.run.smithi118.stdout:(119/139): python3-websocket-client-0.56.0-5.el 458 kB/s | 61 kB 00:00 2023-09-28T04:20:40.358 INFO:teuthology.orchestra.run.smithi118.stdout:(120/139): python3-kubernetes-11.0.0-6.el8.noar 729 kB/s | 1.2 MB 00:01 2023-09-28T04:20:40.383 INFO:teuthology.orchestra.run.smithi118.stdout:(121/139): python3-zc-lockfile-2.0-2.el8.noarch 153 kB/s | 23 kB 00:00 2023-09-28T04:20:40.409 INFO:teuthology.orchestra.run.smithi118.stdout:(122/139): python3-webtest-2.0.33-1.el8.noarch. 405 kB/s | 85 kB 00:00 2023-09-28T04:20:40.942 INFO:teuthology.orchestra.run.smithi118.stdout:(123/139): librados2-17.2.6-1161.g471b6dfd.el8. 6.2 MB/s | 3.5 MB 00:00 2023-09-28T04:20:41.076 INFO:teuthology.orchestra.run.smithi118.stdout:(124/139): librbd1-17.2.6-1161.g471b6dfd.el8.x8 5.4 MB/s | 3.6 MB 00:00 2023-09-28T04:20:41.459 INFO:teuthology.orchestra.run.smithi118.stdout:(125/139): elfutils-debuginfod-client-0.189-3.e 199 kB/s | 76 kB 00:00 2023-09-28T04:20:41.485 INFO:teuthology.orchestra.run.smithi118.stdout:(126/139): NetworkManager-initscripts-updown-1. 265 kB/s | 143 kB 00:00 2023-09-28T04:20:41.786 INFO:teuthology.orchestra.run.smithi118.stdout:(127/139): elfutils-libs-0.189-3.el8.x86_64.rpm 1.0 MB/s | 303 kB 00:00 2023-09-28T04:20:41.811 INFO:teuthology.orchestra.run.smithi118.stdout:(128/139): elfutils-libelf-0.189-3.el8.x86_64.r 660 kB/s | 232 kB 00:00 2023-09-28T04:20:41.928 INFO:teuthology.orchestra.run.smithi118.stdout:(129/139): libblkid-2.32.1-43.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-09-28T04:20:41.995 INFO:teuthology.orchestra.run.smithi118.stdout:(130/139): iproute-6.2.0-2.el8.x86_64.rpm 4.1 MB/s | 880 kB 00:00 2023-09-28T04:20:42.037 INFO:teuthology.orchestra.run.smithi118.stdout:(131/139): libfdisk-2.32.1-43.el8.x86_64.rpm 2.3 MB/s | 254 kB 00:00 2023-09-28T04:20:42.104 INFO:teuthology.orchestra.run.smithi118.stdout:(132/139): libmount-2.32.1-43.el8.x86_64.rpm 2.1 MB/s | 236 kB 00:00 2023-09-28T04:20:42.146 INFO:teuthology.orchestra.run.smithi118.stdout:(133/139): libsmartcols-2.32.1-43.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-09-28T04:20:42.213 INFO:teuthology.orchestra.run.smithi118.stdout:(134/139): libuuid-2.32.1-43.el8.x86_64.rpm 912 kB/s | 99 kB 00:00 2023-09-28T04:20:42.285 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2023-09-28T04:20:42.313 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/1 2023-09-28T04:20:42.330 INFO:teuthology.orchestra.run.smithi118.stdout:(135/139): util-linux-user-2.32.1-43.el8.x86_64 880 kB/s | 103 kB 00:00 2023-09-28T04:20:42.447 INFO:teuthology.orchestra.run.smithi118.stdout:(136/139): xfsdump-3.1.8-6.el8.x86_64.rpm 2.8 MB/s | 334 kB 00:00 2023-09-28T04:20:42.468 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 1/155 2023-09-28T04:20:42.525 INFO:teuthology.orchestra.run.smithi118.stdout:(137/139): util-linux-2.32.1-43.el8.x86_64.rpm 6.6 MB/s | 2.5 MB 00:00 2023-09-28T04:20:42.577 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/155 2023-09-28T04:20:42.581 INFO:teuthology.orchestra.run.smithi118.stdout:(138/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 8.1 MB/s | 1.1 MB 00:00 2023-09-28T04:20:42.743 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 2/155 2023-09-28T04:20:42.823 INFO:teuthology.orchestra.run.smithi118.stdout:(139/139): thrift-0.13.0-2.el8.x86_64.rpm 721 kB/s | 1.7 MB 00:02 2023-09-28T04:20:42.827 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 2/155 2023-09-28T04:20:42.829 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2023-09-28T04:20:42.829 INFO:teuthology.orchestra.run.smithi118.stdout:Total 8.3 MB/s | 209 MB 00:25 2023-09-28T04:20:43.041 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-09-28T04:20:43.430 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 4/155 2023-09-28T04:20:43.669 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/155 2023-09-28T04:20:43.863 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-09-28T04:20:44.093 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-09-28T04:20:44.472 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-09-28T04:20:44.510 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2023-09-28T04:20:44.709 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 8/155 2023-09-28T04:20:44.919 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2023-09-28T04:20:44.919 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2023-09-28T04:20:45.140 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 8/155 2023-09-28T04:20:45.326 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 9/155 2023-09-28T04:20:45.489 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 9/155 2023-09-28T04:20:45.709 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/155 2023-09-28T04:20:45.809 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/155 2023-09-28T04:20:46.087 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 11/155 2023-09-28T04:20:46.309 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-09-28T04:20:46.348 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2023-09-28T04:20:46.352 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2023-09-28T04:20:46.840 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-09-28T04:20:46.993 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/155 2023-09-28T04:20:47.195 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/155 2023-09-28T04:20:47.467 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-09-28T04:20:47.524 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-09-28T04:20:47.766 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-09-28T04:20:48.016 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-09-28T04:20:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 17/155 2023-09-28T04:20:48.285 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 17/155 2023-09-28T04:20:48.417 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 18/155 2023-09-28T04:20:48.572 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 18/155 2023-09-28T04:20:48.774 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-09-28T04:20:48.955 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-09-28T04:20:49.134 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-09-28T04:20:49.257 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-09-28T04:20:49.434 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-09-28T04:20:50.029 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-09-28T04:20:50.284 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-09-28T04:20:50.881 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-09-28T04:20:51.075 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-09-28T04:20:51.762 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-09-28T04:20:51.793 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2023-09-28T04:20:51.851 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/1 2023-09-28T04:20:52.040 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 1/155 2023-09-28T04:20:52.133 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/155 2023-09-28T04:20:52.145 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-09-28T04:20:52.348 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-09-28T04:20:52.348 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 2/155 2023-09-28T04:20:52.445 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 2/155 2023-09-28T04:20:52.579 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/155 2023-09-28T04:20:52.691 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-09-28T04:20:52.851 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-09-28T04:20:53.083 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 4/155 2023-09-28T04:20:53.089 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8. 29/155 2023-09-28T04:20:53.219 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el 30/155 2023-09-28T04:20:53.312 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/155 2023-09-28T04:20:53.489 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_6 31/155 2023-09-28T04:20:53.522 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-09-28T04:20:53.757 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-09-28T04:20:54.189 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-09-28T04:20:54.379 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 8/155 2023-09-28T04:20:54.506 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-09-28T04:20:54.832 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 8/155 2023-09-28T04:20:54.891 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-09-28T04:20:55.031 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 9/155 2023-09-28T04:20:55.182 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 9/155 2023-09-28T04:20:55.205 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-09-28T04:20:55.348 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/155 2023-09-28T04:20:55.391 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-09-28T04:20:55.461 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/155 2023-09-28T04:20:55.711 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 11/155 2023-09-28T04:20:55.881 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-09-28T04:20:56.483 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-09-28T04:20:56.623 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/155 2023-09-28T04:20:56.861 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/155 2023-09-28T04:20:57.114 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-09-28T04:20:57.137 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-09-28T04:20:57.200 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-09-28T04:20:57.455 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-09-28T04:20:57.470 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-09-28T04:20:57.623 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-09-28T04:20:57.717 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-09-28T04:20:57.781 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 17/155 2023-09-28T04:20:57.897 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 17/155 2023-09-28T04:20:57.936 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-09-28T04:20:58.031 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 18/155 2023-09-28T04:20:58.199 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 18/155 2023-09-28T04:20:58.217 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 39/155 2023-09-28T04:20:58.408 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-09-28T04:20:58.471 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 40/155 2023-09-28T04:20:58.619 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-09-28T04:20:58.664 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_6 41/155 2023-09-28T04:20:58.747 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-09-28T04:20:58.861 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/155 2023-09-28T04:20:58.899 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-09-28T04:20:59.072 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-09-28T04:20:59.073 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/155 2023-09-28T04:20:59.324 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/155 2023-09-28T04:20:59.405 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/155 2023-09-28T04:20:59.624 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/155 2023-09-28T04:20:59.700 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/155 2023-09-28T04:20:59.748 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-09-28T04:20:59.877 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/155 2023-09-28T04:20:59.972 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-09-28T04:21:00.049 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-09-28T04:21:00.507 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-09-28T04:21:00.670 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-09-28T04:21:00.791 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/155 2023-09-28T04:21:00.806 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/155 2023-09-28T04:21:00.814 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-09-28T04:21:01.036 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-09-28T04:21:01.293 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-09-28T04:21:01.505 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-09-28T04:21:01.639 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-09-28T04:21:01.695 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-09-28T04:21:01.884 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-09-28T04:21:02.032 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-09-28T04:21:02.073 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-09-28T04:21:02.239 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-09-28T04:21:02.292 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-09-28T04:21:02.428 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/155 2023-09-28T04:21:02.533 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/155 2023-09-28T04:21:02.632 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-09-28T04:21:02.735 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/155 2023-09-28T04:21:02.870 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8. 29/155 2023-09-28T04:21:02.888 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/155 2023-09-28T04:21:03.035 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el 30/155 2023-09-28T04:21:03.086 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/155 2023-09-28T04:21:03.321 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/155 2023-09-28T04:21:03.322 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_6 31/155 2023-09-28T04:21:03.491 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/155 2023-09-28T04:21:03.722 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/155 2023-09-28T04:21:03.983 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/155 2023-09-28T04:21:04.282 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/155 2023-09-28T04:21:04.463 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-09-28T04:21:04.544 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/155 2023-09-28T04:21:04.811 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-09-28T04:21:04.944 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/155 2023-09-28T04:21:05.149 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-09-28T04:21:05.232 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/155 2023-09-28T04:21:05.380 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-09-28T04:21:05.423 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/155 2023-09-28T04:21:05.723 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/155 2023-09-28T04:21:05.973 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/155 2023-09-28T04:21:06.381 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/155 2023-09-28T04:21:06.693 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/155 2023-09-28T04:21:06.891 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/155 2023-09-28T04:21:07.162 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/155 2023-09-28T04:21:07.461 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/155 2023-09-28T04:21:07.465 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-09-28T04:21:07.984 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-09-28T04:21:08.180 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-09-28T04:21:08.358 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-09-28T04:21:08.547 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/155 2023-09-28T04:21:08.559 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 39/155 2023-09-28T04:21:08.769 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 40/155 2023-09-28T04:21:08.965 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/155 2023-09-28T04:21:08.977 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_6 41/155 2023-09-28T04:21:09.176 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/155 2023-09-28T04:21:09.205 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/155 2023-09-28T04:21:09.356 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/155 2023-09-28T04:21:09.422 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/155 2023-09-28T04:21:09.604 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/155 2023-09-28T04:21:09.703 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/155 2023-09-28T04:21:09.753 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/155 2023-09-28T04:21:09.887 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/155 2023-09-28T04:21:09.983 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/155 2023-09-28T04:21:09.989 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/155 2023-09-28T04:21:10.126 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/155 2023-09-28T04:21:10.250 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/155 2023-09-28T04:21:10.295 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-09-28T04:21:10.475 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-09-28T04:21:10.795 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/155 2023-09-28T04:21:10.925 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-09-28T04:21:11.019 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/155 2023-09-28T04:21:11.199 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/155 2023-09-28T04:21:11.205 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/155 2023-09-28T04:21:11.233 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/155 2023-09-28T04:21:11.386 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/155 2023-09-28T04:21:11.427 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-09-28T04:21:11.711 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-09-28T04:21:11.726 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/155 2023-09-28T04:21:11.937 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-09-28T04:21:11.951 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/155 2023-09-28T04:21:12.118 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/155 2023-09-28T04:21:12.125 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-09-28T04:21:12.292 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-09-28T04:21:12.336 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/155 2023-09-28T04:21:12.501 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-09-28T04:21:12.615 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/155 2023-09-28T04:21:12.686 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-09-28T04:21:12.832 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/155 2023-09-28T04:21:12.902 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/155 2023-09-28T04:21:13.095 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/155 2023-09-28T04:21:13.099 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/155 2023-09-28T04:21:13.236 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/155 2023-09-28T04:21:13.331 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/155 2023-09-28T04:21:13.460 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/155 2023-09-28T04:21:13.522 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/155 2023-09-28T04:21:13.645 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/155 2023-09-28T04:21:13.831 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/155 2023-09-28T04:21:14.047 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/155 2023-09-28T04:21:14.306 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/155 2023-09-28T04:21:14.552 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/155 2023-09-28T04:21:14.745 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/155 2023-09-28T04:21:15.063 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/155 2023-09-28T04:21:15.322 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/155 2023-09-28T04:21:15.541 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/155 2023-09-28T04:21:15.746 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/155 2023-09-28T04:21:16.014 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/155 2023-09-28T04:21:16.409 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/155 2023-09-28T04:21:16.710 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/155 2023-09-28T04:21:16.820 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 97/155 2023-09-28T04:21:16.884 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/155 2023-09-28T04:21:17.088 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 97/155 2023-09-28T04:21:17.122 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/155 2023-09-28T04:21:17.371 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/155 2023-09-28T04:21:17.646 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 97/155 2023-09-28T04:21:17.994 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 98/155 2023-09-28T04:21:18.097 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 98/155 2023-09-28T04:21:18.288 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 99/155 2023-09-28T04:21:18.706 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/155 2023-09-28T04:21:19.119 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/155 2023-09-28T04:21:19.346 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/155 2023-09-28T04:21:19.563 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/155 2023-09-28T04:21:19.918 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/155 2023-09-28T04:21:20.217 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/155 2023-09-28T04:21:20.473 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/155 2023-09-28T04:21:20.715 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-09-28T04:21:21.099 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/155 2023-09-28T04:21:21.383 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/155 2023-09-28T04:21:21.530 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/155 2023-09-28T04:21:21.705 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/155 2023-09-28T04:21:22.047 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/155 2023-09-28T04:21:22.303 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/155 2023-09-28T04:21:22.442 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/155 2023-09-28T04:21:22.643 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/155 2023-09-28T04:21:22.829 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/155 2023-09-28T04:21:23.082 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/155 2023-09-28T04:21:23.319 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/155 2023-09-28T04:21:23.520 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/155 2023-09-28T04:21:23.652 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/155 2023-09-28T04:21:26.589 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 97/155 2023-09-28T04:21:26.860 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 97/155 2023-09-28T04:21:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 97/155 2023-09-28T04:21:28.349 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 98/155 2023-09-28T04:21:28.550 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 98/155 2023-09-28T04:21:28.768 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 99/155 2023-09-28T04:21:36.849 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 99/155 2023-09-28T04:21:36.849 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2023-09-28T04:21:36.849 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2023-09-28T04:21:36.850 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /dev 2023-09-28T04:21:36.850 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /run 2023-09-28T04:21:36.850 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2023-09-28T04:21:36.850 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2023-09-28T04:21:36.850 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2023-09-28T04:21:36.850 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2023-09-28T04:21:36.850 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /dev 2023-09-28T04:21:36.850 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:21:37.302 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 100/155 2023-09-28T04:21:38.769 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 100/155 2023-09-28T04:21:39.032 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 101/155 2023-09-28T04:21:39.252 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 101/155 2023-09-28T04:21:39.502 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 102/155 2023-09-28T04:21:39.890 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 102/155 2023-09-28T04:21:40.118 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 103/155 2023-09-28T04:21:40.141 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 103/155 2023-09-28T04:21:40.391 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-09-28T04:21:40.629 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-09-28T04:21:40.768 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-09-28T04:21:40.887 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-09-28T04:21:41.138 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-09-28T04:21:41.368 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.1-8.el8.noarch 108/155 2023-09-28T04:21:41.899 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 109/155 2023-09-28T04:21:42.126 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 109/155 2023-09-28T04:21:42.282 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.e 110/155 2023-09-28T04:21:42.471 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd. 111/155 2023-09-28T04:21:42.742 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 112/155 2023-09-28T04:21:42.958 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 112/155 2023-09-28T04:21:43.206 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 113/155 2023-09-28T04:21:44.169 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 113/155 2023-09-28T04:21:44.392 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 114/155 2023-09-28T04:21:44.484 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 114/155 2023-09-28T04:21:44.910 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el 115/155 2023-09-28T04:21:45.173 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 116/155 2023-09-28T04:21:45.209 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 116/155 2023-09-28T04:21:45.417 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 117/155 2023-09-28T04:21:45.428 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 117/155 2023-09-28T04:21:45.612 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 118/155 2023-09-28T04:21:45.800 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-09-28T04:21:49.301 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 99/155 2023-09-28T04:21:49.301 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2023-09-28T04:21:49.301 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2023-09-28T04:21:49.302 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-09-28T04:21:49.302 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /run 2023-09-28T04:21:49.302 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2023-09-28T04:21:49.302 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2023-09-28T04:21:49.302 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2023-09-28T04:21:49.302 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2023-09-28T04:21:49.302 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-09-28T04:21:49.302 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:21:49.723 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 100/155 2023-09-28T04:21:50.662 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-09-28T04:21:51.335 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 100/155 2023-09-28T04:21:51.579 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 101/155 2023-09-28T04:21:51.846 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 101/155 2023-09-28T04:21:52.090 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 102/155 2023-09-28T04:21:52.421 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 120/155 2023-09-28T04:21:52.541 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 102/155 2023-09-28T04:21:52.646 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 121/155 2023-09-28T04:21:52.781 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 103/155 2023-09-28T04:21:52.791 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 121/155 2023-09-28T04:21:52.830 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 103/155 2023-09-28T04:21:53.000 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1161.g471b6 122/155 2023-09-28T04:21:53.022 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-09-28T04:21:53.041 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1161.g471b6 122/155 2023-09-28T04:21:53.260 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-09-28T04:21:53.278 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 123/155 2023-09-28T04:21:53.414 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-09-28T04:21:53.503 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-09-28T04:21:53.625 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 123/155 2023-09-28T04:21:53.834 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-09-28T04:21:53.866 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 124/155 2023-09-28T04:21:53.960 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 124/155 2023-09-28T04:21:54.114 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : automake-1.16.1-8.el8.noarch 108/155 2023-09-28T04:21:54.760 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 109/155 2023-09-28T04:21:54.862 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 125/155 2023-09-28T04:21:55.006 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 109/155 2023-09-28T04:21:55.137 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-09-28T04:21:55.138 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.e 110/155 2023-09-28T04:21:55.354 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/155 2023-09-28T04:21:55.381 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd. 111/155 2023-09-28T04:21:55.585 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 128/155 2023-09-28T04:21:55.622 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 112/155 2023-09-28T04:21:55.744 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-09-28T04:21:55.877 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 112/155 2023-09-28T04:21:56.032 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_ 130/155 2023-09-28T04:21:56.128 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 113/155 2023-09-28T04:21:56.278 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-09-28T04:21:56.516 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 132/155 2023-09-28T04:21:56.765 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 133/155 2023-09-28T04:21:57.123 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 134/155 2023-09-28T04:21:57.242 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 113/155 2023-09-28T04:21:57.392 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 135/155 2023-09-28T04:21:57.455 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 114/155 2023-09-28T04:21:57.581 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 114/155 2023-09-28T04:21:57.590 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-09-28T04:21:57.609 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-09-28T04:21:57.786 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-09-28T04:21:58.043 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el 115/155 2023-09-28T04:21:58.048 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-09-28T04:21:58.128 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-09-28T04:21:58.278 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 116/155 2023-09-28T04:21:58.342 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 116/155 2023-09-28T04:21:58.348 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-09-28T04:21:58.361 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-09-28T04:21:58.513 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 117/155 2023-09-28T04:21:58.540 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 117/155 2023-09-28T04:21:58.575 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-09-28T04:21:58.755 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-09-28T04:21:58.784 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 118/155 2023-09-28T04:21:58.894 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-09-28T04:21:58.894 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-09-28T04:21:58.937 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-09-28T04:21:59.126 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-09-28T04:21:59.126 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-09-28T04:21:59.375 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-09-28T04:21:59.381 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-09-28T04:21:59.493 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-09-28T04:21:59.493 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-09-28T04:21:59.788 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-09-28T04:21:59.991 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-09-28T04:22:00.175 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-09-28T04:22:00.375 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-09-28T04:22:00.375 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-09-28T04:22:00.600 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-09-28T04:22:00.601 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-09-28T04:22:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-09-28T04:22:00.809 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-09-28T04:22:01.025 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-09-28T04:22:01.026 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-09-28T04:22:01.193 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-09-28T04:22:01.194 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-09-28T04:22:01.417 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-09-28T04:22:01.614 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-09-28T04:22:02.157 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-09-28T04:22:02.157 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 1/155 2023-09-28T04:22:02.157 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 2/155 2023-09-28T04:22:02.157 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 3/155 2023-09-28T04:22:02.157 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 4/155 2023-09-28T04:22:02.157 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1161.g471b6 5/155 2023-09-28T04:22:02.157 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/155 2023-09-28T04:22:02.157 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 7/155 2023-09-28T04:22:02.158 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 8/155 2023-09-28T04:22:02.158 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 9/155 2023-09-28T04:22:02.158 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/155 2023-09-28T04:22:02.158 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 11/155 2023-09-28T04:22:02.158 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 12/155 2023-09-28T04:22:02.158 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/155 2023-09-28T04:22:02.158 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_ 14/155 2023-09-28T04:22:02.158 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 15/155 2023-09-28T04:22:02.158 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 16/155 2023-09-28T04:22:02.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_6 17/155 2023-09-28T04:22:02.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 18/155 2023-09-28T04:22:02.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 19/155 2023-09-28T04:22:02.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el 20/155 2023-09-28T04:22:02.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8. 21/155 2023-09-28T04:22:02.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_6 22/155 2023-09-28T04:22:02.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 23/155 2023-09-28T04:22:02.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 24/155 2023-09-28T04:22:02.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 25/155 2023-09-28T04:22:02.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 26/155 2023-09-28T04:22:02.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 27/155 2023-09-28T04:22:02.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 28/155 2023-09-28T04:22:02.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd. 29/155 2023-09-28T04:22:02.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 30/155 2023-09-28T04:22:02.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 31/155 2023-09-28T04:22:02.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 32/155 2023-09-28T04:22:02.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el 33/155 2023-09-28T04:22:02.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 34/155 2023-09-28T04:22:02.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.e 35/155 2023-09-28T04:22:02.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 36/155 2023-09-28T04:22:02.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 37/155 2023-09-28T04:22:02.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 38/155 2023-09-28T04:22:02.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/155 2023-09-28T04:22:02.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/155 2023-09-28T04:22:02.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/155 2023-09-28T04:22:02.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : jq-1.6-7.el8.x86_64 42/155 2023-09-28T04:22:02.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 43/155 2023-09-28T04:22:02.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 44/155 2023-09-28T04:22:02.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 45/155 2023-09-28T04:22:02.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 46/155 2023-09-28T04:22:02.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 47/155 2023-09-28T04:22:02.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 48/155 2023-09-28T04:22:02.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 49/155 2023-09-28T04:22:02.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 50/155 2023-09-28T04:22:02.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 51/155 2023-09-28T04:22:02.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 52/155 2023-09-28T04:22:02.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 53/155 2023-09-28T04:22:02.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 54/155 2023-09-28T04:22:02.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 55/155 2023-09-28T04:22:02.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 56/155 2023-09-28T04:22:02.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 57/155 2023-09-28T04:22:02.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 58/155 2023-09-28T04:22:02.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 59/155 2023-09-28T04:22:02.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 60/155 2023-09-28T04:22:02.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 61/155 2023-09-28T04:22:02.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 62/155 2023-09-28T04:22:02.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 63/155 2023-09-28T04:22:02.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 64/155 2023-09-28T04:22:02.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 65/155 2023-09-28T04:22:02.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 66/155 2023-09-28T04:22:02.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 67/155 2023-09-28T04:22:02.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 68/155 2023-09-28T04:22:02.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 69/155 2023-09-28T04:22:02.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 70/155 2023-09-28T04:22:02.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 71/155 2023-09-28T04:22:02.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 72/155 2023-09-28T04:22:02.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 73/155 2023-09-28T04:22:02.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 74/155 2023-09-28T04:22:02.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 75/155 2023-09-28T04:22:02.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 76/155 2023-09-28T04:22:02.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 77/155 2023-09-28T04:22:02.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 78/155 2023-09-28T04:22:02.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/155 2023-09-28T04:22:02.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 80/155 2023-09-28T04:22:02.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 81/155 2023-09-28T04:22:02.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 82/155 2023-09-28T04:22:02.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-09-28T04:22:02.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 84/155 2023-09-28T04:22:02.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 85/155 2023-09-28T04:22:02.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 86/155 2023-09-28T04:22:02.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 87/155 2023-09-28T04:22:02.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/155 2023-09-28T04:22:02.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 89/155 2023-09-28T04:22:02.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/155 2023-09-28T04:22:02.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 91/155 2023-09-28T04:22:02.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 92/155 2023-09-28T04:22:02.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-09-28T04:22:02.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-09-28T04:22:02.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 95/155 2023-09-28T04:22:02.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-09-28T04:22:02.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-09-28T04:22:02.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-09-28T04:22:02.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-09-28T04:22:02.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-09-28T04:22:02.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-09-28T04:22:02.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 102/155 2023-09-28T04:22:02.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 103/155 2023-09-28T04:22:02.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 104/155 2023-09-28T04:22:02.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 105/155 2023-09-28T04:22:02.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 106/155 2023-09-28T04:22:02.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 107/155 2023-09-28T04:22:02.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 108/155 2023-09-28T04:22:02.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-09-28T04:22:02.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-09-28T04:22:02.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 111/155 2023-09-28T04:22:02.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 112/155 2023-09-28T04:22:02.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 113/155 2023-09-28T04:22:02.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 114/155 2023-09-28T04:22:02.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 115/155 2023-09-28T04:22:02.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 116/155 2023-09-28T04:22:02.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 117/155 2023-09-28T04:22:02.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 118/155 2023-09-28T04:22:02.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/155 2023-09-28T04:22:02.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/155 2023-09-28T04:22:02.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/155 2023-09-28T04:22:02.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 122/155 2023-09-28T04:22:02.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 123/155 2023-09-28T04:22:02.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 124/155 2023-09-28T04:22:02.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-09-28T04:22:02.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 126/155 2023-09-28T04:22:02.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-09-28T04:22:02.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 128/155 2023-09-28T04:22:02.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-09-28T04:22:02.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 130/155 2023-09-28T04:22:02.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-09-28T04:22:02.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 132/155 2023-09-28T04:22:02.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-09-28T04:22:02.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 134/155 2023-09-28T04:22:02.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-09-28T04:22:02.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 136/155 2023-09-28T04:22:02.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-09-28T04:22:02.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 138/155 2023-09-28T04:22:02.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-09-28T04:22:02.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 140/155 2023-09-28T04:22:02.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-09-28T04:22:02.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/155 2023-09-28T04:22:02.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-09-28T04:22:02.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/155 2023-09-28T04:22:02.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-09-28T04:22:02.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/155 2023-09-28T04:22:02.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-09-28T04:22:02.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/155 2023-09-28T04:22:02.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-09-28T04:22:02.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/155 2023-09-28T04:22:02.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-09-28T04:22:02.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-09-28T04:22:02.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-09-28T04:22:02.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-09-28T04:22:04.247 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-09-28T04:22:04.387 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-09-28T04:22:04.387 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:04.387 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2023-09-28T04:22:04.387 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-28T04:22:04.387 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-28T04:22:04.387 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-28T04:22:04.388 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-28T04:22:04.388 INFO:teuthology.orchestra.run.smithi174.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-28T04:22:04.388 INFO:teuthology.orchestra.run.smithi174.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-28T04:22:04.388 INFO:teuthology.orchestra.run.smithi174.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-28T04:22:04.388 INFO:teuthology.orchestra.run.smithi174.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-28T04:22:04.388 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.388 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.388 INFO:teuthology.orchestra.run.smithi174.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-28T04:22:04.388 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-28T04:22:04.388 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-28T04:22:04.388 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-28T04:22:04.389 INFO:teuthology.orchestra.run.smithi174.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-09-28T04:22:04.389 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-09-28T04:22:04.389 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2023-09-28T04:22:04.389 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.1-8.el8.noarch 2023-09-28T04:22:04.389 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.0.4-10.el8.x86_64 2023-09-28T04:22:04.389 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.389 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.389 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.389 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.389 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:04.389 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.390 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.390 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.390 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:04.390 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:04.390 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:04.390 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:04.390 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:04.390 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.390 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.390 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:04.390 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.391 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.391 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.391 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:04.391 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:04.391 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.391 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:04.391 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-28T04:22:04.391 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.1-9.el8.x86_64 2023-09-28T04:22:04.391 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-28T04:22:04.391 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-28T04:22:04.391 INFO:teuthology.orchestra.run.smithi174.stdout: jq-1.6-7.el8.x86_64 2023-09-28T04:22:04.392 INFO:teuthology.orchestra.run.smithi174.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-28T04:22:04.392 INFO:teuthology.orchestra.run.smithi174.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-28T04:22:04.392 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-28T04:22:04.392 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.392 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.392 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.392 INFO:teuthology.orchestra.run.smithi174.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-28T04:22:04.392 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-28T04:22:04.392 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-28T04:22:04.392 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-28T04:22:04.392 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-28T04:22:04.392 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.393 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.393 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-28T04:22:04.393 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.393 INFO:teuthology.orchestra.run.smithi174.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-28T04:22:04.393 INFO:teuthology.orchestra.run.smithi174.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-28T04:22:04.393 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-28T04:22:04.393 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-28T04:22:04.393 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-09-28T04:22:04.393 INFO:teuthology.orchestra.run.smithi174.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-28T04:22:04.393 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-28T04:22:04.394 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-28T04:22:04.394 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-28T04:22:04.394 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-28T04:22:04.394 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-28T04:22:04.394 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-28T04:22:04.394 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-28T04:22:04.394 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-28T04:22:04.394 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-28T04:22:04.394 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-28T04:22:04.394 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-28T04:22:04.394 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-28T04:22:04.395 INFO:teuthology.orchestra.run.smithi174.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-28T04:22:04.395 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-28T04:22:04.395 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.395 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.395 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.395 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-28T04:22:04.395 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-28T04:22:04.395 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-28T04:22:04.395 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-28T04:22:04.395 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-28T04:22:04.395 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-28T04:22:04.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-28T04:22:04.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-28T04:22:04.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-28T04:22:04.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-28T04:22:04.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-28T04:22:04.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-28T04:22:04.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-28T04:22:04.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-28T04:22:04.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-28T04:22:04.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-28T04:22:04.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-28T04:22:04.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-28T04:22:04.397 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-28T04:22:04.397 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-28T04:22:04.397 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-28T04:22:04.397 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-28T04:22:04.397 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-2.6-1.el8.noarch 2023-09-28T04:22:04.397 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-28T04:22:04.397 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-28T04:22:04.397 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-28T04:22:04.397 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-28T04:22:04.397 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-28T04:22:04.397 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-28T04:22:04.397 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.398 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.398 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-28T04:22:04.398 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-28T04:22:04.398 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.398 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-28T04:22:04.398 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-28T04:22:04.398 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-28T04:22:04.398 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-28T04:22:04.398 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-28T04:22:04.398 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-28T04:22:04.398 INFO:teuthology.orchestra.run.smithi174.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-28T04:22:04.399 INFO:teuthology.orchestra.run.smithi174.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-28T04:22:04.399 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-28T04:22:04.399 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-28T04:22:04.399 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-28T04:22:04.399 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-28T04:22:04.399 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-28T04:22:04.399 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.399 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.399 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:04.399 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-28T04:22:04.399 INFO:teuthology.orchestra.run.smithi174.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-28T04:22:04.399 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-09-28T04:22:04.400 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-28T04:22:04.400 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-28T04:22:04.400 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:04.400 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2023-09-28T04:22:04.645 DEBUG:teuthology.parallel:result is None 2023-09-28T04:22:06.155 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 120/155 2023-09-28T04:22:06.360 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 121/155 2023-09-28T04:22:06.475 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 121/155 2023-09-28T04:22:06.679 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1161.g471b6 122/155 2023-09-28T04:22:06.748 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1161.g471b6 122/155 2023-09-28T04:22:06.981 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 123/155 2023-09-28T04:22:07.391 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 123/155 2023-09-28T04:22:07.579 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 124/155 2023-09-28T04:22:07.706 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 124/155 2023-09-28T04:22:08.940 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 125/155 2023-09-28T04:22:09.283 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-09-28T04:22:09.473 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/155 2023-09-28T04:22:09.692 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 128/155 2023-09-28T04:22:09.865 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-09-28T04:22:10.134 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_ 130/155 2023-09-28T04:22:10.383 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-09-28T04:22:10.570 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 132/155 2023-09-28T04:22:10.853 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 133/155 2023-09-28T04:22:11.182 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 134/155 2023-09-28T04:22:11.472 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 135/155 2023-09-28T04:22:11.669 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-09-28T04:22:11.698 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-09-28T04:22:11.878 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-09-28T04:22:12.110 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-09-28T04:22:12.230 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-09-28T04:22:12.494 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-09-28T04:22:12.522 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-09-28T04:22:12.729 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-09-28T04:22:12.935 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-09-28T04:22:13.075 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-09-28T04:22:13.075 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-09-28T04:22:13.357 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-09-28T04:22:13.357 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-09-28T04:22:13.605 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-09-28T04:22:13.622 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-09-28T04:22:13.759 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-09-28T04:22:13.759 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-09-28T04:22:14.011 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-09-28T04:22:14.215 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-09-28T04:22:14.371 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-09-28T04:22:14.621 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-09-28T04:22:14.621 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-09-28T04:22:14.838 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-09-28T04:22:14.839 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-09-28T04:22:15.072 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-09-28T04:22:15.072 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-09-28T04:22:15.297 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-09-28T04:22:15.297 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-09-28T04:22:15.555 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-09-28T04:22:15.555 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-09-28T04:22:15.747 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-09-28T04:22:15.970 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-09-28T04:22:16.176 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-09-28T04:22:16.176 INFO:teuthology.orchestra.run.smithi118.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-09-28T04:22:16.176 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:16.905 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 1/155 2023-09-28T04:22:16.906 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 2/155 2023-09-28T04:22:16.906 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 3/155 2023-09-28T04:22:16.906 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 4/155 2023-09-28T04:22:16.906 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1161.g471b6 5/155 2023-09-28T04:22:16.906 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/155 2023-09-28T04:22:16.906 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 7/155 2023-09-28T04:22:16.906 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 8/155 2023-09-28T04:22:16.906 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 9/155 2023-09-28T04:22:16.906 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/155 2023-09-28T04:22:16.906 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 11/155 2023-09-28T04:22:16.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 12/155 2023-09-28T04:22:16.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/155 2023-09-28T04:22:16.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_ 14/155 2023-09-28T04:22:16.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 15/155 2023-09-28T04:22:16.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 16/155 2023-09-28T04:22:16.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_6 17/155 2023-09-28T04:22:16.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 18/155 2023-09-28T04:22:16.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 19/155 2023-09-28T04:22:16.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el 20/155 2023-09-28T04:22:16.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8. 21/155 2023-09-28T04:22:16.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_6 22/155 2023-09-28T04:22:16.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 23/155 2023-09-28T04:22:16.907 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 24/155 2023-09-28T04:22:16.908 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 25/155 2023-09-28T04:22:16.908 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 26/155 2023-09-28T04:22:16.908 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 27/155 2023-09-28T04:22:16.908 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 28/155 2023-09-28T04:22:16.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd. 29/155 2023-09-28T04:22:16.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 30/155 2023-09-28T04:22:16.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 31/155 2023-09-28T04:22:16.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 32/155 2023-09-28T04:22:16.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el 33/155 2023-09-28T04:22:16.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 34/155 2023-09-28T04:22:16.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.e 35/155 2023-09-28T04:22:16.918 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 36/155 2023-09-28T04:22:16.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 37/155 2023-09-28T04:22:16.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 38/155 2023-09-28T04:22:16.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/155 2023-09-28T04:22:16.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/155 2023-09-28T04:22:16.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/155 2023-09-28T04:22:16.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jq-1.6-7.el8.x86_64 42/155 2023-09-28T04:22:16.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 43/155 2023-09-28T04:22:16.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 44/155 2023-09-28T04:22:16.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 45/155 2023-09-28T04:22:16.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 46/155 2023-09-28T04:22:16.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 47/155 2023-09-28T04:22:16.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 48/155 2023-09-28T04:22:16.919 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 49/155 2023-09-28T04:22:16.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 50/155 2023-09-28T04:22:16.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 51/155 2023-09-28T04:22:16.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 52/155 2023-09-28T04:22:16.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 53/155 2023-09-28T04:22:16.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 54/155 2023-09-28T04:22:16.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 55/155 2023-09-28T04:22:16.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 56/155 2023-09-28T04:22:16.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 57/155 2023-09-28T04:22:16.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 58/155 2023-09-28T04:22:16.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 59/155 2023-09-28T04:22:16.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 60/155 2023-09-28T04:22:16.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 61/155 2023-09-28T04:22:16.920 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 62/155 2023-09-28T04:22:16.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 63/155 2023-09-28T04:22:16.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 64/155 2023-09-28T04:22:16.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 65/155 2023-09-28T04:22:16.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 66/155 2023-09-28T04:22:16.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 67/155 2023-09-28T04:22:16.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 68/155 2023-09-28T04:22:16.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 69/155 2023-09-28T04:22:16.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 70/155 2023-09-28T04:22:16.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 71/155 2023-09-28T04:22:16.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 72/155 2023-09-28T04:22:16.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 73/155 2023-09-28T04:22:16.921 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 74/155 2023-09-28T04:22:16.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 75/155 2023-09-28T04:22:16.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 76/155 2023-09-28T04:22:16.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 77/155 2023-09-28T04:22:16.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 78/155 2023-09-28T04:22:16.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/155 2023-09-28T04:22:16.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 80/155 2023-09-28T04:22:16.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 81/155 2023-09-28T04:22:16.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 82/155 2023-09-28T04:22:16.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-09-28T04:22:16.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 84/155 2023-09-28T04:22:16.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 85/155 2023-09-28T04:22:16.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 86/155 2023-09-28T04:22:16.922 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 87/155 2023-09-28T04:22:16.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/155 2023-09-28T04:22:16.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 89/155 2023-09-28T04:22:16.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/155 2023-09-28T04:22:16.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 91/155 2023-09-28T04:22:16.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 92/155 2023-09-28T04:22:16.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-09-28T04:22:16.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-09-28T04:22:16.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 95/155 2023-09-28T04:22:16.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-09-28T04:22:16.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-09-28T04:22:16.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-09-28T04:22:16.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-09-28T04:22:16.923 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-09-28T04:22:16.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-09-28T04:22:16.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 102/155 2023-09-28T04:22:16.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 103/155 2023-09-28T04:22:16.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 104/155 2023-09-28T04:22:16.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 105/155 2023-09-28T04:22:16.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 106/155 2023-09-28T04:22:16.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 107/155 2023-09-28T04:22:16.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 108/155 2023-09-28T04:22:16.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-09-28T04:22:16.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-09-28T04:22:16.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 111/155 2023-09-28T04:22:16.924 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 112/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 113/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 114/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 115/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 116/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 117/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 118/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 122/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 123/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 124/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-09-28T04:22:16.925 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 126/155 2023-09-28T04:22:16.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-09-28T04:22:16.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 128/155 2023-09-28T04:22:16.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-09-28T04:22:16.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 130/155 2023-09-28T04:22:16.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-09-28T04:22:16.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 132/155 2023-09-28T04:22:16.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-09-28T04:22:16.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 134/155 2023-09-28T04:22:16.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-09-28T04:22:16.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 136/155 2023-09-28T04:22:16.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-09-28T04:22:16.926 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 138/155 2023-09-28T04:22:16.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-09-28T04:22:16.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 140/155 2023-09-28T04:22:16.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-09-28T04:22:16.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/155 2023-09-28T04:22:16.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-09-28T04:22:16.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/155 2023-09-28T04:22:16.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-09-28T04:22:16.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/155 2023-09-28T04:22:16.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-09-28T04:22:16.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/155 2023-09-28T04:22:16.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-09-28T04:22:16.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/155 2023-09-28T04:22:16.927 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-09-28T04:22:16.928 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-09-28T04:22:16.928 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-09-28T04:22:16.928 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-09-28T04:22:19.107 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-09-28T04:22:19.107 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:19.107 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2023-09-28T04:22:19.107 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-28T04:22:19.107 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-28T04:22:19.107 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-28T04:22:19.107 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-28T04:22:19.107 INFO:teuthology.orchestra.run.smithi118.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-28T04:22:19.108 INFO:teuthology.orchestra.run.smithi118.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-28T04:22:19.108 INFO:teuthology.orchestra.run.smithi118.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-28T04:22:19.108 INFO:teuthology.orchestra.run.smithi118.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-28T04:22:19.108 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.108 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.108 INFO:teuthology.orchestra.run.smithi118.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-28T04:22:19.108 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-28T04:22:19.108 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-28T04:22:19.108 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-28T04:22:19.108 INFO:teuthology.orchestra.run.smithi118.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-09-28T04:22:19.108 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-09-28T04:22:19.109 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2023-09-28T04:22:19.109 INFO:teuthology.orchestra.run.smithi118.stdout: automake-1.16.1-8.el8.noarch 2023-09-28T04:22:19.109 INFO:teuthology.orchestra.run.smithi118.stdout: bison-3.0.4-10.el8.x86_64 2023-09-28T04:22:19.109 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.109 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.109 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.109 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.109 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:19.109 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.109 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.109 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.109 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:19.110 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:19.110 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:19.110 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:19.110 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:19.110 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.110 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.110 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:19.110 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.110 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.110 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.110 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:19.111 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:19.111 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.111 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T04:22:19.111 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-28T04:22:19.111 INFO:teuthology.orchestra.run.smithi118.stdout: flex-2.6.1-9.el8.x86_64 2023-09-28T04:22:19.111 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-28T04:22:19.111 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-28T04:22:19.111 INFO:teuthology.orchestra.run.smithi118.stdout: jq-1.6-7.el8.x86_64 2023-09-28T04:22:19.111 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-28T04:22:19.111 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-28T04:22:19.112 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-28T04:22:19.112 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.112 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.112 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.112 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-28T04:22:19.112 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-28T04:22:19.112 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-28T04:22:19.112 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-28T04:22:19.112 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-28T04:22:19.113 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.113 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.113 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-28T04:22:19.113 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.113 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-28T04:22:19.113 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-28T04:22:19.113 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-28T04:22:19.114 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-28T04:22:19.114 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-09-28T04:22:19.114 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-28T04:22:19.114 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-28T04:22:19.114 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-28T04:22:19.114 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-28T04:22:19.115 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-28T04:22:19.115 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-28T04:22:19.115 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-28T04:22:19.115 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-28T04:22:19.115 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-28T04:22:19.115 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-28T04:22:19.116 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-28T04:22:19.116 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-28T04:22:19.116 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-28T04:22:19.116 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-28T04:22:19.116 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-28T04:22:19.116 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.117 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.117 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.117 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-28T04:22:19.117 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-28T04:22:19.117 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-28T04:22:19.117 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-28T04:22:19.118 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-28T04:22:19.118 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-28T04:22:19.118 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-28T04:22:19.118 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-28T04:22:19.118 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-28T04:22:19.118 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-28T04:22:19.119 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-28T04:22:19.119 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-28T04:22:19.119 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-28T04:22:19.119 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-28T04:22:19.119 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-28T04:22:19.119 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-28T04:22:19.120 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-28T04:22:19.120 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-28T04:22:19.120 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-28T04:22:19.120 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-28T04:22:19.120 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-28T04:22:19.120 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-28T04:22:19.121 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-2.6-1.el8.noarch 2023-09-28T04:22:19.121 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-28T04:22:19.121 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-28T04:22:19.121 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-28T04:22:19.121 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-28T04:22:19.121 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-28T04:22:19.122 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-28T04:22:19.122 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.122 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.122 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-28T04:22:19.122 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-28T04:22:19.122 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.122 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-28T04:22:19.123 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-28T04:22:19.123 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-28T04:22:19.123 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-28T04:22:19.123 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-28T04:22:19.123 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-28T04:22:19.123 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-28T04:22:19.123 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-28T04:22:19.124 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-28T04:22:19.124 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-28T04:22:19.124 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-28T04:22:19.124 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-28T04:22:19.124 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-28T04:22:19.124 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.124 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.124 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T04:22:19.124 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-28T04:22:19.124 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-28T04:22:19.124 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-09-28T04:22:19.124 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-28T04:22:19.125 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-28T04:22:19.125 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:19.125 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-09-28T04:22:19.391 DEBUG:teuthology.parallel:result is None 2023-09-28T04:22:19.392 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T04:22:19.534 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-28T04:22:19.590 INFO:teuthology.orchestra.run.smithi118.stdout:17.2.6-1161.g471b6dfd.el8 2023-09-28T04:22:19.591 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1161.g471b6dfd.el8 2023-09-28T04:22:19.591 INFO:teuthology.task.install:The correct ceph version 17.2.6-1161.g471b6dfd is installed. 2023-09-28T04:22:19.591 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T04:22:19.731 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-28T04:22:19.761 INFO:teuthology.orchestra.run.smithi174.stdout:17.2.6-1161.g471b6dfd.el8 2023-09-28T04:22:19.761 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1161.g471b6dfd.el8 2023-09-28T04:22:19.761 INFO:teuthology.task.install:The correct ceph version 17.2.6-1161.g471b6dfd is installed. 2023-09-28T04:22:19.761 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-28T04:22:19.762 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:19.762 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-28T04:22:19.835 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:19.835 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-28T04:22:19.872 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-28T04:22:19.872 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:19.872 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2023-09-28T04:22:19.946 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-28T04:22:20.057 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:20.057 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2023-09-28T04:22:20.090 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-28T04:22:20.161 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-28T04:22:20.161 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:20.161 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-28T04:22:20.233 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-28T04:22:20.345 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:20.345 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-28T04:22:20.378 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-28T04:22:20.452 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-28T04:22:20.452 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:20.452 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2023-09-28T04:22:20.524 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-28T04:22:20.638 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:20.639 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2023-09-28T04:22:20.671 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-28T04:22:20.743 INFO:teuthology.run_tasks:Running task ceph... 2023-09-28T04:22:20.803 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-28T04:22:20.803 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2023-09-28T04:22:20.808 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2023-09-28T04:22:20.875 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-28T04:22:20.875 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-28T04:22:20.880 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-28T04:22:20.946 INFO:tasks.ceph:Creating extra log directories... 2023-09-28T04:22:20.946 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-28T04:22:20.951 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-28T04:22:21.024 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-28T04:22:21.024 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-28T04:22:21.025 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-28T04:22:21.025 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:21.025 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-28T04:22:21.074 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-28T04:22:21.288 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-28T04:22:21.359 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:21.359 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-28T04:22:21.379 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-28T04:22:21.495 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-28T04:22:21.530 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-28T04:22:21.530 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-28T04:22:21.530 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611', 'branch': 'wip-yuri-testing-2023-09-27-0906-quincy', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7403611', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-09-27-0906-quincy'}, 'ceph': {'cephfs': {'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-09-27-0906-quincy', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 3538, 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-09-27-0906-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28', 'targets': {'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEgkcbwfR7XZNPUcl8Ib/j/BLssG951PHYcBVnxPvirIsPyF0M5iGVpnESGHanAc2xAfzWwR76bDlWg7y/V7LTE=', 'smithi174.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIPrsYX5ysB2+tp7lWpx+f/U8mR/v1mV6w8mB0mI9ZYLfAI9MaFtRgE0T2pfWfkZ4YY469JtwKN0+4kGu2iMQwg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}}, {'ceph': None}, {'kclient': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-27_19:23:53', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-28T04:22:21.531 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-28T04:22:21.535 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-28T04:22:21.583 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2023-09-28T04:22:21.623 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2023-09-28T04:22:21.690 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:21.690 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2023-09-28T04:22:21.735 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-28T04:22:21.736 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2023-09-28T04:22:21.822 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-28T04:22:21.822 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T04:22:21.822 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-09-28T04:22:21.822 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T04:22:21.822 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T04:22:21.822 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-09-28 04:22:16.390056475 +0000 2023-09-28T04:22:21.822 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-09-28 04:18:33.394275498 +0000 2023-09-28T04:22:21.822 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-09-28 04:18:33.394275498 +0000 2023-09-28T04:22:21.822 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2023-09-28 04:18:33.371275982 +0000 2023-09-28T04:22:21.823 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-28T04:22:21.889 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-09-28T04:22:21.890 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-09-28T04:22:21.890 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000176461 s, 2.9 MB/s 2023-09-28T04:22:21.892 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-28T04:22:21.941 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2023-09-28T04:22:21.990 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-28T04:22:21.990 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T04:22:21.991 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-09-28T04:22:21.991 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T04:22:21.991 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T04:22:21.991 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-09-28 04:22:16.390056475 +0000 2023-09-28T04:22:21.991 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-09-28 04:18:34.200258531 +0000 2023-09-28T04:22:21.992 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-09-28 04:18:34.200258531 +0000 2023-09-28T04:22:21.992 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2023-09-28 04:18:34.178258994 +0000 2023-09-28T04:22:21.992 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-28T04:22:22.058 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-09-28T04:22:22.059 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-09-28T04:22:22.059 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.0001744 s, 2.9 MB/s 2023-09-28T04:22:22.060 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-28T04:22:22.107 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2023-09-28T04:22:22.151 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-28T04:22:22.151 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T04:22:22.151 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-09-28T04:22:22.151 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T04:22:22.151 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T04:22:22.151 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-09-28 04:22:16.390056475 +0000 2023-09-28T04:22:22.152 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-09-28 04:18:35.014241396 +0000 2023-09-28T04:22:22.152 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-09-28 04:18:35.014241396 +0000 2023-09-28T04:22:22.152 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2023-09-28 04:18:34.989241922 +0000 2023-09-28T04:22:22.152 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-28T04:22:22.257 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-09-28T04:22:22.257 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-09-28T04:22:22.257 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000172155 s, 3.0 MB/s 2023-09-28T04:22:22.259 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-28T04:22:22.306 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2023-09-28T04:22:22.392 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-28T04:22:22.393 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T04:22:22.393 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-09-28T04:22:22.393 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T04:22:22.393 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T04:22:22.393 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-09-28 04:22:16.390056475 +0000 2023-09-28T04:22:22.393 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-09-28 04:18:35.840224007 +0000 2023-09-28T04:22:22.393 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-09-28 04:18:35.840224007 +0000 2023-09-28T04:22:22.393 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2023-09-28 04:18:35.819224450 +0000 2023-09-28T04:22:22.394 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-28T04:22:22.499 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-09-28T04:22:22.499 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-09-28T04:22:22.499 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000177441 s, 2.9 MB/s 2023-09-28T04:22:22.501 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-28T04:22:22.548 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T04:22:22.548 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:22.548 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2023-09-28T04:22:22.569 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-28T04:22:22.569 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2023-09-28T04:22:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-28T04:22:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T04:22:22.628 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 398471 Links: 1 2023-09-28T04:22:22.628 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T04:22:22.628 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T04:22:22.628 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2023-09-28 04:22:01.828478393 +0000 2023-09-28T04:22:22.629 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2023-09-28 04:16:24.508897786 +0000 2023-09-28T04:22:22.629 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2023-09-28 04:16:24.508897786 +0000 2023-09-28T04:22:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2023-09-28T04:22:22.629 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-28T04:22:22.694 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2023-09-28T04:22:22.694 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2023-09-28T04:22:22.694 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.00022901 s, 2.2 MB/s 2023-09-28T04:22:22.695 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-28T04:22:22.755 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2023-09-28T04:22:22.814 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-28T04:22:22.814 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T04:22:22.815 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 400461 Links: 1 2023-09-28T04:22:22.815 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T04:22:22.815 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T04:22:22.815 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2023-09-28 04:22:01.828478393 +0000 2023-09-28T04:22:22.815 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2023-09-28 04:16:25.017890907 +0000 2023-09-28T04:22:22.815 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2023-09-28 04:16:25.017890907 +0000 2023-09-28T04:22:22.815 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2023-09-28T04:22:22.815 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-28T04:22:22.882 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2023-09-28T04:22:22.882 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2023-09-28T04:22:22.882 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000192046 s, 2.7 MB/s 2023-09-28T04:22:22.883 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-28T04:22:22.941 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2023-09-28T04:22:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-28T04:22:22.999 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T04:22:22.999 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 391965 Links: 1 2023-09-28T04:22:22.999 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T04:22:22.999 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T04:22:23.000 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2023-09-28 04:22:01.828478393 +0000 2023-09-28T04:22:23.000 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2023-09-28 04:16:25.521884094 +0000 2023-09-28T04:22:23.000 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2023-09-28 04:16:25.521884094 +0000 2023-09-28T04:22:23.000 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2023-09-28T04:22:23.000 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-28T04:22:23.064 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2023-09-28T04:22:23.064 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2023-09-28T04:22:23.065 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.00021526 s, 2.4 MB/s 2023-09-28T04:22:23.065 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-28T04:22:23.124 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2023-09-28T04:22:23.183 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-28T04:22:23.183 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T04:22:23.183 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 6h/6d Inode: 398701 Links: 1 2023-09-28T04:22:23.183 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T04:22:23.183 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T04:22:23.183 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2023-09-28 04:22:01.828478393 +0000 2023-09-28T04:22:23.183 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2023-09-28 04:16:26.009877499 +0000 2023-09-28T04:22:23.184 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2023-09-28 04:16:26.009877499 +0000 2023-09-28T04:22:23.184 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2023-09-28T04:22:23.184 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-28T04:22:23.249 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2023-09-28T04:22:23.249 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2023-09-28T04:22:23.249 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000212108 s, 2.4 MB/s 2023-09-28T04:22:23.250 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-28T04:22:23.308 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T04:22:23.309 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-28T04:22:23.309 INFO:tasks.ceph:Generating config... 2023-09-28T04:22:23.310 INFO:tasks.ceph:[client] client mount timeout = 600 2023-09-28T04:22:23.310 INFO:tasks.ceph:[client] debug client = 20 2023-09-28T04:22:23.310 INFO:tasks.ceph:[client] debug ms = 1 2023-09-28T04:22:23.310 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-09-28T04:22:23.310 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-09-28T04:22:23.311 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-09-28T04:22:23.311 INFO:tasks.ceph:[mds] debug mds = 20 2023-09-28T04:22:23.311 INFO:tasks.ceph:[mds] debug ms = 1 2023-09-28T04:22:23.311 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2023-09-28T04:22:23.311 INFO:tasks.ceph:[mds] mds bal merge size = 5 2023-09-28T04:22:23.311 INFO:tasks.ceph:[mds] mds bal split bits = 3 2023-09-28T04:22:23.311 INFO:tasks.ceph:[mds] mds bal split size = 100 2023-09-28T04:22:23.311 INFO:tasks.ceph:[mds] mds debug frag = True 2023-09-28T04:22:23.311 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-09-28T04:22:23.311 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2023-09-28T04:22:23.311 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-09-28T04:22:23.312 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-09-28T04:22:23.312 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2023-09-28T04:22:23.312 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-09-28T04:22:23.312 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-09-28T04:22:23.312 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-09-28T04:22:23.312 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-28T04:22:23.312 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-28T04:22:23.312 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-28T04:22:23.312 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-28T04:22:23.312 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-28T04:22:23.312 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-09-28T04:22:23.312 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-28T04:22:23.313 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-09-28T04:22:23.313 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-28T04:22:23.313 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-09-28T04:22:23.313 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-09-28T04:22:23.313 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-28T04:22:23.313 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-28T04:22:23.313 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-09-28T04:22:23.313 INFO:tasks.ceph:[osd] filestore flush min = 0 2023-09-28T04:22:23.313 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-28T04:22:23.313 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-28T04:22:23.313 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-28T04:22:23.313 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-28T04:22:23.313 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-09-28T04:22:23.314 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-28T04:22:23.314 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-09-28T04:22:23.314 INFO:tasks.ceph:Setting up mon.a... 2023-09-28T04:22:23.314 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-28T04:22:23.418 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.keyring 2023-09-28T04:22:23.425 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-28T04:22:23.522 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-28T04:22:23.591 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.118'), ('mon.b', '172.21.15.174'), ('mon.c', '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]')] 2023-09-28T04:22:23.592 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.118,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-09-28T04:22:23.593 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:23.593 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-28T04:22:23.639 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.118 --add b 172.21.15.174 --addv c '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:23.765 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:23.765 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: generated fsid aedcea83-ad1a-46d9-8a4a-210ffd422a84 2023-09-28T04:22:23.765 INFO:teuthology.orchestra.run.smithi118.stdout:setting min_mon_release = octopus 2023-09-28T04:22:23.765 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 0 2023-09-28T04:22:23.765 INFO:teuthology.orchestra.run.smithi118.stdout:fsid aedcea83-ad1a-46d9-8a4a-210ffd422a84 2023-09-28T04:22:23.765 INFO:teuthology.orchestra.run.smithi118.stdout:last_changed 2023-09-28T04:22:23.765334+0000 2023-09-28T04:22:23.765 INFO:teuthology.orchestra.run.smithi118.stdout:created 2023-09-28T04:22:23.765334+0000 2023-09-28T04:22:23.765 INFO:teuthology.orchestra.run.smithi118.stdout:min_mon_release 15 (octopus) 2023-09-28T04:22:23.765 INFO:teuthology.orchestra.run.smithi118.stdout:election_strategy: 1 2023-09-28T04:22:23.766 INFO:teuthology.orchestra.run.smithi118.stdout:0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.a 2023-09-28T04:22:23.766 INFO:teuthology.orchestra.run.smithi118.stdout:1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.b 2023-09-28T04:22:23.766 INFO:teuthology.orchestra.run.smithi118.stdout:2: [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] mon.c 2023-09-28T04:22:23.766 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-28T04:22:23.767 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-28T04:22:23.812 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID aedcea83-ad1a-46d9-8a4a-210ffd422a84... 2023-09-28T04:22:23.814 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-28T04:22:23.858 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-28T04:22:23.904 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2023-09-28T04:22:23.905 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2023-09-28T04:22:23.905 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-28T04:22:23.905 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2023-09-28T04:22:23.905 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.905 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2023-09-28T04:22:23.905 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.905 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2023-09-28T04:22:23.905 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.905 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2023-09-28T04:22:23.906 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2023-09-28T04:22:23.906 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.906 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2023-09-28T04:22:23.906 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2023-09-28T04:22:23.906 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.906 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-28T04:22:23.906 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2023-09-28T04:22:23.906 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.906 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2023-09-28T04:22:23.906 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-28T04:22:23.906 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.907 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2023-09-28T04:22:23.907 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.907 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2023-09-28T04:22:23.907 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2023-09-28T04:22:23.907 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2023-09-28T04:22:23.907 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2023-09-28T04:22:23.907 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2023-09-28T04:22:23.907 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2023-09-28T04:22:23.907 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2023-09-28T04:22:23.907 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-28T04:22:23.907 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-28T04:22:23.908 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2023-09-28T04:22:23.908 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.908 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-28T04:22:23.908 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.908 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2023-09-28T04:22:23.908 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.908 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2023-09-28T04:22:23.908 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.908 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2023-09-28T04:22:23.908 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2023-09-28T04:22:23.908 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2023-09-28T04:22:23.909 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = "172.21.15.118,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2023-09-28T04:22:23.909 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on skipped message = False 2023-09-28T04:22:23.909 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = aedcea83-ad1a-46d9-8a4a-210ffd422a84 2023-09-28T04:22:23.909 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.909 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2023-09-28T04:22:23.909 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2023-09-28T04:22:23.909 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.909 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2023-09-28T04:22:23.909 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2023-09-28T04:22:23.909 INFO:teuthology.orchestra.run.smithi174.stdout: osd mclock profile = high_recovery_ops 2023-09-28T04:22:23.910 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.910 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2023-09-28T04:22:23.910 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2023-09-28T04:22:23.910 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.910 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2023-09-28T04:22:23.910 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2023-09-28T04:22:23.910 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2023-09-28T04:22:23.910 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.910 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2023-09-28T04:22:23.910 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2023-09-28T04:22:23.910 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.910 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2023-09-28T04:22:23.911 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.911 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2023-09-28T04:22:23.911 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.911 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2023-09-28T04:22:23.911 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.911 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2023-09-28T04:22:23.911 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2023-09-28T04:22:23.911 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.911 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2023-09-28T04:22:23.911 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2023-09-28T04:22:23.911 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore block size = 96636764160 2023-09-28T04:22:23.911 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore compression mode = aggressive 2023-09-28T04:22:23.912 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore fsck on mount = True 2023-09-28T04:22:23.912 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluefs = 20 2023-09-28T04:22:23.912 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluestore = 20 2023-09-28T04:22:23.912 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-09-28T04:22:23.912 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 20 2023-09-28T04:22:23.912 INFO:teuthology.orchestra.run.smithi174.stdout: debug rocksdb = 10 2023-09-28T04:22:23.912 INFO:teuthology.orchestra.run.smithi174.stdout: filestore flush min = 0 2023-09-28T04:22:23.912 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd backfillfull_ratio = 0.85 2023-09-28T04:22:23.912 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd full ratio = 0.9 2023-09-28T04:22:23.912 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd nearfull ratio = 0.8 2023-09-28T04:22:23.912 INFO:teuthology.orchestra.run.smithi174.stdout: osd failsafe full ratio = 0.95 2023-09-28T04:22:23.912 INFO:teuthology.orchestra.run.smithi174.stdout: osd max markdown count = 1000 2023-09-28T04:22:23.913 INFO:teuthology.orchestra.run.smithi174.stdout: osd objectstore = bluestore 2023-09-28T04:22:23.913 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2023-09-28T04:22:23.913 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.913 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2023-09-28T04:22:23.913 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-09-28T04:22:23.913 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2023-09-28T04:22:23.913 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2023-09-28T04:22:23.913 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2023-09-28T04:22:23.913 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2023-09-28T04:22:23.913 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2023-09-28T04:22:23.913 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2023-09-28T04:22:23.913 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.914 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2023-09-28T04:22:23.914 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-09-28T04:22:23.914 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2023-09-28T04:22:23.914 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2023-09-28T04:22:23.914 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2023-09-28T04:22:23.914 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2023-09-28T04:22:23.914 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2023-09-28T04:22:23.914 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2023-09-28T04:22:23.914 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2023-09-28T04:22:23.914 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2023-09-28T04:22:23.914 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2023-09-28T04:22:23.914 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.915 INFO:teuthology.orchestra.run.smithi174.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-28T04:22:23.915 INFO:teuthology.orchestra.run.smithi174.stdout: auth mon ticket ttl = 660 # 11m 2023-09-28T04:22:23.915 INFO:teuthology.orchestra.run.smithi174.stdout: auth service ticket ttl = 240 # 4m 2023-09-28T04:22:23.915 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.915 INFO:teuthology.orchestra.run.smithi174.stdout: # don't complain about insecure global_id in the test suite 2023-09-28T04:22:23.915 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-28T04:22:23.915 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-28T04:22:23.915 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.915 INFO:teuthology.orchestra.run.smithi174.stdout: # 1m isn't quite enough 2023-09-28T04:22:23.915 INFO:teuthology.orchestra.run.smithi174.stdout: mon_down_mkfs_grace = 2m 2023-09-28T04:22:23.915 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.915 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_filestore_osds = false 2023-09-28T04:22:23.916 INFO:teuthology.orchestra.run.smithi174.stdout: mon op complaint time = 120 2023-09-28T04:22:23.916 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-09-28T04:22:23.916 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2023-09-28T04:22:23.916 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2023-09-28T04:22:23.916 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2023-09-28T04:22:23.916 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2023-09-28T04:22:23.916 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-28T04:22:23.916 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-28T04:22:23.916 INFO:teuthology.orchestra.run.smithi174.stdout: client mount timeout = 600 2023-09-28T04:22:23.916 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2023-09-28T04:22:23.916 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-09-28T04:22:23.916 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2023-09-28T04:22:23.917 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2023-09-28T04:22:23.917 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2023-09-28T04:22:23.917 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.b] 2023-09-28T04:22:23.917 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.c] 2023-09-28T04:22:23.917 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2023-09-28T04:22:23.917 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2023-09-28T04:22:23.917 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.e] 2023-09-28T04:22:23.917 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2023-09-28T04:22:23.917 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2023-09-28T04:22:23.917 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.f] 2023-09-28T04:22:23.917 INFO:teuthology.orchestra.run.smithi174.stdout:[mds] 2023-09-28T04:22:23.917 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds = 20 2023-09-28T04:22:23.918 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-09-28T04:22:23.918 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal fragment size max = 10000 2023-09-28T04:22:23.918 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal merge size = 5 2023-09-28T04:22:23.918 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal split bits = 3 2023-09-28T04:22:23.918 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal split size = 100 2023-09-28T04:22:23.918 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug frag = True 2023-09-28T04:22:23.918 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug scatterstat = True 2023-09-28T04:22:23.918 INFO:teuthology.orchestra.run.smithi174.stdout: mds oft prefetch dirfrags = True 2023-09-28T04:22:23.918 INFO:teuthology.orchestra.run.smithi174.stdout: mds op complaint time = 180 2023-09-28T04:22:23.918 INFO:teuthology.orchestra.run.smithi174.stdout: mds verify scatter = True 2023-09-28T04:22:23.918 INFO:teuthology.orchestra.run.smithi174.stdout: mds_sleep_rank_change = 5000000.0 2023-09-28T04:22:23.919 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2023-09-28T04:22:23.919 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2023-09-28T04:22:23.919 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2023-09-28T04:22:23.977 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2023-09-28T04:22:23.977 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2023-09-28T04:22:23.977 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-28T04:22:23.977 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2023-09-28T04:22:23.977 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.978 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2023-09-28T04:22:23.978 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.978 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2023-09-28T04:22:23.978 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.978 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2023-09-28T04:22:23.978 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2023-09-28T04:22:23.978 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.978 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2023-09-28T04:22:23.978 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2023-09-28T04:22:23.978 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.978 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-28T04:22:23.978 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2023-09-28T04:22:23.979 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.979 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2023-09-28T04:22:23.979 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-28T04:22:23.979 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.979 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2023-09-28T04:22:23.979 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.979 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2023-09-28T04:22:23.979 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2023-09-28T04:22:23.979 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2023-09-28T04:22:23.979 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2023-09-28T04:22:23.979 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2023-09-28T04:22:23.980 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2023-09-28T04:22:23.980 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2023-09-28T04:22:23.980 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-28T04:22:23.980 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-28T04:22:23.980 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2023-09-28T04:22:23.980 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.980 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-28T04:22:23.980 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.980 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2023-09-28T04:22:23.980 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.980 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2023-09-28T04:22:23.981 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.981 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2023-09-28T04:22:23.981 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2023-09-28T04:22:23.981 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2023-09-28T04:22:23.981 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.118,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2023-09-28T04:22:23.981 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on skipped message = False 2023-09-28T04:22:23.981 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = aedcea83-ad1a-46d9-8a4a-210ffd422a84 2023-09-28T04:22:23.981 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.981 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2023-09-28T04:22:23.981 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2023-09-28T04:22:23.981 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.981 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2023-09-28T04:22:23.982 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2023-09-28T04:22:23.982 INFO:teuthology.orchestra.run.smithi118.stdout: osd mclock profile = high_recovery_ops 2023-09-28T04:22:23.982 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.982 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2023-09-28T04:22:23.982 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2023-09-28T04:22:23.982 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.982 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2023-09-28T04:22:23.982 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2023-09-28T04:22:23.982 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2023-09-28T04:22:23.983 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.983 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2023-09-28T04:22:23.983 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2023-09-28T04:22:23.983 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.983 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2023-09-28T04:22:23.983 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.983 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2023-09-28T04:22:23.983 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.983 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2023-09-28T04:22:23.983 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.983 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2023-09-28T04:22:23.983 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2023-09-28T04:22:23.984 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.984 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2023-09-28T04:22:23.984 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2023-09-28T04:22:23.984 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2023-09-28T04:22:23.984 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore compression mode = aggressive 2023-09-28T04:22:23.984 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2023-09-28T04:22:23.984 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 20 2023-09-28T04:22:23.984 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 20 2023-09-28T04:22:23.984 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-09-28T04:22:23.984 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2023-09-28T04:22:23.984 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 10 2023-09-28T04:22:23.984 INFO:teuthology.orchestra.run.smithi118.stdout: filestore flush min = 0 2023-09-28T04:22:23.985 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2023-09-28T04:22:23.985 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2023-09-28T04:22:23.985 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2023-09-28T04:22:23.985 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2023-09-28T04:22:23.985 INFO:teuthology.orchestra.run.smithi118.stdout: osd max markdown count = 1000 2023-09-28T04:22:23.985 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2023-09-28T04:22:23.985 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-09-28T04:22:23.985 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.985 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2023-09-28T04:22:23.985 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-09-28T04:22:23.985 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2023-09-28T04:22:23.985 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-09-28T04:22:23.986 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-09-28T04:22:23.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-09-28T04:22:23.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-09-28T04:22:23.986 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2023-09-28T04:22:23.986 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.986 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2023-09-28T04:22:23.986 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-09-28T04:22:23.986 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-09-28T04:22:23.986 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2023-09-28T04:22:23.986 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-09-28T04:22:23.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2023-09-28T04:22:23.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2023-09-28T04:22:23.987 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-09-28T04:22:23.987 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2023-09-28T04:22:23.987 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2023-09-28T04:22:23.987 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-09-28T04:22:23.987 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.987 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-28T04:22:23.987 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2023-09-28T04:22:23.987 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2023-09-28T04:22:23.987 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.987 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2023-09-28T04:22:23.987 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-28T04:22:23.988 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-28T04:22:23.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.988 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2023-09-28T04:22:23.988 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2023-09-28T04:22:23.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.988 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2023-09-28T04:22:23.988 INFO:teuthology.orchestra.run.smithi118.stdout: mon op complaint time = 120 2023-09-28T04:22:23.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:22:23.988 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2023-09-28T04:22:23.988 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2023-09-28T04:22:23.988 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2023-09-28T04:22:23.988 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2023-09-28T04:22:23.989 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-28T04:22:23.989 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-28T04:22:23.989 INFO:teuthology.orchestra.run.smithi118.stdout: client mount timeout = 600 2023-09-28T04:22:23.989 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2023-09-28T04:22:23.989 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-09-28T04:22:23.989 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-09-28T04:22:23.989 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-09-28T04:22:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2023-09-28T04:22:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2023-09-28T04:22:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2023-09-28T04:22:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-09-28T04:22:23.989 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2023-09-28T04:22:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.e] 2023-09-28T04:22:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-09-28T04:22:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2023-09-28T04:22:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.f] 2023-09-28T04:22:23.990 INFO:teuthology.orchestra.run.smithi118.stdout:[mds] 2023-09-28T04:22:23.990 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds = 20 2023-09-28T04:22:23.990 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-09-28T04:22:23.990 INFO:teuthology.orchestra.run.smithi118.stdout: mds bal fragment size max = 10000 2023-09-28T04:22:23.990 INFO:teuthology.orchestra.run.smithi118.stdout: mds bal merge size = 5 2023-09-28T04:22:23.990 INFO:teuthology.orchestra.run.smithi118.stdout: mds bal split bits = 3 2023-09-28T04:22:23.990 INFO:teuthology.orchestra.run.smithi118.stdout: mds bal split size = 100 2023-09-28T04:22:23.991 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug frag = True 2023-09-28T04:22:23.991 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug scatterstat = True 2023-09-28T04:22:23.991 INFO:teuthology.orchestra.run.smithi118.stdout: mds oft prefetch dirfrags = True 2023-09-28T04:22:23.991 INFO:teuthology.orchestra.run.smithi118.stdout: mds op complaint time = 180 2023-09-28T04:22:23.991 INFO:teuthology.orchestra.run.smithi118.stdout: mds verify scatter = True 2023-09-28T04:22:23.991 INFO:teuthology.orchestra.run.smithi118.stdout: mds_sleep_rank_change = 5000000.0 2023-09-28T04:22:23.991 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-09-28T04:22:23.991 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-09-28T04:22:23.991 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-09-28T04:22:24.006 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-28T04:22:24.006 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-28T04:22:24.112 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-28T04:22:24.112 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:24.112 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-28T04:22:24.156 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:24.156 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-28T04:22:24.240 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T04:22:24.240 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:24.240 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-28T04:22:24.240 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-28T04:22:24.378 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:24.379 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:24.465 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2023-09-28T04:22:24.465 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:24.466 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-28T04:22:24.466 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-28T04:22:24.508 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:24.508 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:24.568 INFO:tasks.ceph:Setting up mon nodes... 2023-09-28T04:22:24.568 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-28T04:22:24.568 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-28T04:22:24.687 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-28T04:22:24.693 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-28T04:22:24.973 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-28T04:22:24.975 INFO:tasks.ceph:Setting up mds nodes... 2023-09-28T04:22:24.975 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-28T04:22:25.096 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-28T04:22:25.100 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-28T04:22:25.171 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-09-28T04:22:25.295 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-09-28T04:22:25.300 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-09-28T04:22:25.369 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-09-28T04:22:25.488 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-09-28T04:22:25.493 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-09-28T04:22:25.566 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-28T04:22:25.625 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-28T04:22:25.628 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-28T04:22:25.658 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-09-28T04:22:25.750 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-09-28T04:22:25.753 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-09-28T04:22:25.780 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-09-28T04:22:25.870 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-09-28T04:22:25.872 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-09-28T04:22:25.899 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-28T04:22:25.899 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-28T04:22:25.990 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-28T04:22:26.020 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-28T04:22:26.020 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-28T04:22:26.021 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-28T04:22:26.089 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T04:22:26.090 INFO:tasks.ceph:role: osd.0 2023-09-28T04:22:26.090 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T04:22:26.090 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-28T04:22:26.157 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T04:22:26.157 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T04:22:26.157 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T04:22:26.157 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-28T04:22:26.158 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T04:22:26.158 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-09-28T04:22:26.158 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T04:22:26.158 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T04:22:26.158 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T04:22:26.158 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T04:22:26.180 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-09-28T04:22:26.212 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-09-28T04:22:26.212 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-28T04:22:26.317 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-28T04:22:26.393 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-28T04:22:26.462 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T04:22:26.462 INFO:tasks.ceph:role: osd.1 2023-09-28T04:22:26.462 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T04:22:26.462 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-28T04:22:26.531 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T04:22:26.531 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T04:22:26.531 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T04:22:26.531 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-28T04:22:26.532 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T04:22:26.532 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-09-28T04:22:26.532 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T04:22:26.532 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T04:22:26.532 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T04:22:26.532 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T04:22:26.555 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-09-28T04:22:26.559 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-09-28T04:22:26.559 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-28T04:22:26.665 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-28T04:22:26.739 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-28T04:22:26.808 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T04:22:26.808 INFO:tasks.ceph:role: osd.2 2023-09-28T04:22:26.808 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T04:22:26.808 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-28T04:22:26.876 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T04:22:26.877 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T04:22:26.877 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T04:22:26.877 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-28T04:22:26.877 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T04:22:26.877 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-09-28T04:22:26.877 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T04:22:26.877 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T04:22:26.877 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T04:22:26.877 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T04:22:26.901 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-09-28T04:22:26.905 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-09-28T04:22:26.905 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-28T04:22:27.009 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-28T04:22:27.084 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-28T04:22:27.153 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T04:22:27.153 INFO:tasks.ceph:role: osd.3 2023-09-28T04:22:27.153 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T04:22:27.153 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-28T04:22:27.223 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T04:22:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T04:22:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T04:22:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-28T04:22:27.223 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T04:22:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-09-28T04:22:27.223 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T04:22:27.223 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T04:22:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T04:22:27.224 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T04:22:27.246 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-09-28T04:22:27.249 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-09-28T04:22:27.249 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-28T04:22:27.358 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-28T04:22:27.433 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:27.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:27.551+0000 7f70ec7d7540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-28T04:22:27.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:27.551+0000 7f70ec7d7540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-28T04:22:27.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:27.551+0000 7f70ec7d7540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-28T04:22:27.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:27.551+0000 7f70ec7d7540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-28T04:22:27.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:27.551+0000 7f70ec7d7540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-28T04:22:27.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:27.553+0000 7f70ec7d7540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-28T04:22:28.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:28.095+0000 7f70ec7d7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:28.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:28.852+0000 7f70ec7d7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:29.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:29.619+0000 7f70ec7d7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:30.436 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-28T04:22:30.510 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:30.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:30.609+0000 7f2bab3a3540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-28T04:22:30.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:30.609+0000 7f2bab3a3540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-28T04:22:30.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:30.609+0000 7f2bab3a3540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-28T04:22:30.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:30.609+0000 7f2bab3a3540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-28T04:22:30.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:30.609+0000 7f2bab3a3540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-28T04:22:30.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:30.611+0000 7f2bab3a3540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-28T04:22:31.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:31.148+0000 7f2bab3a3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:31.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:31.913+0000 7f2bab3a3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:32.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:32.678+0000 7f2bab3a3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:33.499 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-28T04:22:33.579 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:33.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:33.687+0000 7f3774a6c540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-28T04:22:33.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:33.687+0000 7f3774a6c540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-28T04:22:33.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:33.687+0000 7f3774a6c540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-28T04:22:33.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:33.687+0000 7f3774a6c540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-28T04:22:33.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:33.688+0000 7f3774a6c540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-28T04:22:33.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:33.689+0000 7f3774a6c540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-28T04:22:34.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:34.228+0000 7f3774a6c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:35.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:35.005+0000 7f3774a6c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:35.768 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:35.768+0000 7f3774a6c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:36.579 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-28T04:22:36.662 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:36.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:36.775+0000 7f6cd965b540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-28T04:22:36.776 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:36.775+0000 7f6cd965b540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-28T04:22:36.776 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:36.775+0000 7f6cd965b540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-28T04:22:36.776 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:36.775+0000 7f6cd965b540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-28T04:22:36.776 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:36.775+0000 7f6cd965b540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-28T04:22:36.777 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:36.777+0000 7f6cd965b540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-28T04:22:37.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:37.314+0000 7f6cd965b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:38.080 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:38.080+0000 7f6cd965b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:38.842 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:38.842+0000 7f6cd965b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:39.659 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-28T04:22:39.734 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-09-28T04:22:39.768 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T04:22:39.768 INFO:tasks.ceph:role: osd.4 2023-09-28T04:22:39.769 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com 2023-09-28T04:22:39.769 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-28T04:22:39.849 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T04:22:39.849 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T04:22:39.849 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T04:22:39.850 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-28T04:22:39.850 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T04:22:39.850 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2023-09-28T04:22:39.850 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T04:22:39.850 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T04:22:39.850 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T04:22:39.850 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T04:22:40.278 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2023-09-28T04:22:40.280 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2023-09-28T04:22:40.280 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-09-28T04:22:40.458 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-09-28T04:22:40.495 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-09-28T04:22:40.565 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T04:22:40.565 INFO:tasks.ceph:role: osd.5 2023-09-28T04:22:40.566 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com 2023-09-28T04:22:40.566 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-28T04:22:40.642 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T04:22:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T04:22:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T04:22:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-28T04:22:40.642 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T04:22:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2023-09-28T04:22:40.642 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T04:22:40.642 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T04:22:40.643 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T04:22:40.643 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T04:22:41.072 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2023-09-28T04:22:41.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2023-09-28T04:22:41.074 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-09-28T04:22:41.185 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-09-28T04:22:41.219 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-09-28T04:22:41.289 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T04:22:41.289 INFO:tasks.ceph:role: osd.6 2023-09-28T04:22:41.289 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com 2023-09-28T04:22:41.289 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-28T04:22:41.365 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T04:22:41.365 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T04:22:41.365 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T04:22:41.366 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-28T04:22:41.366 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T04:22:41.366 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2023-09-28T04:22:41.366 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T04:22:41.366 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T04:22:41.367 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T04:22:41.367 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T04:22:41.813 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2023-09-28T04:22:41.815 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2023-09-28T04:22:41.816 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-09-28T04:22:41.989 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-09-28T04:22:42.025 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-09-28T04:22:42.096 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T04:22:42.097 INFO:tasks.ceph:role: osd.7 2023-09-28T04:22:42.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com 2023-09-28T04:22:42.097 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-28T04:22:42.174 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T04:22:42.174 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T04:22:42.174 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T04:22:42.174 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-28T04:22:42.174 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T04:22:42.174 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2023-09-28T04:22:42.175 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T04:22:42.175 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T04:22:42.175 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T04:22:42.175 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T04:22:42.615 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2023-09-28T04:22:42.618 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2023-09-28T04:22:42.618 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-09-28T04:22:42.798 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-09-28T04:22:42.835 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:42.924 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:42.922+0000 7fe7daf99540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-09-28T04:22:42.924 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:42.922+0000 7fe7daf99540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-09-28T04:22:42.924 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:42.922+0000 7fe7daf99540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-28T04:22:42.924 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:42.922+0000 7fe7daf99540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-28T04:22:42.925 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:42.922+0000 7fe7daf99540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-28T04:22:42.925 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:42.922+0000 7fe7daf99540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-09-28T04:22:43.448 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:43.447+0000 7fe7daf99540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:44.214 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:44.213+0000 7fe7daf99540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:44.977 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:44.975+0000 7fe7daf99540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:45.773 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-09-28T04:22:45.806 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:45.894 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:45.892+0000 7f9b5bcb5540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-09-28T04:22:45.894 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:45.893+0000 7f9b5bcb5540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-09-28T04:22:45.895 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:45.893+0000 7f9b5bcb5540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-28T04:22:45.895 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:45.893+0000 7f9b5bcb5540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-28T04:22:45.895 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:45.893+0000 7f9b5bcb5540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-28T04:22:45.895 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:45.893+0000 7f9b5bcb5540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-09-28T04:22:46.417 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:46.415+0000 7f9b5bcb5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:47.179 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:47.178+0000 7f9b5bcb5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:47.945 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:47.944+0000 7f9b5bcb5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:48.741 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-09-28T04:22:48.774 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:48.863 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:48.862+0000 7efc36bb3540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-09-28T04:22:48.863 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:48.862+0000 7efc36bb3540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-09-28T04:22:48.864 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:48.862+0000 7efc36bb3540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-28T04:22:48.864 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:48.862+0000 7efc36bb3540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-28T04:22:48.864 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:48.862+0000 7efc36bb3540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-28T04:22:48.864 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:48.863+0000 7efc36bb3540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-09-28T04:22:49.395 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:49.394+0000 7efc36bb3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:50.160 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:50.159+0000 7efc36bb3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:50.923 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:50.922+0000 7efc36bb3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:51.532 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T04:22:51.538 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T04:22:51.721 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-09-28T04:22:51.754 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:51.841 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:51.840+0000 7f7ad0f35540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-09-28T04:22:51.842 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:51.840+0000 7f7ad0f35540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-09-28T04:22:51.842 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:51.840+0000 7f7ad0f35540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-28T04:22:51.842 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:51.840+0000 7f7ad0f35540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-28T04:22:51.842 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:51.840+0000 7f7ad0f35540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-28T04:22:51.842 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:51.841+0000 7f7ad0f35540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-09-28T04:22:52.370 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:52.369+0000 7f7ad0f35540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:53.136 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:53.135+0000 7f7ad0f35540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:53.901 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:53.899+0000 7f7ad0f35540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T04:22:54.696 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-09-28T04:22:54.727 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-28T04:22:54.727 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:54.727 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-28T04:22:54.804 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:54.805 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-28T04:22:54.874 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:54.875 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-09-28T04:22:54.984 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:54.984 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-09-28T04:22:55.092 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:55.092 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-28T04:22:55.201 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:55.201 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-28T04:22:55.310 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:55.310 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-28T04:22:55.418 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:55.419 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-28T04:22:55.527 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:55.527 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-28T04:22:55.560 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:55.560 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-28T04:22:55.633 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:55.633 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-09-28T04:22:55.705 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:55.705 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-09-28T04:22:55.775 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:55.775 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-09-28T04:22:55.846 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:55.846 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-09-28T04:22:55.915 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:55.915 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-09-28T04:22:55.983 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:55.983 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-09-28T04:22:56.051 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:56.051 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-28T04:22:56.097 INFO:tasks.ceph:Adding keys to all mons... 2023-09-28T04:22:56.097 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-28T04:22:56.142 DEBUG:teuthology.orchestra.run.smithi174:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-28T04:22:56.168 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.y] 2023-09-28T04:22:56.168 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCA/xRl1UcEKRAAw7ykeuoAFdD2tx8Bvy6UVQ== 2023-09-28T04:22:56.169 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2023-09-28T04:22:56.169 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCB/xRl6YTFBRAAYefWcA7Y+N3DUfTJYyUwUw== 2023-09-28T04:22:56.169 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2023-09-28T04:22:56.169 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCB/xRl5cCfERAARFdRQu2nupHY9u3TiovYng== 2023-09-28T04:22:56.169 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.e] 2023-09-28T04:22:56.169 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCB/xRlLYgoHRAAmuIm3G/VmTvTggwcJyCQVA== 2023-09-28T04:22:56.169 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.0] 2023-09-28T04:22:56.169 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCD/xRlVBjvIBAAILF/n2RZ3IjtBndrxgoYOQ== 2023-09-28T04:22:56.169 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.1] 2023-09-28T04:22:56.169 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCG/xRlv7tiJBAAjjv2OxiuHRa9ZKbIjIGX/g== 2023-09-28T04:22:56.170 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.2] 2023-09-28T04:22:56.170 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCJ/xRlnP4KKRAAjVQDJ0yHnNNyXbCnU9FRUw== 2023-09-28T04:22:56.170 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.3] 2023-09-28T04:22:56.170 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCM/xRluzpELhAApCpG9+5D+LbjsDzEyQoNNw== 2023-09-28T04:22:56.170 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.x] 2023-09-28T04:22:56.170 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCA/xRlcUgHOhAAkxonPGUId9aewM3sWQWpzA== 2023-09-28T04:22:56.170 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2023-09-28T04:22:56.170 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCB/xRluYJYJRAA7O1nD/nl/DFQY2R6XkiM8g== 2023-09-28T04:22:56.170 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2023-09-28T04:22:56.170 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCB/xRlr5fJLBAAwHMT2Yfg5QXGbdR5eJrFtA== 2023-09-28T04:22:56.170 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.f] 2023-09-28T04:22:56.170 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCB/xRluMLrMxAAvPafVp4uvTcs1eUQgamWKQ== 2023-09-28T04:22:56.171 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.4] 2023-09-28T04:22:56.171 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCS/xRl61kSNxAAtPm8TT3N7u/HzWGNy4P8Aw== 2023-09-28T04:22:56.171 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.5] 2023-09-28T04:22:56.171 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCV/xRl/6tUNRAA1QdwKBq1KjHCjVx5+kix0g== 2023-09-28T04:22:56.171 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.6] 2023-09-28T04:22:56.171 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCY/xRlVOF9MxAA21N8zOGzCYSz69rFHVFn8Q== 2023-09-28T04:22:56.171 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.7] 2023-09-28T04:22:56.171 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCb/xRlvfYyMhAAzUcscagW0t4Jo4R0Od/eyg== 2023-09-28T04:22:56.171 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2023-09-28T04:22:56.171 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQCB/xRl4hEXOxAAPE/75yP21phEBBk1cYT1xg== 2023-09-28T04:22:56.204 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2023-09-28T04:22:56.204 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCA/xRl1UcEKRAAw7ykeuoAFdD2tx8Bvy6UVQ== 2023-09-28T04:22:56.204 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-09-28T04:22:56.204 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCB/xRl6YTFBRAAYefWcA7Y+N3DUfTJYyUwUw== 2023-09-28T04:22:56.205 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2023-09-28T04:22:56.205 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCB/xRl5cCfERAARFdRQu2nupHY9u3TiovYng== 2023-09-28T04:22:56.205 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.e] 2023-09-28T04:22:56.205 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCB/xRlLYgoHRAAmuIm3G/VmTvTggwcJyCQVA== 2023-09-28T04:22:56.205 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2023-09-28T04:22:56.205 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCD/xRlVBjvIBAAILF/n2RZ3IjtBndrxgoYOQ== 2023-09-28T04:22:56.205 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2023-09-28T04:22:56.205 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCG/xRlv7tiJBAAjjv2OxiuHRa9ZKbIjIGX/g== 2023-09-28T04:22:56.205 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2023-09-28T04:22:56.205 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCJ/xRlnP4KKRAAjVQDJ0yHnNNyXbCnU9FRUw== 2023-09-28T04:22:56.205 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2023-09-28T04:22:56.205 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCM/xRluzpELhAApCpG9+5D+LbjsDzEyQoNNw== 2023-09-28T04:22:56.206 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2023-09-28T04:22:56.206 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCA/xRlcUgHOhAAkxonPGUId9aewM3sWQWpzA== 2023-09-28T04:22:56.206 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-09-28T04:22:56.206 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCB/xRluYJYJRAA7O1nD/nl/DFQY2R6XkiM8g== 2023-09-28T04:22:56.206 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2023-09-28T04:22:56.206 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCB/xRlr5fJLBAAwHMT2Yfg5QXGbdR5eJrFtA== 2023-09-28T04:22:56.206 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.f] 2023-09-28T04:22:56.206 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCB/xRluMLrMxAAvPafVp4uvTcs1eUQgamWKQ== 2023-09-28T04:22:56.206 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.4] 2023-09-28T04:22:56.206 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCS/xRl61kSNxAAtPm8TT3N7u/HzWGNy4P8Aw== 2023-09-28T04:22:56.206 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.5] 2023-09-28T04:22:56.207 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCV/xRl/6tUNRAA1QdwKBq1KjHCjVx5+kix0g== 2023-09-28T04:22:56.207 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.6] 2023-09-28T04:22:56.207 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCY/xRlVOF9MxAA21N8zOGzCYSz69rFHVFn8Q== 2023-09-28T04:22:56.207 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.7] 2023-09-28T04:22:56.207 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCb/xRlvfYyMhAAzUcscagW0t4Jo4R0Od/eyg== 2023-09-28T04:22:56.207 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2023-09-28T04:22:56.207 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCB/xRl4hEXOxAAPE/75yP21phEBBk1cYT1xg== 2023-09-28T04:22:56.208 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-28T04:22:56.253 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-28T04:22:56.351 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T04:22:56.356 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T04:22:56.456 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T04:22:56.461 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T04:22:56.562 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T04:22:56.566 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T04:22:56.667 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:56.671 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:56.769 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:56.774 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:56.873 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:56.877 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:56.974 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:56.978 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:57.076 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-28T04:22:57.080 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-28T04:22:57.178 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T04:22:57.183 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T04:22:57.283 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T04:22:57.288 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T04:22:57.388 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T04:22:57.392 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T04:22:57.493 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:57.498 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:57.595 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:57.599 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:57.697 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:57.701 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:57.799 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:57.805 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T04:22:57.903 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-28T04:22:57.908 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-28T04:22:58.008 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-28T04:22:58.008 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-28T04:22:58.076 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-28T04:22:58.194 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-28T04:22:58.263 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-28T04:22:58.291 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-28T04:22:58.386 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-28T04:22:58.414 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-28T04:22:58.481 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-28T04:22:58.575 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-28T04:22:58.602 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:58.609 DEBUG:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-28T04:22:58.660 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-28T04:22:58.660 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-28T04:22:58.660 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-28T04:22:58.693 INFO:tasks.ceph.mon.a:Started 2023-09-28T04:22:58.694 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-28T04:22:58.694 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-28T04:22:58.702 INFO:tasks.ceph.mon.b:Started 2023-09-28T04:22:58.703 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-28T04:22:58.703 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-28T04:22:58.705 INFO:tasks.ceph.mon.c:Started 2023-09-28T04:22:58.705 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-28T04:22:58.706 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-28T04:22:58.706 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-28T04:22:58.711 INFO:tasks.ceph.mgr.y:Started 2023-09-28T04:22:58.712 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-28T04:22:58.712 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-28T04:22:58.714 INFO:tasks.ceph.mgr.x:Started 2023-09-28T04:22:58.714 INFO:tasks.ceph:Setting crush tunables to default 2023-09-28T04:22:58.714 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd crush tunables default 2023-09-28T04:22:58.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.907+0000 7f02bd3ff700 1 Processor -- start 2023-09-28T04:22:58.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.907+0000 7f02bd3ff700 1 -- start start 2023-09-28T04:22:58.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.908+0000 7f02bd3ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b81585e0 0x7f02b8069d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:22:58.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.908+0000 7f02bd3ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f02b81589b0 0x7f02b80cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:22:58.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.908+0000 7f02bd3ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b8156f20 con 0x7f02b806a280 2023-09-28T04:22:58.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.908+0000 7f02bd3ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b80acf70 con 0x7f02b81589b0 2023-09-28T04:22:58.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.908+0000 7f02bd3ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b8156790 con 0x7f02b81585e0 2023-09-28T04:22:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.908+0000 7f02b6ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b81585e0 0x7f02b8069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:22:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.908+0000 7f02b6ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b81585e0 0x7f02b8069d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:57958/0 (socket says 172.21.15.118:57958) 2023-09-28T04:22:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.908+0000 7f02b6ffd700 1 -- 172.21.15.118:0/1406355715 learned_addr learned my addr 172.21.15.118:0/1406355715 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:22:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.908+0000 7f02b67fc700 1 --2- 172.21.15.118:0/1406355715 >> v2:172.21.15.118:3300/0 conn(0x7f02b81589b0 0x7f02b80cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:22:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.909+0000 7f02b6ffd700 1 -- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b81585e0 msgr2=0x7f02b8069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-28T04:22:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.909+0000 7f02b6ffd700 1 -- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b81585e0 msgr2=0x7f02b8069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-28T04:22:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.909+0000 7f02b6ffd700 1 --2- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b81585e0 0x7f02b8069d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-28T04:22:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.909+0000 7f02b6ffd700 1 --2- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b81585e0 0x7f02b8069d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-28T04:22:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.909+0000 7f02b67fc700 1 -- 172.21.15.118:0/1406355715 >> v2:172.21.15.118:3300/0 conn(0x7f02b81589b0 msgr2=0x7f02b80cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-28T04:22:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.909+0000 7f02b67fc700 1 -- 172.21.15.118:0/1406355715 >> v2:172.21.15.118:3300/0 conn(0x7f02b81589b0 msgr2=0x7f02b80cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-28T04:22:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.909+0000 7f02b67fc700 1 --2- 172.21.15.118:0/1406355715 >> v2:172.21.15.118:3300/0 conn(0x7f02b81589b0 0x7f02b80cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-28T04:22:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.909+0000 7f02b67fc700 1 --2- 172.21.15.118:0/1406355715 >> v2:172.21.15.118:3300/0 conn(0x7f02b81589b0 0x7f02b80cbe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-28T04:22:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794951226 0 0) 0x7f02b8156f20 con 0x7f02b806a280 2023-09-28T04:22:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a0003570 con 0x7f02b806a280 2023-09-28T04:22:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3868657424 0 0) 0x7f02a0003570 con 0x7f02b806a280 2023-09-28T04:22:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b81585e0 msgr2=0x7f02b8069d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T04:22:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 --2- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b81585e0 0x7f02b8069d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 >> v2:172.21.15.118:3300/0 conn(0x7f02b81589b0 msgr2=0x7f02b80cbe70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T04:22:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 --2- 172.21.15.118:0/1406355715 >> v2:172.21.15.118:3300/0 conn(0x7f02b81589b0 0x7f02b80cbe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8155c10 con 0x7f02b806a280 2023-09-28T04:22:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 605954562 0 0) 0x7f02b00017f0 con 0x7f02b806a280 2023-09-28T04:22:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 >> v1:172.21.15.118:6789/0 conn(0x7f02b806a280 legacy=0x7f02b81573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:22:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 --2- 172.21.15.118:0/1406355715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a0003a90 0x7f02a0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:22:58.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 --2- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02a0004810 0x7f02a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:22:58.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 --2- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b81585e0 0x7f02a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:22:58.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b80acf70 con 0x7f02a0003a90 2023-09-28T04:22:58.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b8156790 con 0x7f02a0004810 2023-09-28T04:22:58.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.910+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a000bbc0 con 0x7f02b81585e0 2023-09-28T04:22:58.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.911+0000 7f02b67fc700 1 --2- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02a0004810 0x7f02a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:22:58.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.911+0000 7f02b77fe700 1 --2- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b81585e0 0x7f02a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:22:58.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.911+0000 7f02b6ffd700 1 --2- 172.21.15.118:0/1406355715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a0003a90 0x7f02a0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:22:58.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.911+0000 7f02b67fc700 1 -- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b81585e0 msgr2=0x7f02a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:22:58.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.911+0000 7f02b67fc700 1 --2- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b81585e0 0x7f02a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.911+0000 7f02b67fc700 1 -- 172.21.15.118:0/1406355715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a0003a90 msgr2=0x7f02a0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:22:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.911+0000 7f02b67fc700 1 --2- 172.21.15.118:0/1406355715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a0003a90 0x7f02a0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.911+0000 7f02b67fc700 1 -- 172.21.15.118:0/1406355715 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a0003570 con 0x7f02a0004810 2023-09-28T04:22:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.912+0000 7f02b67fc700 1 --2- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02a0004810 0x7f02a0004c80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00cae0 tx=0x7f02ac00c240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d0db8828b62cebc server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:22:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.912+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac00c450 con 0x7f02a0004810 2023-09-28T04:22:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.912+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac00e5e0 con 0x7f02a0004810 2023-09-28T04:22:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.912+0000 7f02b5ffb700 1 -- 172.21.15.118:0/1406355715 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac00e790 con 0x7f02a0004810 2023-09-28T04:22:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.912+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02a0004810 msgr2=0x7f02a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:22:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.912+0000 7f02bd3ff700 1 --2- 172.21.15.118:0/1406355715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02a0004810 0x7f02a0004c80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00cae0 tx=0x7f02ac00c240 comp rx=0 tx=0).stop 2023-09-28T04:22:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.912+0000 7f02b77fe700 1 -- 172.21.15.118:0/1406355715 reap_dead start 2023-09-28T04:22:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.913+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1406355715 shutdown_connections 2023-09-28T04:22:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.913+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1406355715 >> 172.21.15.118:0/1406355715 conn(0x7f02b80688e0 msgr2=0x7f02b8068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:22:58.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.913+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1406355715 shutdown_connections 2023-09-28T04:22:58.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.913+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1406355715 wait complete. 2023-09-28T04:22:58.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.915+0000 7f02bd3ff700 1 Processor -- start 2023-09-28T04:22:58.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.915+0000 7f02bd3ff700 1 -- start start 2023-09-28T04:22:58.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02bd3ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a0004810 0x7f02b8168c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:22:58.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02bd3ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b8152940 0x7f02b81691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:22:58.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02bd3ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02b814c200 0x7f02b814c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:22:58.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02bd3ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b80b1be0 con 0x7f02a0004810 2023-09-28T04:22:58.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02bd3ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b814cbb0 con 0x7f02b814c200 2023-09-28T04:22:58.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02bd3ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b81504a0 con 0x7f02b8152940 2023-09-28T04:22:58.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02b77fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02b814c200 0x7f02b814c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:22:58.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02b77fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02b814c200 0x7f02b814c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:41614/0 (socket says 172.21.15.118:41614) 2023-09-28T04:22:58.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02b77fe700 1 -- 172.21.15.118:0/1330944633 learned_addr learned my addr 172.21.15.118:0/1330944633 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:22:58.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02b67fc700 1 --2- 172.21.15.118:0/1330944633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b8152940 0x7f02b81691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:22:58.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02b6ffd700 1 --2- 172.21.15.118:0/1330944633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a0004810 0x7f02b8168c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:22:58.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02b77fe700 1 -- 172.21.15.118:0/1330944633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b8152940 msgr2=0x7f02b81691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:22:58.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02b77fe700 1 --2- 172.21.15.118:0/1330944633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b8152940 0x7f02b81691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:58.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02b77fe700 1 -- 172.21.15.118:0/1330944633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a0004810 msgr2=0x7f02b8168c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:22:58.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02b77fe700 1 --2- 172.21.15.118:0/1330944633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a0004810 0x7f02b8168c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:58.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02b77fe700 1 -- 172.21.15.118:0/1330944633 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b80c6f30 con 0x7f02b814c200 2023-09-28T04:22:58.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.917+0000 7f02b6ffd700 1 --2- 172.21.15.118:0/1330944633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a0004810 0x7f02b8168c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:22:58.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.918+0000 7f02b77fe700 1 --2- 172.21.15.118:0/1330944633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02b814c200 0x7f02b814c670 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f02a0004790 tx=0x7f02b0002e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:22:58.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.918+0000 7f029effd700 1 -- 172.21.15.118:0/1330944633 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b00017b0 con 0x7f02b814c200 2023-09-28T04:22:58.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.918+0000 7f029effd700 1 -- 172.21.15.118:0/1330944633 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b000dcd0 con 0x7f02b814c200 2023-09-28T04:22:58.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.918+0000 7f029effd700 1 -- 172.21.15.118:0/1330944633 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b0006dd0 con 0x7f02b814c200 2023-09-28T04:22:58.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.918+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1330944633 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b8169790 con 0x7f02b814c200 2023-09-28T04:22:58.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.918+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1330944633 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b80b1900 con 0x7f02b814c200 2023-09-28T04:22:58.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.918+0000 7f029effd700 1 -- 172.21.15.118:0/1330944633 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f02b0013600 con 0x7f02b814c200 2023-09-28T04:22:58.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.919+0000 7f029effd700 1 -- 172.21.15.118:0/1330944633 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f02b001d7b0 con 0x7f02b814c200 2023-09-28T04:22:58.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.920+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1330944633 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b8071980 con 0x7f02b814c200 2023-09-28T04:22:58.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:58.922+0000 7f029effd700 1 -- 172.21.15.118:0/1330944633 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f02b000de40 con 0x7f02b814c200 2023-09-28T04:22:59.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:59.028+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1330944633 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f02b81505e0 con 0x7f02b814c200 2023-09-28T04:22:59.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:59.032+0000 7f029effd700 1 -- 172.21.15.118:0/1330944633 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f02b0013a40 con 0x7f02b814c200 2023-09-28T04:22:59.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:59.033+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1330944633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02b814c200 msgr2=0x7f02b814c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:22:59.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:59.033+0000 7f02bd3ff700 1 --2- 172.21.15.118:0/1330944633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02b814c200 0x7f02b814c670 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f02a0004790 tx=0x7f02b0002e30 comp rx=0 tx=0).stop 2023-09-28T04:22:59.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:59.034+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1330944633 shutdown_connections 2023-09-28T04:22:59.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:59.034+0000 7f02bd3ff700 1 --2- 172.21.15.118:0/1330944633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02b814c200 0x7f02b814c670 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:59.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:59.034+0000 7f02bd3ff700 1 --2- 172.21.15.118:0/1330944633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a0004810 0x7f02b8168c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:59.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:59.034+0000 7f02bd3ff700 1 --2- 172.21.15.118:0/1330944633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f02b8152940 0x7f02b81691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:59.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:59.034+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1330944633 >> 172.21.15.118:0/1330944633 conn(0x7f02b80688e0 msgr2=0x7f02b80c6490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:22:59.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:59.034+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1330944633 shutdown_connections 2023-09-28T04:22:59.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:22:59.034+0000 7f02bd3ff700 1 -- 172.21.15.118:0/1330944633 wait complete. 2023-09-28T04:22:59.035 INFO:teuthology.orchestra.run.smithi118.stderr:adjusted tunables profile to default 2023-09-28T04:22:59.058 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-28T04:22:59.058 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:59.058 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-28T04:22:59.095 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:22:59.094+0000 7f8955c6a1c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-28T04:22:59.109 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:22:59.109+0000 7f0560e251c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-28T04:22:59.126 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:59.126 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-28T04:22:59.268 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:59.268 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-28T04:22:59.272 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:22:59.272+0000 7f0560e251c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-28T04:22:59.303 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:22:59.303+0000 7f8955c6a1c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-28T04:22:59.339 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-09-28T04:22:59.340 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-28T04:22:59.449 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:59.449 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-09-28T04:22:59.477 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:59.477 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-09-28T04:22:59.545 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:59.545 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-09-28T04:22:59.612 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-09-28T04:22:59.613 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-09-28T04:22:59.636 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:22:59.636+0000 7f0560e251c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-28T04:22:59.663 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 5f03ec78-88be-455a-b631-23a0f43dcadb 0 2023-09-28T04:22:59.724 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:22:59.724+0000 7f8955c6a1c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-28T04:22:59.822 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.822+0000 7f22ca4b3700 1 Processor -- start 2023-09-28T04:22:59.822 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.822+0000 7f22ca4b3700 1 -- start start 2023-09-28T04:22:59.828 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22ca4b3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f22c406e600 0x7f22c40c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:22:59.829 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22ca4b3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22c4157600 0x7f22c414cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:22:59.829 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22ca4b3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c40c9b60 con 0x7f22c406cd10 2023-09-28T04:22:59.829 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22ca4b3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c40c54d0 con 0x7f22c406e600 2023-09-28T04:22:59.829 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22ca4b3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c40c9880 con 0x7f22c4157600 2023-09-28T04:22:59.829 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22c8a50700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22c4157600 0x7f22c414cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:22:59.829 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22c3fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f22c406cd10 0x7f22c4156ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:55072/0 (socket says 172.21.15.174:55072) 2023-09-28T04:22:59.829 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22c3fff700 1 -- 172.21.15.174:0/1762036730 learned_addr learned my addr 172.21.15.174:0/1762036730 (peer_addr_for_me v1:172.21.15.174:0/0) 2023-09-28T04:22:59.830 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22c37fe700 1 --2- 172.21.15.174:0/1762036730 >> v2:172.21.15.118:3300/0 conn(0x7f22c406e600 0x7f22c40c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:22:59.830 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22c8a50700 1 -- 172.21.15.174:0/1762036730 >> v2:172.21.15.118:3300/0 conn(0x7f22c406e600 msgr2=0x7f22c40c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:22:59.830 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22c8a50700 1 --2- 172.21.15.174:0/1762036730 >> v2:172.21.15.118:3300/0 conn(0x7f22c406e600 0x7f22c40c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:59.830 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22c8a50700 1 -- 172.21.15.174:0/1762036730 >> v1:172.21.15.174:6789/0 conn(0x7f22c406cd10 legacy=0x7f22c4156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:22:59.830 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22c8a50700 1 -- 172.21.15.174:0/1762036730 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c40c4f10 con 0x7f22c4157600 2023-09-28T04:22:59.830 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22c8a50700 1 --2- 172.21.15.174:0/1762036730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c4157600 0x7f22c414cee0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f22c40c4990 tx=0x7f22bc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65bd0a6924fa6df4 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:22:59.830 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22c2ffd700 1 -- 172.21.15.174:0/1762036730 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00e070 con 0x7f22c4157600 2023-09-28T04:22:59.830 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22c2ffd700 1 -- 172.21.15.174:0/1762036730 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc00bcc0 con 0x7f22c4157600 2023-09-28T04:22:59.831 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.823+0000 7f22c2ffd700 1 -- 172.21.15.174:0/1762036730 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc012680 con 0x7f22c4157600 2023-09-28T04:22:59.831 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.824+0000 7f22ca4b3700 1 -- 172.21.15.174:0/1762036730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c4157600 msgr2=0x7f22c414cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:22:59.831 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.824+0000 7f22ca4b3700 1 --2- 172.21.15.174:0/1762036730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c4157600 0x7f22c414cee0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f22c40c4990 tx=0x7f22bc009780 comp rx=0 tx=0).stop 2023-09-28T04:22:59.831 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.824+0000 7f22ca4b3700 1 -- 172.21.15.174:0/1762036730 shutdown_connections 2023-09-28T04:22:59.831 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.824+0000 7f22ca4b3700 1 --2- 172.21.15.174:0/1762036730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c4157600 0x7f22c414cee0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:59.831 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.824+0000 7f22ca4b3700 1 --2- 172.21.15.174:0/1762036730 >> v2:172.21.15.118:3300/0 conn(0x7f22c406e600 0x7f22c40c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:59.831 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.824+0000 7f22ca4b3700 1 -- 172.21.15.174:0/1762036730 >> 172.21.15.174:0/1762036730 conn(0x7f22c4069210 msgr2=0x7f22c40c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:22:59.831 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.824+0000 7f22ca4b3700 1 -- 172.21.15.174:0/1762036730 shutdown_connections 2023-09-28T04:22:59.831 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.824+0000 7f22ca4b3700 1 -- 172.21.15.174:0/1762036730 wait complete. 2023-09-28T04:22:59.831 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.825+0000 7f22ca4b3700 1 Processor -- start 2023-09-28T04:22:59.832 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.825+0000 7f22ca4b3700 1 -- start start 2023-09-28T04:22:59.832 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22ca4b3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22c406cd10 0x7f22c40c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:22:59.832 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22ca4b3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22c406e600 0x7f22c415a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:22:59.832 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22ca4b3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c4157600 0x7f22c40c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:22:59.832 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22ca4b3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4169250 con 0x7f22c406cd10 2023-09-28T04:22:59.832 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22ca4b3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4147580 con 0x7f22c4157600 2023-09-28T04:22:59.832 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22ca4b3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4168d00 con 0x7f22c406e600 2023-09-28T04:22:59.833 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22c37fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22c406e600 0x7f22c415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:22:59.833 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22c8a50700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c4157600 0x7f22c40c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:22:59.833 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22c37fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22c406e600 0x7f22c415a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34926/0 (socket says 172.21.15.174:34926) 2023-09-28T04:22:59.833 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22c37fe700 1 -- 172.21.15.174:0/3773242465 learned_addr learned my addr 172.21.15.174:0/3773242465 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-09-28T04:22:59.833 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22c3fff700 1 --2- 172.21.15.174:0/3773242465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22c406cd10 0x7f22c40c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:22:59.833 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22c37fe700 1 -- 172.21.15.174:0/3773242465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c4157600 msgr2=0x7f22c40c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:22:59.833 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22c37fe700 1 --2- 172.21.15.174:0/3773242465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c4157600 0x7f22c40c15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:59.833 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22c37fe700 1 -- 172.21.15.174:0/3773242465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22c406cd10 msgr2=0x7f22c40c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:22:59.834 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22c37fe700 1 --2- 172.21.15.174:0/3773242465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22c406cd10 0x7f22c40c0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:59.834 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.826+0000 7f22c37fe700 1 -- 172.21.15.174:0/3773242465 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc009a20 con 0x7f22c406e600 2023-09-28T04:22:59.834 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.827+0000 7f22c37fe700 1 --2- 172.21.15.174:0/3773242465 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22c406e600 0x7f22c415a670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f22b800d8c0 tx=0x7f22b8008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:22:59.834 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.827+0000 7f22abfff700 1 -- 172.21.15.174:0/3773242465 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8012630 con 0x7f22c406e600 2023-09-28T04:22:59.834 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.827+0000 7f22abfff700 1 -- 172.21.15.174:0/3773242465 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b8012790 con 0x7f22c406e600 2023-09-28T04:22:59.834 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.827+0000 7f22abfff700 1 -- 172.21.15.174:0/3773242465 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8012b30 con 0x7f22c406e600 2023-09-28T04:22:59.834 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.827+0000 7f22ca4b3700 1 -- 172.21.15.174:0/3773242465 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c4149410 con 0x7f22c406e600 2023-09-28T04:22:59.834 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.827+0000 7f22ca4b3700 1 -- 172.21.15.174:0/3773242465 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c4149110 con 0x7f22c406e600 2023-09-28T04:22:59.834 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.828+0000 7f22abfff700 1 -- 172.21.15.174:0/3773242465 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f22b801d400 con 0x7f22c406e600 2023-09-28T04:22:59.834 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.828+0000 7f22abfff700 1 -- 172.21.15.174:0/3773242465 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f22b8014740 con 0x7f22c406e600 2023-09-28T04:22:59.835 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.828+0000 7f22ca4b3700 1 -- 172.21.15.174:0/3773242465 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c41476c0 con 0x7f22c406e600 2023-09-28T04:22:59.835 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.830+0000 7f22abfff700 1 -- 172.21.15.174:0/3773242465 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f22c41476c0 con 0x7f22c406e600 2023-09-28T04:22:59.913 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.913+0000 7f22ca4b3700 1 -- 172.21.15.174:0/3773242465 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5f03ec78-88be-455a-b631-23a0f43dcadb", "id": 0} v 0) v1 -- 0x7f22c40bf0d0 con 0x7f22c406e600 2023-09-28T04:22:59.917 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.916+0000 7f22abfff700 1 -- 172.21.15.174:0/3773242465 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f03ec78-88be-455a-b631-23a0f43dcadb", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f22b801d7f0 con 0x7f22c406e600 2023-09-28T04:22:59.917 INFO:teuthology.orchestra.run.smithi174.stdout:0 2023-09-28T04:22:59.918 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.917+0000 7f22ca4b3700 1 -- 172.21.15.174:0/3773242465 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22c406e600 msgr2=0x7f22c415a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:22:59.918 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.917+0000 7f22ca4b3700 1 --2- 172.21.15.174:0/3773242465 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22c406e600 0x7f22c415a670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f22b800d8c0 tx=0x7f22b8008040 comp rx=0 tx=0).stop 2023-09-28T04:22:59.918 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.917+0000 7f22ca4b3700 1 -- 172.21.15.174:0/3773242465 shutdown_connections 2023-09-28T04:22:59.918 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.918+0000 7f22ca4b3700 1 --2- 172.21.15.174:0/3773242465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c4157600 0x7f22c40c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:59.918 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.918+0000 7f22ca4b3700 1 --2- 172.21.15.174:0/3773242465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22c406cd10 0x7f22c40c0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:59.918 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.918+0000 7f22ca4b3700 1 --2- 172.21.15.174:0/3773242465 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22c406e600 0x7f22c415a670 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:22:59.918 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.918+0000 7f22ca4b3700 1 -- 172.21.15.174:0/3773242465 >> 172.21.15.174:0/3773242465 conn(0x7f22c4069210 msgr2=0x7f22c4153f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:22:59.918 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.918+0000 7f22ca4b3700 1 -- 172.21.15.174:0/3773242465 shutdown_connections 2023-09-28T04:22:59.919 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:22:59.918+0000 7f22ca4b3700 1 -- 172.21.15.174:0/3773242465 wait complete. 2023-09-28T04:22:59.930 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new f3f70643-751b-4f1a-a043-b0cca861e209 1 2023-09-28T04:23:00.049 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.049+0000 7ff57bb2d700 1 Processor -- start 2023-09-28T04:23:00.049 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.049+0000 7ff57bb2d700 1 -- start start 2023-09-28T04:23:00.051 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff57bb2d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff5740c8a20 0x7ff5740c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.052 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff57bb2d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff5740c8df0 0x7ff57414f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.052 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff57bb2d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5740c8650 con 0x7ff5740c7be0 2023-09-28T04:23:00.052 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff57bb2d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5740ad940 con 0x7ff5740c8df0 2023-09-28T04:23:00.052 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff57bb2d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5741561e0 con 0x7ff5740c8a20 2023-09-28T04:23:00.052 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff5798c9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff5740c8a20 0x7ff5740c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.052 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff5798c9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff5740c8a20 0x7ff5740c6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:44606/0 (socket says 172.21.15.174:44606) 2023-09-28T04:23:00.052 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff5798c9700 1 -- 172.21.15.174:0/3715367242 learned_addr learned my addr 172.21.15.174:0/3715367242 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-09-28T04:23:00.052 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff57a0ca700 1 --2- 172.21.15.174:0/3715367242 >> v2:172.21.15.118:3300/0 conn(0x7ff5740c8df0 0x7ff57414f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.052 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff5798c9700 1 -- 172.21.15.174:0/3715367242 >> v2:172.21.15.118:3300/0 conn(0x7ff5740c8df0 msgr2=0x7ff57414f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:00.052 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff5798c9700 1 --2- 172.21.15.174:0/3715367242 >> v2:172.21.15.118:3300/0 conn(0x7ff5740c8df0 0x7ff57414f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.053 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff5798c9700 1 -- 172.21.15.174:0/3715367242 >> v1:172.21.15.118:6789/0 conn(0x7ff5740c7be0 legacy=0x7ff574155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:00.053 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff5798c9700 1 -- 172.21.15.174:0/3715367242 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5741564c0 con 0x7ff5740c8a20 2023-09-28T04:23:00.053 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff57a0ca700 1 --2- 172.21.15.174:0/3715367242 >> v2:172.21.15.118:3300/0 conn(0x7ff5740c8df0 0x7ff57414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T04:23:00.053 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff5798c9700 1 --2- 172.21.15.174:0/3715367242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5740c8a20 0x7ff5740c6880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff574089740 tx=0x7ff564009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3519c8ea0b448b68 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:00.053 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff5788c7700 1 -- 172.21.15.174:0/3715367242 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400e070 con 0x7ff5740c8a20 2023-09-28T04:23:00.053 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff5788c7700 1 -- 172.21.15.174:0/3715367242 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56400ba10 con 0x7ff5740c8a20 2023-09-28T04:23:00.053 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.050+0000 7ff5788c7700 1 -- 172.21.15.174:0/3715367242 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640092e0 con 0x7ff5740c8a20 2023-09-28T04:23:00.053 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.051+0000 7ff57bb2d700 1 -- 172.21.15.174:0/3715367242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5740c8a20 msgr2=0x7ff5740c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.053 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.051+0000 7ff57bb2d700 1 --2- 172.21.15.174:0/3715367242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5740c8a20 0x7ff5740c6880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff574089740 tx=0x7ff564009840 comp rx=0 tx=0).stop 2023-09-28T04:23:00.053 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.051+0000 7ff57bb2d700 1 -- 172.21.15.174:0/3715367242 shutdown_connections 2023-09-28T04:23:00.053 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.051+0000 7ff57bb2d700 1 --2- 172.21.15.174:0/3715367242 >> v2:172.21.15.118:3300/0 conn(0x7ff5740c8df0 0x7ff57414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.053 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.051+0000 7ff57bb2d700 1 --2- 172.21.15.174:0/3715367242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5740c8a20 0x7ff5740c6880 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.054 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.051+0000 7ff57bb2d700 1 -- 172.21.15.174:0/3715367242 >> 172.21.15.174:0/3715367242 conn(0x7ff574063230 msgr2=0x7ff574063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:00.054 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.051+0000 7ff57bb2d700 1 -- 172.21.15.174:0/3715367242 shutdown_connections 2023-09-28T04:23:00.054 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.051+0000 7ff57bb2d700 1 -- 172.21.15.174:0/3715367242 wait complete. 2023-09-28T04:23:00.056 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.052+0000 7ff57bb2d700 1 Processor -- start 2023-09-28T04:23:00.057 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.052+0000 7ff57bb2d700 1 -- start start 2023-09-28T04:23:00.057 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff57bb2d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5740c7be0 0x7ff5741697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.057 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff57bb2d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5740c8a20 0x7ff574166230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.057 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff57bb2d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5740c8df0 0x7ff5741536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.057 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff57bb2d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5740a7870 con 0x7ff5740c7be0 2023-09-28T04:23:00.057 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff57bb2d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5740cc7b0 con 0x7ff5740c8df0 2023-09-28T04:23:00.057 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff57bb2d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff574165da0 con 0x7ff5740c8a20 2023-09-28T04:23:00.057 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff5790c8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5740c8a20 0x7ff574166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.057 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff57a0ca700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5740c8df0 0x7ff5741536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.057 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff5790c8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5740c8a20 0x7ff574166230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34928/0 (socket says 172.21.15.174:34928) 2023-09-28T04:23:00.058 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff5790c8700 1 -- 172.21.15.174:0/2022630462 learned_addr learned my addr 172.21.15.174:0/2022630462 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-09-28T04:23:00.058 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff5798c9700 1 --2- 172.21.15.174:0/2022630462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5740c7be0 0x7ff5741697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.058 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff5790c8700 1 -- 172.21.15.174:0/2022630462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5740c8df0 msgr2=0x7ff5741536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.058 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff5790c8700 1 --2- 172.21.15.174:0/2022630462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5740c8df0 0x7ff5741536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.058 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff5790c8700 1 -- 172.21.15.174:0/2022630462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5740c7be0 msgr2=0x7ff5741697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.058 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff5790c8700 1 --2- 172.21.15.174:0/2022630462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5740c7be0 0x7ff5741697d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.058 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff5790c8700 1 -- 172.21.15.174:0/2022630462 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009ae0 con 0x7ff5740c8a20 2023-09-28T04:23:00.058 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff57a0ca700 1 --2- 172.21.15.174:0/2022630462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5740c8df0 0x7ff5741536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:00.059 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.053+0000 7ff5790c8700 1 --2- 172.21.15.174:0/2022630462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5740c8a20 0x7ff574166230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff56800b5e0 tx=0x7ff5680090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:00.059 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.054+0000 7ff571ffb700 1 -- 172.21.15.174:0/2022630462 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56800f510 con 0x7ff5740c8a20 2023-09-28T04:23:00.059 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.054+0000 7ff571ffb700 1 -- 172.21.15.174:0/2022630462 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56800f690 con 0x7ff5740c8a20 2023-09-28T04:23:00.059 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.054+0000 7ff57bb2d700 1 -- 172.21.15.174:0/2022630462 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff574166770 con 0x7ff5740c8a20 2023-09-28T04:23:00.059 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.054+0000 7ff571ffb700 1 -- 172.21.15.174:0/2022630462 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56800fa50 con 0x7ff5740c8a20 2023-09-28T04:23:00.059 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.054+0000 7ff57bb2d700 1 -- 172.21.15.174:0/2022630462 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5740cbf10 con 0x7ff5740c8a20 2023-09-28T04:23:00.059 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.054+0000 7ff571ffb700 1 -- 172.21.15.174:0/2022630462 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff56801a680 con 0x7ff5740c8a20 2023-09-28T04:23:00.059 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.054+0000 7ff571ffb700 1 -- 172.21.15.174:0/2022630462 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7ff5680117e0 con 0x7ff5740c8a20 2023-09-28T04:23:00.059 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.055+0000 7ff57bb2d700 1 -- 172.21.15.174:0/2022630462 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff574071980 con 0x7ff5740c8a20 2023-09-28T04:23:00.060 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.057+0000 7ff571ffb700 1 -- 172.21.15.174:0/2022630462 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7ff56801a930 con 0x7ff5740c8a20 2023-09-28T04:23:00.139 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.139+0000 7ff57bb2d700 1 -- 172.21.15.174:0/2022630462 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f3f70643-751b-4f1a-a043-b0cca861e209", "id": 1} v 0) v1 -- 0x7ff574165ee0 con 0x7ff5740c8a20 2023-09-28T04:23:00.143 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.143+0000 7ff571ffb700 1 -- 172.21.15.174:0/2022630462 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f3f70643-751b-4f1a-a043-b0cca861e209", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff56801aad0 con 0x7ff5740c8a20 2023-09-28T04:23:00.143 INFO:teuthology.orchestra.run.smithi174.stdout:1 2023-09-28T04:23:00.144 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.144+0000 7ff57bb2d700 1 -- 172.21.15.174:0/2022630462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5740c8a20 msgr2=0x7ff574166230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.144 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.144+0000 7ff57bb2d700 1 --2- 172.21.15.174:0/2022630462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5740c8a20 0x7ff574166230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff56800b5e0 tx=0x7ff5680090f0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.145 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.144+0000 7ff57bb2d700 1 -- 172.21.15.174:0/2022630462 shutdown_connections 2023-09-28T04:23:00.145 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.144+0000 7ff57bb2d700 1 --2- 172.21.15.174:0/2022630462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5740c8df0 0x7ff5741536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.145 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.144+0000 7ff57bb2d700 1 --2- 172.21.15.174:0/2022630462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5740c7be0 0x7ff5741697d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.145 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.144+0000 7ff57bb2d700 1 --2- 172.21.15.174:0/2022630462 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff5740c8a20 0x7ff574166230 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.145 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.144+0000 7ff57bb2d700 1 -- 172.21.15.174:0/2022630462 >> 172.21.15.174:0/2022630462 conn(0x7ff574063230 msgr2=0x7ff5740c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:00.145 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.144+0000 7ff57bb2d700 1 -- 172.21.15.174:0/2022630462 shutdown_connections 2023-09-28T04:23:00.145 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.144+0000 7ff57bb2d700 1 -- 172.21.15.174:0/2022630462 wait complete. 2023-09-28T04:23:00.156 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new cb071ef8-411c-4647-826f-b032f9c2f3c9 2 2023-09-28T04:23:00.171 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:00.171+0000 7f0560e251c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-28T04:23:00.274 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.274+0000 7ff317f20700 1 Processor -- start 2023-09-28T04:23:00.275 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.274+0000 7ff317f20700 1 -- start start 2023-09-28T04:23:00.277 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.276+0000 7ff317f20700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff310068740 0x7ff31006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.277 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.276+0000 7ff317f20700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31006cab0 con 0x7ff31006c0e0 2023-09-28T04:23:00.277 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.276+0000 7ff317f20700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3100c1aa0 con 0x7ff3100c5a60 2023-09-28T04:23:00.278 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.276+0000 7ff317f20700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3100bbd80 con 0x7ff310068740 2023-09-28T04:23:00.278 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.276+0000 7ff3154bb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff310068740 0x7ff31006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.278 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.276+0000 7ff3164bd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff3100c5a60 0x7ff3101528c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:55084/0 (socket says 172.21.15.174:55084) 2023-09-28T04:23:00.278 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.276+0000 7ff3154bb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff310068740 0x7ff31006c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:44610/0 (socket says 172.21.15.174:44610) 2023-09-28T04:23:00.278 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.276+0000 7ff3164bd700 1 -- 172.21.15.174:0/3360741965 learned_addr learned my addr 172.21.15.174:0/3360741965 (peer_addr_for_me v1:172.21.15.174:0/0) 2023-09-28T04:23:00.278 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.276+0000 7ff3154bb700 1 -- 172.21.15.174:0/3360741965 >> v1:172.21.15.174:6789/0 conn(0x7ff3100c5a60 legacy=0x7ff3101528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.279 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.276+0000 7ff3154bb700 1 -- 172.21.15.174:0/3360741965 >> v1:172.21.15.118:6789/0 conn(0x7ff31006c0e0 legacy=0x7ff310153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.279 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.276+0000 7ff314cba700 1 -- 172.21.15.174:0/3360741965 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173236748 0 0) 0x7ff3100c1aa0 con 0x7ff3100c5a60 2023-09-28T04:23:00.279 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.276+0000 7ff3154bb700 1 -- 172.21.15.174:0/3360741965 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3100632d0 con 0x7ff310068740 2023-09-28T04:23:00.279 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.276+0000 7ff3154bb700 1 --2- 172.21.15.174:0/3360741965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff310068740 0x7ff31006c4b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff3000098d0 tx=0x7ff300009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8906988bfc2671c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:00.279 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.277+0000 7ff314cba700 1 -- 172.21.15.174:0/3360741965 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300009e70 con 0x7ff310068740 2023-09-28T04:23:00.279 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.277+0000 7ff314cba700 1 -- 172.21.15.174:0/3360741965 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff300005c10 con 0x7ff310068740 2023-09-28T04:23:00.279 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.277+0000 7ff314cba700 1 -- 172.21.15.174:0/3360741965 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30000b6e0 con 0x7ff310068740 2023-09-28T04:23:00.282 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.277+0000 7ff317f20700 1 -- 172.21.15.174:0/3360741965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff310068740 msgr2=0x7ff31006c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.283 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.277+0000 7ff317f20700 1 --2- 172.21.15.174:0/3360741965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff310068740 0x7ff31006c4b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff3000098d0 tx=0x7ff300009120 comp rx=0 tx=0).stop 2023-09-28T04:23:00.283 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.277+0000 7ff317f20700 1 -- 172.21.15.174:0/3360741965 shutdown_connections 2023-09-28T04:23:00.283 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.277+0000 7ff317f20700 1 --2- 172.21.15.174:0/3360741965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff310068740 0x7ff31006c4b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.283 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.277+0000 7ff317f20700 1 -- 172.21.15.174:0/3360741965 >> 172.21.15.174:0/3360741965 conn(0x7ff31006a2e0 msgr2=0x7ff31006a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:00.283 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.278+0000 7ff317f20700 1 -- 172.21.15.174:0/3360741965 shutdown_connections 2023-09-28T04:23:00.283 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.278+0000 7ff317f20700 1 -- 172.21.15.174:0/3360741965 wait complete. 2023-09-28T04:23:00.283 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.279+0000 7ff317f20700 1 Processor -- start 2023-09-28T04:23:00.284 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.279+0000 7ff317f20700 1 -- start start 2023-09-28T04:23:00.284 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.279+0000 7ff317f20700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff310068740 0x7ff3101590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.284 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.279+0000 7ff317f20700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff31006c0e0 0x7ff3101483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.284 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.279+0000 7ff317f20700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3100c5a60 0x7ff310067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.284 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.279+0000 7ff317f20700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31014a7f0 con 0x7ff3100c5a60 2023-09-28T04:23:00.284 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.279+0000 7ff317f20700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3100c8180 con 0x7ff31006c0e0 2023-09-28T04:23:00.285 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.279+0000 7ff317f20700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31014b3b0 con 0x7ff310068740 2023-09-28T04:23:00.285 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff3154bb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff31006c0e0 0x7ff3101483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.285 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff3154bb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff31006c0e0 0x7ff3101483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:44614/0 (socket says 172.21.15.174:44614) 2023-09-28T04:23:00.285 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff3154bb700 1 -- 172.21.15.174:0/1550785701 learned_addr learned my addr 172.21.15.174:0/1550785701 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-09-28T04:23:00.285 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff315cbc700 1 --2- 172.21.15.174:0/1550785701 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff310068740 0x7ff3101590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.285 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff3164bd700 1 --2- 172.21.15.174:0/1550785701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3100c5a60 0x7ff310067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.285 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff3154bb700 1 -- 172.21.15.174:0/1550785701 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff310068740 msgr2=0x7ff3101590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.286 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff3154bb700 1 --2- 172.21.15.174:0/1550785701 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff310068740 0x7ff3101590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.286 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff3154bb700 1 -- 172.21.15.174:0/1550785701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3100c5a60 msgr2=0x7ff310067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.286 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff3154bb700 1 --2- 172.21.15.174:0/1550785701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3100c5a60 0x7ff310067630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.286 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff3154bb700 1 -- 172.21.15.174:0/1550785701 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3000093c0 con 0x7ff31006c0e0 2023-09-28T04:23:00.286 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff3164bd700 1 --2- 172.21.15.174:0/1550785701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3100c5a60 0x7ff310067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:00.286 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff3154bb700 1 --2- 172.21.15.174:0/1550785701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff31006c0e0 0x7ff3101483d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff31006bbb0 tx=0x7ff300016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:00.286 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff305ffb700 1 -- 172.21.15.174:0/1550785701 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300006460 con 0x7ff31006c0e0 2023-09-28T04:23:00.287 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff305ffb700 1 -- 172.21.15.174:0/1550785701 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3000065c0 con 0x7ff31006c0e0 2023-09-28T04:23:00.287 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff317f20700 1 -- 172.21.15.174:0/1550785701 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31014a530 con 0x7ff31006c0e0 2023-09-28T04:23:00.287 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff305ffb700 1 -- 172.21.15.174:0/1550785701 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30001b480 con 0x7ff31006c0e0 2023-09-28T04:23:00.287 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.280+0000 7ff317f20700 1 -- 172.21.15.174:0/1550785701 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3100c4b40 con 0x7ff31006c0e0 2023-09-28T04:23:00.287 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.281+0000 7ff305ffb700 1 -- 172.21.15.174:0/1550785701 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff30001bab0 con 0x7ff31006c0e0 2023-09-28T04:23:00.287 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.281+0000 7ff305ffb700 1 -- 172.21.15.174:0/1550785701 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7ff3000269b0 con 0x7ff31006c0e0 2023-09-28T04:23:00.287 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.281+0000 7ff317f20700 1 -- 172.21.15.174:0/1550785701 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31014afe0 con 0x7ff31006c0e0 2023-09-28T04:23:00.288 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.283+0000 7ff305ffb700 1 -- 172.21.15.174:0/1550785701 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7ff31014afe0 con 0x7ff31006c0e0 2023-09-28T04:23:00.317 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:00.316+0000 7f0560e251c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-28T04:23:00.347 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:00.347+0000 7f8955c6a1c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-28T04:23:00.366 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.366+0000 7ff317f20700 1 -- 172.21.15.174:0/1550785701 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cb071ef8-411c-4647-826f-b032f9c2f3c9", "id": 2} v 0) v1 -- 0x7ff310071980 con 0x7ff31006c0e0 2023-09-28T04:23:00.370 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.370+0000 7ff305ffb700 1 -- 172.21.15.174:0/1550785701 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb071ef8-411c-4647-826f-b032f9c2f3c9", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff30002c060 con 0x7ff31006c0e0 2023-09-28T04:23:00.371 INFO:teuthology.orchestra.run.smithi174.stdout:2 2023-09-28T04:23:00.372 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.371+0000 7ff317f20700 1 -- 172.21.15.174:0/1550785701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff31006c0e0 msgr2=0x7ff3101483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.372 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.371+0000 7ff317f20700 1 --2- 172.21.15.174:0/1550785701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff31006c0e0 0x7ff3101483d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff31006bbb0 tx=0x7ff300016000 comp rx=0 tx=0).stop 2023-09-28T04:23:00.372 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.371+0000 7ff317f20700 1 -- 172.21.15.174:0/1550785701 shutdown_connections 2023-09-28T04:23:00.372 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.371+0000 7ff317f20700 1 --2- 172.21.15.174:0/1550785701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3100c5a60 0x7ff310067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.372 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.371+0000 7ff317f20700 1 --2- 172.21.15.174:0/1550785701 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff310068740 0x7ff3101590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.373 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.371+0000 7ff317f20700 1 --2- 172.21.15.174:0/1550785701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff31006c0e0 0x7ff3101483d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.373 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.371+0000 7ff317f20700 1 -- 172.21.15.174:0/1550785701 >> 172.21.15.174:0/1550785701 conn(0x7ff31006a2e0 msgr2=0x7ff310153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:00.373 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.372+0000 7ff317f20700 1 -- 172.21.15.174:0/1550785701 shutdown_connections 2023-09-28T04:23:00.373 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.372+0000 7ff317f20700 1 -- 172.21.15.174:0/1550785701 wait complete. 2023-09-28T04:23:00.383 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 8b4858ee-61f7-4888-b06d-691c0ab2fe37 3 2023-09-28T04:23:00.515 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:00.515+0000 7f8955c6a1c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-28T04:23:00.541 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.541+0000 7fdf8bb71700 1 Processor -- start 2023-09-28T04:23:00.542 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.542+0000 7fdf8bb71700 1 -- start start 2023-09-28T04:23:00.544 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.542+0000 7fdf8bb71700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdf8406d950 0x7fdf840ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.544 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.542+0000 7fdf8bb71700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf840ca990 0x7fdf8406c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.544 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.542+0000 7fdf8bb71700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf8406c8b0 0x7fdf84158d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.544 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.542+0000 7fdf8bb71700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8406bee0 con 0x7fdf8406d950 2023-09-28T04:23:00.544 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.542+0000 7fdf8bb71700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8406bc00 con 0x7fdf8406c8b0 2023-09-28T04:23:00.544 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.542+0000 7fdf8bb71700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf840c4bb0 con 0x7fdf840ca990 2023-09-28T04:23:00.544 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.542+0000 7fdf8a10e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf8406c8b0 0x7fdf84158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.544 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.542+0000 7fdf8910c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf840ca990 0x7fdf8406c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.544 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8a10e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf8406c8b0 0x7fdf84158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:44622/0 (socket says 172.21.15.174:44622) 2023-09-28T04:23:00.544 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8910c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf840ca990 0x7fdf8406c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34946/0 (socket says 172.21.15.174:34946) 2023-09-28T04:23:00.545 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8a10e700 1 -- 172.21.15.174:0/4210980830 learned_addr learned my addr 172.21.15.174:0/4210980830 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-09-28T04:23:00.545 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8990d700 1 --2- 172.21.15.174:0/4210980830 >> v2:172.21.15.118:3300/0 conn(0x7fdf8406d950 0x7fdf840ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.545 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8910c700 1 -- 172.21.15.174:0/4210980830 >> v2:172.21.15.174:3300/0 conn(0x7fdf8406c8b0 msgr2=0x7fdf84158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:00.545 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8910c700 1 --2- 172.21.15.174:0/4210980830 >> v2:172.21.15.174:3300/0 conn(0x7fdf8406c8b0 0x7fdf84158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.545 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8910c700 1 -- 172.21.15.174:0/4210980830 >> v2:172.21.15.118:3300/0 conn(0x7fdf8406d950 msgr2=0x7fdf840ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:00.545 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8910c700 1 --2- 172.21.15.174:0/4210980830 >> v2:172.21.15.118:3300/0 conn(0x7fdf8406d950 0x7fdf840ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.545 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8910c700 1 -- 172.21.15.174:0/4210980830 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf84155c60 con 0x7fdf840ca990 2023-09-28T04:23:00.545 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8a10e700 1 --2- 172.21.15.174:0/4210980830 >> v2:172.21.15.174:3300/0 conn(0x7fdf8406c8b0 0x7fdf84158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:00.545 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8910c700 1 --2- 172.21.15.174:0/4210980830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf840ca990 0x7fdf8406c370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdf840c4970 tx=0x7fdf740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cae88bf126d82749 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:00.545 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8890b700 1 -- 172.21.15.174:0/4210980830 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400b690 con 0x7fdf840ca990 2023-09-28T04:23:00.545 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8890b700 1 -- 172.21.15.174:0/4210980830 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7400b7f0 con 0x7fdf840ca990 2023-09-28T04:23:00.545 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.543+0000 7fdf8890b700 1 -- 172.21.15.174:0/4210980830 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400bb90 con 0x7fdf840ca990 2023-09-28T04:23:00.547 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.544+0000 7fdf8bb71700 1 -- 172.21.15.174:0/4210980830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf840ca990 msgr2=0x7fdf8406c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.547 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.544+0000 7fdf8bb71700 1 --2- 172.21.15.174:0/4210980830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf840ca990 0x7fdf8406c370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdf840c4970 tx=0x7fdf740091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.547 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.544+0000 7fdf8bb71700 1 -- 172.21.15.174:0/4210980830 shutdown_connections 2023-09-28T04:23:00.547 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.544+0000 7fdf8bb71700 1 --2- 172.21.15.174:0/4210980830 >> v2:172.21.15.174:3300/0 conn(0x7fdf8406c8b0 0x7fdf84158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.547 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.544+0000 7fdf8bb71700 1 --2- 172.21.15.174:0/4210980830 >> v2:172.21.15.118:3300/0 conn(0x7fdf8406d950 0x7fdf840ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.547 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.544+0000 7fdf8bb71700 1 --2- 172.21.15.174:0/4210980830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf840ca990 0x7fdf8406c370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.547 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.544+0000 7fdf8bb71700 1 -- 172.21.15.174:0/4210980830 >> 172.21.15.174:0/4210980830 conn(0x7fdf84063d00 msgr2=0x7fdf840c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:00.547 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.544+0000 7fdf8bb71700 1 -- 172.21.15.174:0/4210980830 shutdown_connections 2023-09-28T04:23:00.547 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.544+0000 7fdf8bb71700 1 -- 172.21.15.174:0/4210980830 wait complete. 2023-09-28T04:23:00.547 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.546+0000 7fdf8bb71700 1 Processor -- start 2023-09-28T04:23:00.547 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.546+0000 7fdf8bb71700 1 -- start start 2023-09-28T04:23:00.549 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.547+0000 7fdf8bb71700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf8406c8b0 0x7fdf84165ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.550 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.547+0000 7fdf8bb71700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf8406d950 0x7fdf8415c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.550 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.547+0000 7fdf8bb71700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf840ca990 0x7fdf8415b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.550 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.547+0000 7fdf8bb71700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf841597b0 con 0x7fdf8406d950 2023-09-28T04:23:00.550 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.547+0000 7fdf8bb71700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8415c3b0 con 0x7fdf840ca990 2023-09-28T04:23:00.550 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.547+0000 7fdf8bb71700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf84158c50 con 0x7fdf8406c8b0 2023-09-28T04:23:00.550 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.547+0000 7fdf8990d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf8406c8b0 0x7fdf84165ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.550 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.547+0000 7fdf8990d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf8406c8b0 0x7fdf84165ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34952/0 (socket says 172.21.15.174:34952) 2023-09-28T04:23:00.550 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.547+0000 7fdf8990d700 1 -- 172.21.15.174:0/3155454170 learned_addr learned my addr 172.21.15.174:0/3155454170 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-09-28T04:23:00.550 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.547+0000 7fdf8a10e700 1 --2- 172.21.15.174:0/3155454170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf840ca990 0x7fdf8415b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.550 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.547+0000 7fdf8910c700 1 --2- 172.21.15.174:0/3155454170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf8406d950 0x7fdf8415c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.550 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.547+0000 7fdf8990d700 1 -- 172.21.15.174:0/3155454170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf840ca990 msgr2=0x7fdf8415b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.551 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.547+0000 7fdf8990d700 1 --2- 172.21.15.174:0/3155454170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf840ca990 0x7fdf8415b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.551 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.548+0000 7fdf8990d700 1 -- 172.21.15.174:0/3155454170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf8406d950 msgr2=0x7fdf8415c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.551 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.548+0000 7fdf8990d700 1 --2- 172.21.15.174:0/3155454170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf8406d950 0x7fdf8415c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.551 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.548+0000 7fdf8990d700 1 -- 172.21.15.174:0/3155454170 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c009ae0 con 0x7fdf8406c8b0 2023-09-28T04:23:00.551 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.548+0000 7fdf8990d700 1 --2- 172.21.15.174:0/3155454170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf8406c8b0 0x7fdf84165ff0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000d8c0 tx=0x7fdf80008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:00.551 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.548+0000 7fdf79ffb700 1 -- 172.21.15.174:0/3155454170 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800125f0 con 0x7fdf8406c8b0 2023-09-28T04:23:00.551 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.548+0000 7fdf79ffb700 1 -- 172.21.15.174:0/3155454170 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf80012750 con 0x7fdf8406c8b0 2023-09-28T04:23:00.551 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.548+0000 7fdf79ffb700 1 -- 172.21.15.174:0/3155454170 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80012af0 con 0x7fdf8406c8b0 2023-09-28T04:23:00.551 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.548+0000 7fdf8bb71700 1 -- 172.21.15.174:0/3155454170 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf74009420 con 0x7fdf8406c8b0 2023-09-28T04:23:00.551 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.548+0000 7fdf79ffb700 1 -- 172.21.15.174:0/3155454170 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdf8001e6e0 con 0x7fdf8406c8b0 2023-09-28T04:23:00.551 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.548+0000 7fdf8bb71700 1 -- 172.21.15.174:0/3155454170 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf841591f0 con 0x7fdf8406c8b0 2023-09-28T04:23:00.551 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.548+0000 7fdf79ffb700 1 -- 172.21.15.174:0/3155454170 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fdf8001ead0 con 0x7fdf8406c8b0 2023-09-28T04:23:00.552 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.549+0000 7fdf8bb71700 1 -- 172.21.15.174:0/3155454170 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8415c620 con 0x7fdf8406c8b0 2023-09-28T04:23:00.552 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.551+0000 7fdf79ffb700 1 -- 172.21.15.174:0/3155454170 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fdf8001ec90 con 0x7fdf8406c8b0 2023-09-28T04:23:00.634 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.634+0000 7fdf8bb71700 1 -- 172.21.15.174:0/3155454170 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8b4858ee-61f7-4888-b06d-691c0ab2fe37", "id": 3} v 0) v1 -- 0x7fdf84071980 con 0x7fdf8406c8b0 2023-09-28T04:23:00.638 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.637+0000 7fdf79ffb700 1 -- 172.21.15.174:0/3155454170 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b4858ee-61f7-4888-b06d-691c0ab2fe37", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdf80028430 con 0x7fdf8406c8b0 2023-09-28T04:23:00.638 INFO:teuthology.orchestra.run.smithi174.stdout:3 2023-09-28T04:23:00.639 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.639+0000 7fdf8bb71700 1 -- 172.21.15.174:0/3155454170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf8406c8b0 msgr2=0x7fdf84165ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.639 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.639+0000 7fdf8bb71700 1 --2- 172.21.15.174:0/3155454170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf8406c8b0 0x7fdf84165ff0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000d8c0 tx=0x7fdf80008040 comp rx=0 tx=0).stop 2023-09-28T04:23:00.639 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.639+0000 7fdf8bb71700 1 -- 172.21.15.174:0/3155454170 shutdown_connections 2023-09-28T04:23:00.639 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.639+0000 7fdf8bb71700 1 --2- 172.21.15.174:0/3155454170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf840ca990 0x7fdf8415b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.640 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.639+0000 7fdf8bb71700 1 --2- 172.21.15.174:0/3155454170 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf8406c8b0 0x7fdf84165ff0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.640 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.639+0000 7fdf8bb71700 1 --2- 172.21.15.174:0/3155454170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf8406d950 0x7fdf8415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.640 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.639+0000 7fdf8bb71700 1 -- 172.21.15.174:0/3155454170 >> 172.21.15.174:0/3155454170 conn(0x7fdf84063d00 msgr2=0x7fdf84154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:00.640 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.639+0000 7fdf8bb71700 1 -- 172.21.15.174:0/3155454170 shutdown_connections 2023-09-28T04:23:00.640 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.639+0000 7fdf8bb71700 1 -- 172.21.15.174:0/3155454170 wait complete. 2023-09-28T04:23:00.650 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 5ac654cb-4138-4e61-8a2c-9b18cbec4e7e 4 2023-09-28T04:23:00.673 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:00.673+0000 7f0560e251c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-28T04:23:00.772 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.771+0000 7fa3175eb700 1 Processor -- start 2023-09-28T04:23:00.772 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.771+0000 7fa3175eb700 1 -- start start 2023-09-28T04:23:00.780 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.772+0000 7fa3175eb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa31006ddf0 0x7fa310156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.780 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.772+0000 7fa3175eb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 0x7fa31015de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.781 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.772+0000 7fa3175eb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3100635b0 con 0x7fa3100bb680 2023-09-28T04:23:00.781 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.772+0000 7fa3175eb700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa310063850 con 0x7fa31006ddf0 2023-09-28T04:23:00.781 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.772+0000 7fa3175eb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100681c0 con 0x7fa310157170 2023-09-28T04:23:00.781 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.772+0000 7fa315b88700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 0x7fa31015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.781 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.772+0000 7fa315b88700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 0x7fa31015de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34956/0 (socket says 172.21.15.174:34956) 2023-09-28T04:23:00.781 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.772+0000 7fa315b88700 1 -- 172.21.15.174:0/1604184376 learned_addr learned my addr 172.21.15.174:0/1604184376 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-09-28T04:23:00.782 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.773+0000 7fa314b86700 1 --2- 172.21.15.174:0/1604184376 >> v2:172.21.15.118:3300/0 conn(0x7fa31006ddf0 0x7fa310156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.782 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.773+0000 7fa315b88700 1 -- 172.21.15.174:0/1604184376 >> v2:172.21.15.118:3300/0 conn(0x7fa31006ddf0 msgr2=0x7fa310156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:00.782 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.773+0000 7fa315b88700 1 --2- 172.21.15.174:0/1604184376 >> v2:172.21.15.118:3300/0 conn(0x7fa31006ddf0 0x7fa310156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.782 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.773+0000 7fa315b88700 1 -- 172.21.15.174:0/1604184376 >> v1:172.21.15.118:6789/0 conn(0x7fa3100bb680 legacy=0x7fa3100c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:00.782 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.773+0000 7fa315b88700 1 -- 172.21.15.174:0/1604184376 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3100684a0 con 0x7fa310157170 2023-09-28T04:23:00.782 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.773+0000 7fa314b86700 1 --2- 172.21.15.174:0/1604184376 >> v2:172.21.15.118:3300/0 conn(0x7fa31006ddf0 0x7fa310156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T04:23:00.783 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.773+0000 7fa315b88700 1 --2- 172.21.15.174:0/1604184376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 0x7fa31015de00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa308009f20 tx=0x7fa308009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76036e345e6479f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:00.783 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.773+0000 7fa307fff700 1 -- 172.21.15.174:0/1604184376 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30800e070 con 0x7fa310157170 2023-09-28T04:23:00.783 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.773+0000 7fa307fff700 1 -- 172.21.15.174:0/1604184376 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30800ba40 con 0x7fa310157170 2023-09-28T04:23:00.783 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.773+0000 7fa307fff700 1 -- 172.21.15.174:0/1604184376 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3080092e0 con 0x7fa310157170 2023-09-28T04:23:00.783 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.774+0000 7fa3175eb700 1 -- 172.21.15.174:0/1604184376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 msgr2=0x7fa31015de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.784 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.774+0000 7fa3175eb700 1 --2- 172.21.15.174:0/1604184376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 0x7fa31015de00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa308009f20 tx=0x7fa308009840 comp rx=0 tx=0).stop 2023-09-28T04:23:00.784 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.774+0000 7fa3175eb700 1 -- 172.21.15.174:0/1604184376 shutdown_connections 2023-09-28T04:23:00.784 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.774+0000 7fa3175eb700 1 --2- 172.21.15.174:0/1604184376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 0x7fa31015de00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.784 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.774+0000 7fa3175eb700 1 --2- 172.21.15.174:0/1604184376 >> v2:172.21.15.118:3300/0 conn(0x7fa31006ddf0 0x7fa310156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.784 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.774+0000 7fa3175eb700 1 -- 172.21.15.174:0/1604184376 >> 172.21.15.174:0/1604184376 conn(0x7fa31006a2e0 msgr2=0x7fa31006a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:00.785 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.774+0000 7fa3175eb700 1 -- 172.21.15.174:0/1604184376 shutdown_connections 2023-09-28T04:23:00.785 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.774+0000 7fa3175eb700 1 -- 172.21.15.174:0/1604184376 wait complete. 2023-09-28T04:23:00.785 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.775+0000 7fa3175eb700 1 Processor -- start 2023-09-28T04:23:00.785 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.775+0000 7fa3175eb700 1 -- start start 2023-09-28T04:23:00.785 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa3175eb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa31006ddf0 0x7fa31014c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.785 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa3175eb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3100bb680 0x7fa310158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.785 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa3175eb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 0x7fa3101593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:00.785 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa3175eb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310163db0 con 0x7fa3100bb680 2023-09-28T04:23:00.785 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa3175eb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310145dd0 con 0x7fa31006ddf0 2023-09-28T04:23:00.786 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa3175eb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3101586c0 con 0x7fa310157170 2023-09-28T04:23:00.786 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa315b88700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 0x7fa3101593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.786 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa315387700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa31006ddf0 0x7fa31014c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.786 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa315387700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa31006ddf0 0x7fa31014c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:44636/0 (socket says 172.21.15.174:44636) 2023-09-28T04:23:00.786 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa315b88700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 0x7fa3101593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34970/0 (socket says 172.21.15.174:34970) 2023-09-28T04:23:00.786 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa315387700 1 -- 172.21.15.174:0/805973063 learned_addr learned my addr 172.21.15.174:0/805973063 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-09-28T04:23:00.786 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa314b86700 1 --2- 172.21.15.174:0/805973063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3100bb680 0x7fa310158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:00.786 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa315387700 1 -- 172.21.15.174:0/805973063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 msgr2=0x7fa3101593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.786 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa315387700 1 --2- 172.21.15.174:0/805973063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 0x7fa3101593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.787 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa315387700 1 -- 172.21.15.174:0/805973063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3100bb680 msgr2=0x7fa310158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.787 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa315387700 1 --2- 172.21.15.174:0/805973063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3100bb680 0x7fa310158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.787 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa315387700 1 -- 172.21.15.174:0/805973063 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa308009ae0 con 0x7fa31006ddf0 2023-09-28T04:23:00.787 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa315b88700 1 --2- 172.21.15.174:0/805973063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 0x7fa3101593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:00.787 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa315387700 1 --2- 172.21.15.174:0/805973063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa31006ddf0 0x7fa31014c620 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00c5d0 tx=0x7fa30c007f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:00.787 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.776+0000 7fa3057fa700 1 -- 172.21.15.174:0/805973063 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c011590 con 0x7fa31006ddf0 2023-09-28T04:23:00.787 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.777+0000 7fa3057fa700 1 -- 172.21.15.174:0/805973063 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c011710 con 0x7fa31006ddf0 2023-09-28T04:23:00.787 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.777+0000 7fa3175eb700 1 -- 172.21.15.174:0/805973063 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa310068c70 con 0x7fa31006ddf0 2023-09-28T04:23:00.787 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.777+0000 7fa3057fa700 1 -- 172.21.15.174:0/805973063 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c011ad0 con 0x7fa31006ddf0 2023-09-28T04:23:00.787 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.777+0000 7fa3175eb700 1 -- 172.21.15.174:0/805973063 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3100c6620 con 0x7fa31006ddf0 2023-09-28T04:23:00.788 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.777+0000 7fa3057fa700 1 -- 172.21.15.174:0/805973063 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa30c01c460 con 0x7fa31006ddf0 2023-09-28T04:23:00.788 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.777+0000 7fa3057fa700 1 -- 172.21.15.174:0/805973063 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fa30c012420 con 0x7fa31006ddf0 2023-09-28T04:23:00.788 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.777+0000 7fa3175eb700 1 -- 172.21.15.174:0/805973063 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa310071980 con 0x7fa31006ddf0 2023-09-28T04:23:00.788 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.780+0000 7fa3057fa700 1 -- 172.21.15.174:0/805973063 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fa30c01c710 con 0x7fa31006ddf0 2023-09-28T04:23:00.862 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.862+0000 7fa3175eb700 1 -- 172.21.15.174:0/805973063 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5ac654cb-4138-4e61-8a2c-9b18cbec4e7e", "id": 4} v 0) v1 -- 0x7fa3100c2970 con 0x7fa31006ddf0 2023-09-28T04:23:00.865 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.865+0000 7fa3057fa700 1 -- 172.21.15.174:0/805973063 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5ac654cb-4138-4e61-8a2c-9b18cbec4e7e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa30c02b0b0 con 0x7fa31006ddf0 2023-09-28T04:23:00.866 INFO:teuthology.orchestra.run.smithi174.stdout:4 2023-09-28T04:23:00.868 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.866+0000 7fa3175eb700 1 -- 172.21.15.174:0/805973063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa31006ddf0 msgr2=0x7fa31014c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:00.868 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.866+0000 7fa3175eb700 1 --2- 172.21.15.174:0/805973063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa31006ddf0 0x7fa31014c620 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00c5d0 tx=0x7fa30c007f60 comp rx=0 tx=0).stop 2023-09-28T04:23:00.868 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.866+0000 7fa3175eb700 1 -- 172.21.15.174:0/805973063 shutdown_connections 2023-09-28T04:23:00.869 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.866+0000 7fa3175eb700 1 --2- 172.21.15.174:0/805973063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa310157170 0x7fa3101593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.869 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.866+0000 7fa3175eb700 1 --2- 172.21.15.174:0/805973063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa31006ddf0 0x7fa31014c620 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.869 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.866+0000 7fa3175eb700 1 --2- 172.21.15.174:0/805973063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3100bb680 0x7fa310158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:00.869 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.866+0000 7fa3175eb700 1 -- 172.21.15.174:0/805973063 >> 172.21.15.174:0/805973063 conn(0x7fa31006a2e0 msgr2=0x7fa310155d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:00.869 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.866+0000 7fa3175eb700 1 -- 172.21.15.174:0/805973063 shutdown_connections 2023-09-28T04:23:00.869 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:00.866+0000 7fa3175eb700 1 -- 172.21.15.174:0/805973063 wait complete. 2023-09-28T04:23:00.878 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 7aa0eaee-f25c-4ca1-a55f-da714be4aa43 5 2023-09-28T04:23:00.931 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:00.931+0000 7f8955c6a1c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-28T04:23:01.035 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.034+0000 7f9f2335d700 1 Processor -- start 2023-09-28T04:23:01.035 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.035+0000 7f9f2335d700 1 -- start start 2023-09-28T04:23:01.037 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.035+0000 7f9f2335d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f1c06ddf0 0x7f9f1c156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.037 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.035+0000 7f9f2335d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1c0635b0 con 0x7f9f1c0bb680 2023-09-28T04:23:01.037 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.035+0000 7f9f2335d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1c1575d0 con 0x7f9f1c157170 2023-09-28T04:23:01.037 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.035+0000 7f9f2335d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c063850 con 0x7f9f1c06ddf0 2023-09-28T04:23:01.037 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.036+0000 7f9f208f8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f1c06ddf0 0x7f9f1c156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.037 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.036+0000 7f9f218fa700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9f1c157170 0x7f9f1c15de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:55100/0 (socket says 172.21.15.174:55100) 2023-09-28T04:23:01.038 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.036+0000 7f9f218fa700 1 -- 172.21.15.174:0/3439520422 learned_addr learned my addr 172.21.15.174:0/3439520422 (peer_addr_for_me v1:172.21.15.174:0/0) 2023-09-28T04:23:01.038 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.036+0000 7f9f13fff700 1 -- 172.21.15.174:0/3439520422 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618671535 0 0) 0x7f9f1c1575d0 con 0x7f9f1c157170 2023-09-28T04:23:01.038 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.036+0000 7f9f208f8700 1 -- 172.21.15.174:0/3439520422 >> v1:172.21.15.174:6789/0 conn(0x7f9f1c157170 legacy=0x7f9f1c15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.038 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.036+0000 7f9f208f8700 1 -- 172.21.15.174:0/3439520422 >> v1:172.21.15.118:6789/0 conn(0x7f9f1c0bb680 legacy=0x7f9f1c0c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:01.038 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.036+0000 7f9f208f8700 1 -- 172.21.15.174:0/3439520422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c0681c0 con 0x7f9f1c06ddf0 2023-09-28T04:23:01.038 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.036+0000 7f9f208f8700 1 --2- 172.21.15.174:0/3439520422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f1c06ddf0 0x7f9f1c156c30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c009900 tx=0x7f9f0c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=846f535abfd7bb0c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:01.038 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.036+0000 7f9f13fff700 1 -- 172.21.15.174:0/3439520422 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c009ea0 con 0x7f9f1c06ddf0 2023-09-28T04:23:01.038 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.036+0000 7f9f13fff700 1 -- 172.21.15.174:0/3439520422 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c005c10 con 0x7f9f1c06ddf0 2023-09-28T04:23:01.038 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.036+0000 7f9f13fff700 1 -- 172.21.15.174:0/3439520422 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c00b610 con 0x7f9f1c06ddf0 2023-09-28T04:23:01.038 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.037+0000 7f9f2335d700 1 -- 172.21.15.174:0/3439520422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f1c06ddf0 msgr2=0x7f9f1c156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.038 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.037+0000 7f9f2335d700 1 --2- 172.21.15.174:0/3439520422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f1c06ddf0 0x7f9f1c156c30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c009900 tx=0x7f9f0c009120 comp rx=0 tx=0).stop 2023-09-28T04:23:01.039 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.037+0000 7f9f2335d700 1 -- 172.21.15.174:0/3439520422 shutdown_connections 2023-09-28T04:23:01.039 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.037+0000 7f9f2335d700 1 --2- 172.21.15.174:0/3439520422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f1c06ddf0 0x7f9f1c156c30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.039 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.037+0000 7f9f2335d700 1 -- 172.21.15.174:0/3439520422 >> 172.21.15.174:0/3439520422 conn(0x7f9f1c06a2e0 msgr2=0x7f9f1c06a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:01.039 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.037+0000 7f9f2335d700 1 -- 172.21.15.174:0/3439520422 shutdown_connections 2023-09-28T04:23:01.039 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.037+0000 7f9f2335d700 1 -- 172.21.15.174:0/3439520422 wait complete. 2023-09-28T04:23:01.041 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.038+0000 7f9f2335d700 1 Processor -- start 2023-09-28T04:23:01.041 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.038+0000 7f9f2335d700 1 -- start start 2023-09-28T04:23:01.041 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f2335d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f1c06ddf0 0x7f9f1c1654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.041 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f2335d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f1c0bb680 0x7f9f1c06c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.041 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f2335d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f1c157170 0x7f9f1c142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.042 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f2335d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c0ba360 con 0x7f9f1c157170 2023-09-28T04:23:01.042 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f2335d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c0c11c0 con 0x7f9f1c06ddf0 2023-09-28T04:23:01.042 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f2335d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c169140 con 0x7f9f1c0bb680 2023-09-28T04:23:01.042 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f208f8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f1c0bb680 0x7f9f1c06c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.042 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f208f8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f1c0bb680 0x7f9f1c06c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:34982/0 (socket says 172.21.15.174:34982) 2023-09-28T04:23:01.042 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f208f8700 1 -- 172.21.15.174:0/1562085334 learned_addr learned my addr 172.21.15.174:0/1562085334 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-09-28T04:23:01.042 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f210f9700 1 --2- 172.21.15.174:0/1562085334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f1c06ddf0 0x7f9f1c1654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.042 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f218fa700 1 --2- 172.21.15.174:0/1562085334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f1c157170 0x7f9f1c142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.042 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f208f8700 1 -- 172.21.15.174:0/1562085334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f1c06ddf0 msgr2=0x7f9f1c1654d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.042 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f208f8700 1 --2- 172.21.15.174:0/1562085334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f1c06ddf0 0x7f9f1c1654d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.043 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f208f8700 1 -- 172.21.15.174:0/1562085334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f1c157170 msgr2=0x7f9f1c142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.043 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f208f8700 1 --2- 172.21.15.174:0/1562085334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f1c157170 0x7f9f1c142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.043 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f208f8700 1 -- 172.21.15.174:0/1562085334 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c0093c0 con 0x7f9f1c0bb680 2023-09-28T04:23:01.043 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f208f8700 1 --2- 172.21.15.174:0/1562085334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f1c0bb680 0x7f9f1c06c0e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c003080 tx=0x7f9f0c015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:01.043 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.039+0000 7f9f117fa700 1 -- 172.21.15.174:0/1562085334 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0065d0 con 0x7f9f1c0bb680 2023-09-28T04:23:01.043 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.040+0000 7f9f117fa700 1 -- 172.21.15.174:0/1562085334 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c006730 con 0x7f9f1c0bb680 2023-09-28T04:23:01.043 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.040+0000 7f9f2335d700 1 -- 172.21.15.174:0/1562085334 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1c0bf1a0 con 0x7f9f1c0bb680 2023-09-28T04:23:01.043 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.040+0000 7f9f117fa700 1 -- 172.21.15.174:0/1562085334 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c026470 con 0x7f9f1c0bb680 2023-09-28T04:23:01.043 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.040+0000 7f9f2335d700 1 -- 172.21.15.174:0/1562085334 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1c0c1410 con 0x7f9f1c0bb680 2023-09-28T04:23:01.043 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.040+0000 7f9f117fa700 1 -- 172.21.15.174:0/1562085334 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9f0c023070 con 0x7f9f1c0bb680 2023-09-28T04:23:01.043 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.040+0000 7f9f117fa700 1 -- 172.21.15.174:0/1562085334 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f9f0c026aa0 con 0x7f9f1c0bb680 2023-09-28T04:23:01.043 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.040+0000 7f9f2335d700 1 -- 172.21.15.174:0/1562085334 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1c071980 con 0x7f9f1c0bb680 2023-09-28T04:23:01.044 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.043+0000 7f9f117fa700 1 -- 172.21.15.174:0/1562085334 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f9f0c0456b0 con 0x7f9f1c0bb680 2023-09-28T04:23:01.126 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.126+0000 7f9f2335d700 1 -- 172.21.15.174:0/1562085334 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7aa0eaee-f25c-4ca1-a55f-da714be4aa43", "id": 5} v 0) v1 -- 0x7f9f1c0c16f0 con 0x7f9f1c0bb680 2023-09-28T04:23:01.129 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.129+0000 7f9f117fa700 1 -- 172.21.15.174:0/1562085334 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7aa0eaee-f25c-4ca1-a55f-da714be4aa43", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9f0c034030 con 0x7f9f1c0bb680 2023-09-28T04:23:01.129 INFO:teuthology.orchestra.run.smithi174.stdout:5 2023-09-28T04:23:01.130 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.130+0000 7f9f2335d700 1 -- 172.21.15.174:0/1562085334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f1c0bb680 msgr2=0x7f9f1c06c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.130 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.130+0000 7f9f2335d700 1 --2- 172.21.15.174:0/1562085334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f1c0bb680 0x7f9f1c06c0e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c003080 tx=0x7f9f0c015000 comp rx=0 tx=0).stop 2023-09-28T04:23:01.131 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.130+0000 7f9f2335d700 1 -- 172.21.15.174:0/1562085334 shutdown_connections 2023-09-28T04:23:01.131 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.130+0000 7f9f2335d700 1 --2- 172.21.15.174:0/1562085334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f1c157170 0x7f9f1c142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.131 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.130+0000 7f9f2335d700 1 --2- 172.21.15.174:0/1562085334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f1c06ddf0 0x7f9f1c1654d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.131 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.130+0000 7f9f2335d700 1 --2- 172.21.15.174:0/1562085334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f1c0bb680 0x7f9f1c06c0e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.131 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.130+0000 7f9f2335d700 1 -- 172.21.15.174:0/1562085334 >> 172.21.15.174:0/1562085334 conn(0x7f9f1c06a2e0 msgr2=0x7f9f1c155910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:01.131 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.130+0000 7f9f2335d700 1 -- 172.21.15.174:0/1562085334 shutdown_connections 2023-09-28T04:23:01.131 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.130+0000 7f9f2335d700 1 -- 172.21.15.174:0/1562085334 wait complete. 2023-09-28T04:23:01.142 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 22e36623-0a40-4e50-a469-30e296d2476e 6 2023-09-28T04:23:01.261 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.260+0000 7f7288ee4700 1 Processor -- start 2023-09-28T04:23:01.261 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.260+0000 7f7288ee4700 1 -- start start 2023-09-28T04:23:01.263 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.261+0000 7f7288ee4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f728406e600 0x7f72840c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.263 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.261+0000 7f7288ee4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72840c9b60 con 0x7f728406cd10 2023-09-28T04:23:01.263 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.261+0000 7f7288ee4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72840c9880 con 0x7f7284157600 2023-09-28T04:23:01.263 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.261+0000 7f7288ee4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72840c54d0 con 0x7f728406e600 2023-09-28T04:23:01.263 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.262+0000 7f7281d9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f728406e600 0x7f72840c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.263 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.262+0000 7f7282d9d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f7284157600 0x7f728414cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:34440/0 (socket says 172.21.15.174:34440) 2023-09-28T04:23:01.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.262+0000 7f7282d9d700 1 -- 172.21.15.174:0/1889111144 learned_addr learned my addr 172.21.15.174:0/1889111144 (peer_addr_for_me v1:172.21.15.174:0/0) 2023-09-28T04:23:01.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.262+0000 7f7281d9b700 1 -- 172.21.15.174:0/1889111144 >> v1:172.21.15.174:6789/0 conn(0x7f7284157600 legacy=0x7f728414cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.262+0000 7f7281d9b700 1 -- 172.21.15.174:0/1889111144 >> v1:172.21.15.118:6789/0 conn(0x7f728406cd10 legacy=0x7f7284156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:01.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.262+0000 7f7281d9b700 1 -- 172.21.15.174:0/1889111144 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72840c4f10 con 0x7f728406e600 2023-09-28T04:23:01.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.262+0000 7f7281d9b700 1 --2- 172.21.15.174:0/1889111144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f728406e600 0x7f72840c2c00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f72780098e0 tx=0x7f72780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c6d620b10cb4d2c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:01.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.262+0000 7f728159a700 1 -- 172.21.15.174:0/1889111144 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278009e80 con 0x7f728406e600 2023-09-28T04:23:01.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.262+0000 7f728159a700 1 -- 172.21.15.174:0/1889111144 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727800b8b0 con 0x7f728406e600 2023-09-28T04:23:01.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.262+0000 7f728159a700 1 -- 172.21.15.174:0/1889111144 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727800bc30 con 0x7f728406e600 2023-09-28T04:23:01.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.263+0000 7f7288ee4700 1 -- 172.21.15.174:0/1889111144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f728406e600 msgr2=0x7f72840c2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.263+0000 7f7288ee4700 1 --2- 172.21.15.174:0/1889111144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f728406e600 0x7f72840c2c00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f72780098e0 tx=0x7f72780091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.263+0000 7f7288ee4700 1 -- 172.21.15.174:0/1889111144 shutdown_connections 2023-09-28T04:23:01.265 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.263+0000 7f7288ee4700 1 --2- 172.21.15.174:0/1889111144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f728406e600 0x7f72840c2c00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.265 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.263+0000 7f7288ee4700 1 -- 172.21.15.174:0/1889111144 >> 172.21.15.174:0/1889111144 conn(0x7f7284069210 msgr2=0x7f72840c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:01.265 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.263+0000 7f7288ee4700 1 -- 172.21.15.174:0/1889111144 shutdown_connections 2023-09-28T04:23:01.265 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.263+0000 7f7288ee4700 1 -- 172.21.15.174:0/1889111144 wait complete. 2023-09-28T04:23:01.267 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.264+0000 7f7288ee4700 1 Processor -- start 2023-09-28T04:23:01.267 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.264+0000 7f7288ee4700 1 -- start start 2023-09-28T04:23:01.267 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7288ee4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f728406cd10 0x7f7284145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.267 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7288ee4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f728406e600 0x7f728415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7288ee4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7284157600 0x7f728415ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7288ee4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72841666c0 con 0x7f7284157600 2023-09-28T04:23:01.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7288ee4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7284165830 con 0x7f728406e600 2023-09-28T04:23:01.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7288ee4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7284168f30 con 0x7f728406cd10 2023-09-28T04:23:01.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7281d9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f728406e600 0x7f728415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f728259c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f728406cd10 0x7f7284145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7281d9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f728406e600 0x7f728415a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:50488/0 (socket says 172.21.15.174:50488) 2023-09-28T04:23:01.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7281d9b700 1 -- 172.21.15.174:0/2390443869 learned_addr learned my addr 172.21.15.174:0/2390443869 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-09-28T04:23:01.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7282d9d700 1 --2- 172.21.15.174:0/2390443869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7284157600 0x7f728415ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7281d9b700 1 -- 172.21.15.174:0/2390443869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f728406cd10 msgr2=0x7f7284145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7281d9b700 1 --2- 172.21.15.174:0/2390443869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f728406cd10 0x7f7284145470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7281d9b700 1 -- 172.21.15.174:0/2390443869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7284157600 msgr2=0x7f728415ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7281d9b700 1 --2- 172.21.15.174:0/2390443869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7284157600 0x7f728415ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7281d9b700 1 -- 172.21.15.174:0/2390443869 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7278009420 con 0x7f728406e600 2023-09-28T04:23:01.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f728259c700 1 --2- 172.21.15.174:0/2390443869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f728406cd10 0x7f7284145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:01.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.265+0000 7f7281d9b700 1 --2- 172.21.15.174:0/2390443869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f728406e600 0x7f728415a650 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f72780030c0 tx=0x7f7278016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:01.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.266+0000 7f72727fc700 1 -- 172.21.15.174:0/2390443869 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727800bb70 con 0x7f728406e600 2023-09-28T04:23:01.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.266+0000 7f72727fc700 1 -- 172.21.15.174:0/2390443869 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7278020070 con 0x7f728406e600 2023-09-28T04:23:01.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.266+0000 7f7288ee4700 1 -- 172.21.15.174:0/2390443869 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7284165ab0 con 0x7f728406e600 2023-09-28T04:23:01.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.266+0000 7f72727fc700 1 -- 172.21.15.174:0/2390443869 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727801b6a0 con 0x7f728406e600 2023-09-28T04:23:01.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.266+0000 7f7288ee4700 1 -- 172.21.15.174:0/2390443869 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7284166070 con 0x7f728406e600 2023-09-28T04:23:01.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.266+0000 7f72727fc700 1 -- 172.21.15.174:0/2390443869 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7278022030 con 0x7f728406e600 2023-09-28T04:23:01.270 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.266+0000 7f72727fc700 1 -- 172.21.15.174:0/2390443869 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f727801caf0 con 0x7f728406e600 2023-09-28T04:23:01.270 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.267+0000 7f7288ee4700 1 -- 172.21.15.174:0/2390443869 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7284071980 con 0x7f728406e600 2023-09-28T04:23:01.271 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.269+0000 7f72727fc700 1 -- 172.21.15.174:0/2390443869 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f727801c4f0 con 0x7f728406e600 2023-09-28T04:23:01.351 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.351+0000 7f7288ee4700 1 -- 172.21.15.174:0/2390443869 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "22e36623-0a40-4e50-a469-30e296d2476e", "id": 6} v 0) v1 -- 0x7f728414f740 con 0x7f728406e600 2023-09-28T04:23:01.355 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.355+0000 7f72727fc700 1 -- 172.21.15.174:0/2390443869 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22e36623-0a40-4e50-a469-30e296d2476e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f727801c690 con 0x7f728406e600 2023-09-28T04:23:01.355 INFO:teuthology.orchestra.run.smithi174.stdout:6 2023-09-28T04:23:01.356 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.355+0000 7f7288ee4700 1 -- 172.21.15.174:0/2390443869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f728406e600 msgr2=0x7f728415a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.356 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.355+0000 7f7288ee4700 1 --2- 172.21.15.174:0/2390443869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f728406e600 0x7f728415a650 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f72780030c0 tx=0x7f7278016000 comp rx=0 tx=0).stop 2023-09-28T04:23:01.356 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.356+0000 7f7288ee4700 1 -- 172.21.15.174:0/2390443869 shutdown_connections 2023-09-28T04:23:01.356 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.356+0000 7f7288ee4700 1 --2- 172.21.15.174:0/2390443869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7284157600 0x7f728415ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.356 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.356+0000 7f7288ee4700 1 --2- 172.21.15.174:0/2390443869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f728406cd10 0x7f7284145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.356 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.356+0000 7f7288ee4700 1 --2- 172.21.15.174:0/2390443869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f728406e600 0x7f728415a650 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.357 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.356+0000 7f7288ee4700 1 -- 172.21.15.174:0/2390443869 >> 172.21.15.174:0/2390443869 conn(0x7f7284069210 msgr2=0x7f7284070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:01.357 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.356+0000 7f7288ee4700 1 -- 172.21.15.174:0/2390443869 shutdown_connections 2023-09-28T04:23:01.357 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.356+0000 7f7288ee4700 1 -- 172.21.15.174:0/2390443869 wait complete. 2023-09-28T04:23:01.367 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 747dff1c-1812-404d-829c-c884fee73df4 7 2023-09-28T04:23:01.434 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:01.433+0000 7f0560e251c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-28T04:23:01.488 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.488+0000 7f689e543700 1 Processor -- start 2023-09-28T04:23:01.488 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.488+0000 7f689e543700 1 -- start start 2023-09-28T04:23:01.491 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f689e543700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f689806cd10 0x7f68980c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.491 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f689e543700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6898157600 0x7f689814cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.491 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f689e543700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68980c9b60 con 0x7f689806e600 2023-09-28T04:23:01.491 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f689e543700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68980c54d0 con 0x7f689806cd10 2023-09-28T04:23:01.491 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f689e543700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68980c9880 con 0x7f6898157600 2023-09-28T04:23:01.491 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f68977fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f689806e600 0x7f6898156ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:34452/0 (socket says 172.21.15.174:34452) 2023-09-28T04:23:01.491 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f68977fe700 1 -- 172.21.15.174:0/519287827 learned_addr learned my addr 172.21.15.174:0/519287827 (peer_addr_for_me v1:172.21.15.174:0/0) 2023-09-28T04:23:01.491 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f689cae0700 1 --2- 172.21.15.174:0/519287827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6898157600 0x7f689814cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.492 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f6897fff700 1 --2- 172.21.15.174:0/519287827 >> v2:172.21.15.118:3300/0 conn(0x7f689806cd10 0x7f68980c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.492 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f6896ffd700 1 -- 172.21.15.174:0/519287827 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890110929 0 0) 0x7f68980c9b60 con 0x7f689806e600 2023-09-28T04:23:01.492 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f6896ffd700 1 -- 172.21.15.174:0/519287827 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6880003570 con 0x7f689806e600 2023-09-28T04:23:01.492 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f689cae0700 1 -- 172.21.15.174:0/519287827 >> v2:172.21.15.118:3300/0 conn(0x7f689806cd10 msgr2=0x7f68980c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:01.492 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f689cae0700 1 --2- 172.21.15.174:0/519287827 >> v2:172.21.15.118:3300/0 conn(0x7f689806cd10 0x7f68980c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.492 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f689cae0700 1 -- 172.21.15.174:0/519287827 >> v1:172.21.15.174:6789/0 conn(0x7f689806e600 legacy=0x7f6898156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.492 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f689cae0700 1 -- 172.21.15.174:0/519287827 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68980c4f10 con 0x7f6898157600 2023-09-28T04:23:01.492 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f689cae0700 1 --2- 172.21.15.174:0/519287827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6898157600 0x7f689814cee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6890009e60 tx=0x7f6890009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=997b99321d218914 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:01.492 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f6896ffd700 1 -- 172.21.15.174:0/519287827 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000e070 con 0x7f6898157600 2023-09-28T04:23:01.492 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.489+0000 7f6896ffd700 1 -- 172.21.15.174:0/519287827 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689000bbf0 con 0x7f6898157600 2023-09-28T04:23:01.492 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.490+0000 7f6896ffd700 1 -- 172.21.15.174:0/519287827 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890012430 con 0x7f6898157600 2023-09-28T04:23:01.493 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.490+0000 7f689e543700 1 -- 172.21.15.174:0/519287827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6898157600 msgr2=0x7f689814cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.493 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.490+0000 7f689e543700 1 --2- 172.21.15.174:0/519287827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6898157600 0x7f689814cee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6890009e60 tx=0x7f6890009780 comp rx=0 tx=0).stop 2023-09-28T04:23:01.493 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.490+0000 7f689e543700 1 -- 172.21.15.174:0/519287827 shutdown_connections 2023-09-28T04:23:01.493 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.490+0000 7f689e543700 1 --2- 172.21.15.174:0/519287827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6898157600 0x7f689814cee0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.493 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.490+0000 7f689e543700 1 --2- 172.21.15.174:0/519287827 >> v2:172.21.15.118:3300/0 conn(0x7f689806cd10 0x7f68980c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.493 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.490+0000 7f689e543700 1 -- 172.21.15.174:0/519287827 >> 172.21.15.174:0/519287827 conn(0x7f6898069210 msgr2=0x7f68980c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:01.493 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.490+0000 7f689e543700 1 -- 172.21.15.174:0/519287827 shutdown_connections 2023-09-28T04:23:01.493 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.490+0000 7f689e543700 1 -- 172.21.15.174:0/519287827 wait complete. 2023-09-28T04:23:01.495 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.492+0000 7f689e543700 1 Processor -- start 2023-09-28T04:23:01.495 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.492+0000 7f689e543700 1 -- start start 2023-09-28T04:23:01.496 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f689e543700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689806cd10 0x7f6898146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.496 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f689e543700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f689806e600 0x7f68981472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.496 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f689e543700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6898157600 0x7f68981477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.496 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f689e543700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68981491a0 con 0x7f689806cd10 2023-09-28T04:23:01.496 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f689e543700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68981631a0 con 0x7f6898157600 2023-09-28T04:23:01.496 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f689e543700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6898163ce0 con 0x7f689806e600 2023-09-28T04:23:01.496 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f68977fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f689806e600 0x7f68981472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.496 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f689cae0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6898157600 0x7f68981477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.496 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f68977fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f689806e600 0x7f68981472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:46070/0 (socket says 172.21.15.174:46070) 2023-09-28T04:23:01.496 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f689cae0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6898157600 0x7f68981477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:50500/0 (socket says 172.21.15.174:50500) 2023-09-28T04:23:01.497 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f68977fe700 1 -- 172.21.15.174:0/641371208 learned_addr learned my addr 172.21.15.174:0/641371208 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-09-28T04:23:01.497 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f6897fff700 1 --2- 172.21.15.174:0/641371208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689806cd10 0x7f6898146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.497 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f68977fe700 1 -- 172.21.15.174:0/641371208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6898157600 msgr2=0x7f68981477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.497 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f68977fe700 1 --2- 172.21.15.174:0/641371208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6898157600 0x7f68981477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.497 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f68977fe700 1 -- 172.21.15.174:0/641371208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689806cd10 msgr2=0x7f6898146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.497 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f68977fe700 1 --2- 172.21.15.174:0/641371208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689806cd10 0x7f6898146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.497 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f68977fe700 1 -- 172.21.15.174:0/641371208 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6890009a20 con 0x7f689806e600 2023-09-28T04:23:01.497 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f68977fe700 1 --2- 172.21.15.174:0/641371208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f689806e600 0x7f68981472b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f688c00c7c0 tx=0x7f688c007db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:01.497 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.493+0000 7f687ffff700 1 -- 172.21.15.174:0/641371208 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c005b30 con 0x7f689806e600 2023-09-28T04:23:01.497 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.494+0000 7f687ffff700 1 -- 172.21.15.174:0/641371208 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c005c90 con 0x7f689806e600 2023-09-28T04:23:01.497 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.494+0000 7f689e543700 1 -- 172.21.15.174:0/641371208 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6898148ee0 con 0x7f689806e600 2023-09-28T04:23:01.498 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.494+0000 7f687ffff700 1 -- 172.21.15.174:0/641371208 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c0072e0 con 0x7f689806e600 2023-09-28T04:23:01.498 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.494+0000 7f689e543700 1 -- 172.21.15.174:0/641371208 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6898163690 con 0x7f689806e600 2023-09-28T04:23:01.498 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.494+0000 7f687ffff700 1 -- 172.21.15.174:0/641371208 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f688c01c6c0 con 0x7f689806e600 2023-09-28T04:23:01.498 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.494+0000 7f687ffff700 1 -- 172.21.15.174:0/641371208 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f688c005e00 con 0x7f689806e600 2023-09-28T04:23:01.498 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.494+0000 7f689e543700 1 -- 172.21.15.174:0/641371208 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68980c6670 con 0x7f689806e600 2023-09-28T04:23:01.498 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.496+0000 7f687ffff700 1 -- 172.21.15.174:0/641371208 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f688c021060 con 0x7f689806e600 2023-09-28T04:23:01.509 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:01.509+0000 7f0560e251c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-28T04:23:01.578 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.578+0000 7f689e543700 1 -- 172.21.15.174:0/641371208 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "747dff1c-1812-404d-829c-c884fee73df4", "id": 7} v 0) v1 -- 0x7f6898071980 con 0x7f689806e600 2023-09-28T04:23:01.582 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.581+0000 7f687ffff700 1 -- 172.21.15.174:0/641371208 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "747dff1c-1812-404d-829c-c884fee73df4", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f688c017070 con 0x7f689806e600 2023-09-28T04:23:01.582 INFO:teuthology.orchestra.run.smithi174.stdout:7 2023-09-28T04:23:01.583 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.582+0000 7f689e543700 1 -- 172.21.15.174:0/641371208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f689806e600 msgr2=0x7f68981472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.583 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.582+0000 7f689e543700 1 --2- 172.21.15.174:0/641371208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f689806e600 0x7f68981472b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f688c00c7c0 tx=0x7f688c007db0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.583 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.582+0000 7f689e543700 1 -- 172.21.15.174:0/641371208 shutdown_connections 2023-09-28T04:23:01.583 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.582+0000 7f689e543700 1 --2- 172.21.15.174:0/641371208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6898157600 0x7f68981477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.583 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.582+0000 7f689e543700 1 --2- 172.21.15.174:0/641371208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689806cd10 0x7f6898146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.583 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.582+0000 7f689e543700 1 --2- 172.21.15.174:0/641371208 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f689806e600 0x7f68981472b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.583 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.582+0000 7f689e543700 1 -- 172.21.15.174:0/641371208 >> 172.21.15.174:0/641371208 conn(0x7f6898069210 msgr2=0x7f689814d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:01.583 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.583+0000 7f689e543700 1 -- 172.21.15.174:0/641371208 shutdown_connections 2023-09-28T04:23:01.583 INFO:teuthology.orchestra.run.smithi174.stderr:2023-09-28T04:23:01.583+0000 7f689e543700 1 -- 172.21.15.174:0/641371208 wait complete. 2023-09-28T04:23:01.595 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-28T04:23:01.595 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-28T04:23:01.599 INFO:tasks.ceph.osd.0:Started 2023-09-28T04:23:01.599 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-28T04:23:01.599 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-28T04:23:01.603 INFO:tasks.ceph.osd.1:Started 2023-09-28T04:23:01.604 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-28T04:23:01.604 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-28T04:23:01.608 INFO:tasks.ceph.osd.2:Started 2023-09-28T04:23:01.608 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-28T04:23:01.608 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-28T04:23:01.613 INFO:tasks.ceph.osd.3:Started 2023-09-28T04:23:01.614 INFO:tasks.ceph.osd.4:Restarting daemon 2023-09-28T04:23:01.614 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-09-28T04:23:01.616 INFO:tasks.ceph.osd.4:Started 2023-09-28T04:23:01.616 INFO:tasks.ceph.osd.5:Restarting daemon 2023-09-28T04:23:01.616 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-09-28T04:23:01.618 INFO:tasks.ceph.osd.5:Started 2023-09-28T04:23:01.618 INFO:tasks.ceph.osd.6:Restarting daemon 2023-09-28T04:23:01.618 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-09-28T04:23:01.620 INFO:tasks.ceph.osd.6:Started 2023-09-28T04:23:01.620 INFO:tasks.ceph.osd.7:Restarting daemon 2023-09-28T04:23:01.620 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-09-28T04:23:01.622 INFO:tasks.ceph.osd.7:Started 2023-09-28T04:23:01.623 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:01.657 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:01.657+0000 7f0560e251c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-28T04:23:01.737 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:01.736+0000 7f0560e251c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-28T04:23:01.855 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:01.855+0000 7f8955c6a1c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-28T04:23:01.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.887+0000 7f27f67ff700 1 Processor -- start 2023-09-28T04:23:01.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.887+0000 7f27f67ff700 1 -- start start 2023-09-28T04:23:01.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27f67ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f27f00c5e30 0x7f27f0156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27f67ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f27f00c4ab0 0x7f27f00c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27f67ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f00c73e0 con 0x7f27f00c6200 2023-09-28T04:23:01.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27f67ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f00c0b60 con 0x7f27f00c5e30 2023-09-28T04:23:01.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27f67ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f00c67d0 con 0x7f27f00c4ab0 2023-09-28T04:23:01.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27effff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f27f00c5e30 0x7f27f0156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27f4d9c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f27f00c6200 0x7f27f0159070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:58934/0 (socket says 172.21.15.118:58934) 2023-09-28T04:23:01.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27effff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f27f00c5e30 0x7f27f0156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41744/0 (socket says 172.21.15.118:41744) 2023-09-28T04:23:01.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27f4d9c700 1 -- 172.21.15.118:0/1837566982 learned_addr learned my addr 172.21.15.118:0/1837566982 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:01.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27ef7fe700 1 --2- 172.21.15.118:0/1837566982 >> v2:172.21.15.174:3300/0 conn(0x7f27f00c4ab0 0x7f27f00c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27ef7fe700 1 -- 172.21.15.118:0/1837566982 >> v2:172.21.15.118:3300/0 conn(0x7f27f00c5e30 msgr2=0x7f27f0156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:01.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27eeffd700 1 -- 172.21.15.118:0/1837566982 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790901426 0 0) 0x7f27f00c73e0 con 0x7f27f00c6200 2023-09-28T04:23:01.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27ef7fe700 1 --2- 172.21.15.118:0/1837566982 >> v2:172.21.15.118:3300/0 conn(0x7f27f00c5e30 0x7f27f0156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.889+0000 7f27ef7fe700 1 -- 172.21.15.118:0/1837566982 >> v1:172.21.15.118:6789/0 conn(0x7f27f00c6200 legacy=0x7f27f0159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.890+0000 7f27ef7fe700 1 -- 172.21.15.118:0/1837566982 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00c6ab0 con 0x7f27f00c4ab0 2023-09-28T04:23:01.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.890+0000 7f27ef7fe700 1 --2- 172.21.15.118:0/1837566982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27f00c4ab0 0x7f27f00c9fb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f27f006f420 tx=0x7f27e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1475ffd24c3ef59 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.890+0000 7f27eeffd700 1 -- 172.21.15.118:0/1837566982 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400b690 con 0x7f27f00c4ab0 2023-09-28T04:23:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.890+0000 7f27eeffd700 1 -- 172.21.15.118:0/1837566982 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e400b7f0 con 0x7f27f00c4ab0 2023-09-28T04:23:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.890+0000 7f27eeffd700 1 -- 172.21.15.118:0/1837566982 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400bb90 con 0x7f27f00c4ab0 2023-09-28T04:23:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.890+0000 7f27f67ff700 1 -- 172.21.15.118:0/1837566982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27f00c4ab0 msgr2=0x7f27f00c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.890+0000 7f27f67ff700 1 --2- 172.21.15.118:0/1837566982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27f00c4ab0 0x7f27f00c9fb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f27f006f420 tx=0x7f27e40091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.891+0000 7f27f67ff700 1 -- 172.21.15.118:0/1837566982 shutdown_connections 2023-09-28T04:23:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.891+0000 7f27f67ff700 1 --2- 172.21.15.118:0/1837566982 >> v2:172.21.15.118:3300/0 conn(0x7f27f00c5e30 0x7f27f0156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.891+0000 7f27f67ff700 1 --2- 172.21.15.118:0/1837566982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27f00c4ab0 0x7f27f00c9fb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.891+0000 7f27f67ff700 1 -- 172.21.15.118:0/1837566982 >> 172.21.15.118:0/1837566982 conn(0x7f27f0063230 msgr2=0x7f27f0063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.891+0000 7f27f67ff700 1 -- 172.21.15.118:0/1837566982 shutdown_connections 2023-09-28T04:23:01.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.891+0000 7f27f67ff700 1 -- 172.21.15.118:0/1837566982 wait complete. 2023-09-28T04:23:01.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.892+0000 7f27f67ff700 1 Processor -- start 2023-09-28T04:23:01.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.892+0000 7f27f67ff700 1 -- start start 2023-09-28T04:23:01.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.893+0000 7f27f67ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00c4ab0 0x7f27f0148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.893+0000 7f27f67ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27f00c5e30 0x7f27f00c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.893+0000 7f27f67ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f00c6200 0x7f27f00c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:01.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.893+0000 7f27f67ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f014a3c0 con 0x7f27f00c4ab0 2023-09-28T04:23:01.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.893+0000 7f27f67ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f0154810 con 0x7f27f00c5e30 2023-09-28T04:23:01.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.893+0000 7f27f67ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f006e2c0 con 0x7f27f00c6200 2023-09-28T04:23:01.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.893+0000 7f27effff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00c4ab0 0x7f27f0148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.893+0000 7f27effff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00c4ab0 0x7f27f0148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41760/0 (socket says 172.21.15.118:41760) 2023-09-28T04:23:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.893+0000 7f27effff700 1 -- 172.21.15.118:0/1670692697 learned_addr learned my addr 172.21.15.118:0/1670692697 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.893+0000 7f27ef7fe700 1 --2- 172.21.15.118:0/1670692697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27f00c5e30 0x7f27f00c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.893+0000 7f27f4d9c700 1 --2- 172.21.15.118:0/1670692697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f00c6200 0x7f27f00c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.894+0000 7f27effff700 1 -- 172.21.15.118:0/1670692697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f00c6200 msgr2=0x7f27f00c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.894+0000 7f27effff700 1 --2- 172.21.15.118:0/1670692697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f00c6200 0x7f27f00c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.894+0000 7f27effff700 1 -- 172.21.15.118:0/1670692697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27f00c5e30 msgr2=0x7f27f00c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.894+0000 7f27effff700 1 --2- 172.21.15.118:0/1670692697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27f00c5e30 0x7f27f00c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.894+0000 7f27effff700 1 -- 172.21.15.118:0/1670692697 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e4009420 con 0x7f27f00c4ab0 2023-09-28T04:23:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.894+0000 7f27effff700 1 --2- 172.21.15.118:0/1670692697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00c4ab0 0x7f27f0148f80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f27e000ec80 tx=0x7f27e0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.894+0000 7f27d7fff700 1 -- 172.21.15.118:0/1670692697 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e000c850 con 0x7f27f00c4ab0 2023-09-28T04:23:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.894+0000 7f27d7fff700 1 -- 172.21.15.118:0/1670692697 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e000c9b0 con 0x7f27f00c4ab0 2023-09-28T04:23:01.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.894+0000 7f27d7fff700 1 -- 172.21.15.118:0/1670692697 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e000cd30 con 0x7f27f00c4ab0 2023-09-28T04:23:01.898 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.894+0000 7f27f67ff700 1 -- 172.21.15.118:0/1670692697 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f0149e40 con 0x7f27f00c4ab0 2023-09-28T04:23:01.898 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.894+0000 7f27f67ff700 1 -- 172.21.15.118:0/1670692697 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f014a0e0 con 0x7f27f00c4ab0 2023-09-28T04:23:01.898 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.895+0000 7f27d7fff700 1 -- 172.21.15.118:0/1670692697 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f27e0013900 con 0x7f27f00c4ab0 2023-09-28T04:23:01.898 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.895+0000 7f27d7fff700 1 -- 172.21.15.118:0/1670692697 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f27e001cc70 con 0x7f27f00c4ab0 2023-09-28T04:23:01.898 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.895+0000 7f27f67ff700 1 -- 172.21.15.118:0/1670692697 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f0154af0 con 0x7f27f00c4ab0 2023-09-28T04:23:01.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.900+0000 7f27d7fff700 1 -- 172.21.15.118:0/1670692697 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f27e0021060 con 0x7f27f00c4ab0 2023-09-28T04:23:01.919 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:01.919+0000 7f0560e251c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-28T04:23:01.951 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:01.950+0000 7f8955c6a1c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-28T04:23:01.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.972+0000 7f27f67ff700 1 -- 172.21.15.118:0/1670692697 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27f00713a0 con 0x7f27f00c4ab0 2023-09-28T04:23:01.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.972+0000 7f27d7fff700 1 -- 172.21.15.118:0/1670692697 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f27e002a020 con 0x7f27f00c4ab0 2023-09-28T04:23:01.973 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":10,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:01.580166+0000","last_up_change":"0.000000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:01.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.974+0000 7f27f67ff700 1 -- 172.21.15.118:0/1670692697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00c4ab0 msgr2=0x7f27f0148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:01.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.974+0000 7f27f67ff700 1 --2- 172.21.15.118:0/1670692697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00c4ab0 0x7f27f0148f80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f27e000ec80 tx=0x7f27e0009120 comp rx=0 tx=0).stop 2023-09-28T04:23:01.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.974+0000 7f27f67ff700 1 -- 172.21.15.118:0/1670692697 shutdown_connections 2023-09-28T04:23:01.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.974+0000 7f27f67ff700 1 --2- 172.21.15.118:0/1670692697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27f00c6200 0x7f27f00c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.974+0000 7f27f67ff700 1 --2- 172.21.15.118:0/1670692697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00c4ab0 0x7f27f0148f80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.974+0000 7f27f67ff700 1 --2- 172.21.15.118:0/1670692697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27f00c5e30 0x7f27f00c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:01.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.974+0000 7f27f67ff700 1 -- 172.21.15.118:0/1670692697 >> 172.21.15.118:0/1670692697 conn(0x7f27f0063230 msgr2=0x7f27f014dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:01.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.974+0000 7f27f67ff700 1 -- 172.21.15.118:0/1670692697 shutdown_connections 2023-09-28T04:23:01.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:01.974+0000 7f27f67ff700 1 -- 172.21.15.118:0/1670692697 wait complete. 2023-09-28T04:23:01.991 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-28T04:23:01.991 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-28T04:23:01.997 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:01.997+0000 7f0560e251c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-28T04:23:02.074 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:02.073+0000 7f0560e251c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-28T04:23:02.121 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:02.120+0000 7f8955c6a1c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-28T04:23:02.156 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:02.156+0000 7f0560e251c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-28T04:23:02.208 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:02.207+0000 7f8955c6a1c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-28T04:23:02.218 INFO:tasks.ceph.osd.4.smithi174.stderr:2023-09-28T04:23:02.219+0000 7fc8df778540 -1 Falling back to public interface 2023-09-28T04:23:02.230 INFO:tasks.ceph.osd.7.smithi174.stderr:2023-09-28T04:23:02.230+0000 7fc67ede0540 -1 Falling back to public interface 2023-09-28T04:23:02.243 INFO:tasks.ceph.osd.6.smithi174.stderr:2023-09-28T04:23:02.243+0000 7f7ef955a540 -1 Falling back to public interface 2023-09-28T04:23:02.244 INFO:tasks.ceph.osd.5.smithi174.stderr:2023-09-28T04:23:02.243+0000 7f8c7029e540 -1 Falling back to public interface 2023-09-28T04:23:02.302 INFO:tasks.ceph.osd.3.smithi118.stderr:2023-09-28T04:23:02.302+0000 7ff16771f540 -1 Falling back to public interface 2023-09-28T04:23:02.336 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:02.336+0000 7f0560e251c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-28T04:23:02.337 INFO:tasks.ceph.osd.2.smithi118.stderr:2023-09-28T04:23:02.337+0000 7fd21ac24540 -1 Falling back to public interface 2023-09-28T04:23:02.341 INFO:tasks.ceph.osd.1.smithi118.stderr:2023-09-28T04:23:02.341+0000 7fa5544bc540 -1 Falling back to public interface 2023-09-28T04:23:02.342 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-09-28T04:23:02.342+0000 7fd1f0157540 -1 Falling back to public interface 2023-09-28T04:23:02.415 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:02.415+0000 7f0560e251c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-28T04:23:02.434 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:02.433+0000 7f8955c6a1c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-28T04:23:02.530 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:02.530+0000 7f8955c6a1c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-28T04:23:02.625 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:02.625+0000 7f8955c6a1c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-28T04:23:02.708 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:02.708+0000 7f0560e251c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-28T04:23:02.738 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:02.737+0000 7f8955c6a1c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-28T04:23:02.778 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:02.777+0000 7f0560e251c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-28T04:23:02.796 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:02.968 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.967+0000 7fcfa71ff700 1 Processor -- start 2023-09-28T04:23:02.968 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.967+0000 7fcfa71ff700 1 -- start start 2023-09-28T04:23:02.968 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:02.968+0000 7f8955c6a1c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-28T04:23:02.970 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.968+0000 7fcfa71ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfa00c6bd0 0x7fcfa0156650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:02.970 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.968+0000 7fcfa71ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcfa00c8360 0x7fcfa014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:02.970 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.968+0000 7fcfa71ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa00c16a0 con 0x7fcfa00c7f90 2023-09-28T04:23:02.970 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.968+0000 7fcfa71ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa00692f0 con 0x7fcfa00c8360 2023-09-28T04:23:02.970 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.968+0000 7fcfa71ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa0063af0 con 0x7fcfa00c6bd0 2023-09-28T04:23:02.970 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.969+0000 7fcfa4f9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fcfa00c7f90 0x7fcfa0068be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:58950/0 (socket says 172.21.15.118:58950) 2023-09-28T04:23:02.971 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.969+0000 7fcfa4f9b700 1 -- 172.21.15.118:0/2799737760 learned_addr learned my addr 172.21.15.118:0/2799737760 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:02.971 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.969+0000 7fcfa579c700 1 --2- 172.21.15.118:0/2799737760 >> v2:172.21.15.174:3300/0 conn(0x7fcfa00c8360 0x7fcfa014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:02.971 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.969+0000 7fcf9ffff700 1 --2- 172.21.15.118:0/2799737760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfa00c6bd0 0x7fcfa0156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:02.971 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.969+0000 7fcf9f7fe700 1 -- 172.21.15.118:0/2799737760 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060661510 0 0) 0x7fcfa00c16a0 con 0x7fcfa00c7f90 2023-09-28T04:23:02.971 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.969+0000 7fcf9f7fe700 1 -- 172.21.15.118:0/2799737760 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf90003570 con 0x7fcfa00c7f90 2023-09-28T04:23:02.971 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.969+0000 7fcf9ffff700 1 -- 172.21.15.118:0/2799737760 >> v2:172.21.15.174:3300/0 conn(0x7fcfa00c8360 msgr2=0x7fcfa014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:02.971 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.969+0000 7fcf9ffff700 1 --2- 172.21.15.118:0/2799737760 >> v2:172.21.15.174:3300/0 conn(0x7fcfa00c8360 0x7fcfa014f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:02.971 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.969+0000 7fcf9ffff700 1 -- 172.21.15.118:0/2799737760 >> v1:172.21.15.118:6789/0 conn(0x7fcfa00c7f90 legacy=0x7fcfa0068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:02.971 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.969+0000 7fcf9ffff700 1 -- 172.21.15.118:0/2799737760 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0063db0 con 0x7fcfa00c6bd0 2023-09-28T04:23:02.971 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.969+0000 7fcfa579c700 1 --2- 172.21.15.118:0/2799737760 >> v2:172.21.15.174:3300/0 conn(0x7fcfa00c8360 0x7fcfa014f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:02.971 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.969+0000 7fcf9ffff700 1 --2- 172.21.15.118:0/2799737760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfa00c6bd0 0x7fcfa0156650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0098e0 tx=0x7fcf8c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6bce2177a5078d server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:02.972 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.970+0000 7fcf9f7fe700 1 -- 172.21.15.118:0/2799737760 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c011630 con 0x7fcfa00c6bd0 2023-09-28T04:23:02.972 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.970+0000 7fcf9f7fe700 1 -- 172.21.15.118:0/2799737760 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c011790 con 0x7fcfa00c6bd0 2023-09-28T04:23:02.972 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.970+0000 7fcf9f7fe700 1 -- 172.21.15.118:0/2799737760 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c011b30 con 0x7fcfa00c6bd0 2023-09-28T04:23:02.973 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.970+0000 7fcfa71ff700 1 -- 172.21.15.118:0/2799737760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfa00c6bd0 msgr2=0x7fcfa0156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:02.973 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.970+0000 7fcfa71ff700 1 --2- 172.21.15.118:0/2799737760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfa00c6bd0 0x7fcfa0156650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0098e0 tx=0x7fcf8c0091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:02.973 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.970+0000 7fcfa71ff700 1 -- 172.21.15.118:0/2799737760 shutdown_connections 2023-09-28T04:23:02.973 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.970+0000 7fcfa71ff700 1 --2- 172.21.15.118:0/2799737760 >> v2:172.21.15.174:3300/0 conn(0x7fcfa00c8360 0x7fcfa014f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:02.973 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.970+0000 7fcfa71ff700 1 --2- 172.21.15.118:0/2799737760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfa00c6bd0 0x7fcfa0156650 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:02.973 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.970+0000 7fcfa71ff700 1 -- 172.21.15.118:0/2799737760 >> 172.21.15.118:0/2799737760 conn(0x7fcfa00ccaa0 msgr2=0x7fcfa00632c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:02.973 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.970+0000 7fcfa71ff700 1 -- 172.21.15.118:0/2799737760 shutdown_connections 2023-09-28T04:23:02.973 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.970+0000 7fcfa71ff700 1 -- 172.21.15.118:0/2799737760 wait complete. 2023-09-28T04:23:02.973 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.972+0000 7fcfa71ff700 1 Processor -- start 2023-09-28T04:23:02.974 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.972+0000 7fcfa71ff700 1 -- start start 2023-09-28T04:23:02.976 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcfa71ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfa00c6bd0 0x7fcfa0154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:02.976 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcfa71ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfa00c7f90 0x7fcfa00ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:02.976 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcfa71ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa00c8360 0x7fcfa00ac770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:02.976 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcfa71ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa0169d60 con 0x7fcfa00c8360 2023-09-28T04:23:02.976 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcfa71ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00abda0 con 0x7fcfa00c7f90 2023-09-28T04:23:02.976 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcfa71ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa01691e0 con 0x7fcfa00c6bd0 2023-09-28T04:23:02.976 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcf9ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfa00c7f90 0x7fcfa00ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:02.977 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcfa579c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa00c8360 0x7fcfa00ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:02.977 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcfa4f9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfa00c6bd0 0x7fcfa0154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:02.977 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcf9ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfa00c7f90 0x7fcfa00ac230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:41666/0 (socket says 172.21.15.118:41666) 2023-09-28T04:23:02.977 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcf9ffff700 1 -- 172.21.15.118:0/4117076965 learned_addr learned my addr 172.21.15.118:0/4117076965 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:02.977 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcf9ffff700 1 -- 172.21.15.118:0/4117076965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfa00c6bd0 msgr2=0x7fcfa0154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:02.977 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcf9ffff700 1 --2- 172.21.15.118:0/4117076965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfa00c6bd0 0x7fcfa0154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:02.977 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcf9ffff700 1 -- 172.21.15.118:0/4117076965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa00c8360 msgr2=0x7fcfa00ac770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:02.977 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.973+0000 7fcf9ffff700 1 --2- 172.21.15.118:0/4117076965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa00c8360 0x7fcfa00ac770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:02.977 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.974+0000 7fcf9ffff700 1 -- 172.21.15.118:0/4117076965 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98009a20 con 0x7fcfa00c7f90 2023-09-28T04:23:02.977 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.974+0000 7fcfa579c700 1 --2- 172.21.15.118:0/4117076965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa00c8360 0x7fcfa00ac770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:02.977 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.974+0000 7fcf9ffff700 1 --2- 172.21.15.118:0/4117076965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfa00c7f90 0x7fcfa00ac230 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c013000 tx=0x7fcf8c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:02.978 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.974+0000 7fcf9cff9700 1 -- 172.21.15.118:0/4117076965 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c011b10 con 0x7fcfa00c7f90 2023-09-28T04:23:02.978 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.974+0000 7fcf9cff9700 1 -- 172.21.15.118:0/4117076965 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c000cc0 con 0x7fcfa00c7f90 2023-09-28T04:23:02.978 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.974+0000 7fcfa71ff700 1 -- 172.21.15.118:0/4117076965 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8c009420 con 0x7fcfa00c7f90 2023-09-28T04:23:02.978 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.974+0000 7fcf9cff9700 1 -- 172.21.15.118:0/4117076965 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c025620 con 0x7fcfa00c7f90 2023-09-28T04:23:02.978 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.974+0000 7fcfa71ff700 1 -- 172.21.15.118:0/4117076965 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa01697a0 con 0x7fcfa00c7f90 2023-09-28T04:23:02.978 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.974+0000 7fcf9cff9700 1 -- 172.21.15.118:0/4117076965 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcf8c025c50 con 0x7fcfa00c7f90 2023-09-28T04:23:02.978 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.974+0000 7fcf9cff9700 1 -- 172.21.15.118:0/4117076965 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fcf8c02e3f0 con 0x7fcfa00c7f90 2023-09-28T04:23:02.978 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.975+0000 7fcfa71ff700 1 -- 172.21.15.118:0/4117076965 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa00713e0 con 0x7fcfa00c7f90 2023-09-28T04:23:02.979 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:02.978+0000 7fcf9cff9700 1 -- 172.21.15.118:0/4117076965 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fcf8c033060 con 0x7fcfa00c7f90 2023-09-28T04:23:03.050 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:03.049+0000 7fcfa71ff700 1 -- 172.21.15.118:0/4117076965 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfa004c3c0 con 0x7fcfa00c7f90 2023-09-28T04:23:03.050 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:03.050+0000 7fcf9cff9700 1 -- 172.21.15.118:0/4117076965 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fcf8c015020 con 0x7fcfa00c7f90 2023-09-28T04:23:03.051 INFO:teuthology.misc.health.smithi118.stdout: 2023-09-28T04:23:03.051 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":10,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:01.580166+0000","last_up_change":"0.000000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:03.052 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:03.051+0000 7fcfa71ff700 1 -- 172.21.15.118:0/4117076965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfa00c7f90 msgr2=0x7fcfa00ac230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:03.052 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:03.051+0000 7fcfa71ff700 1 --2- 172.21.15.118:0/4117076965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfa00c7f90 0x7fcfa00ac230 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c013000 tx=0x7fcf8c017000 comp rx=0 tx=0).stop 2023-09-28T04:23:03.052 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:03.051+0000 7fcfa71ff700 1 -- 172.21.15.118:0/4117076965 shutdown_connections 2023-09-28T04:23:03.052 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:03.051+0000 7fcfa71ff700 1 --2- 172.21.15.118:0/4117076965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa00c8360 0x7fcfa00ac770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:03.052 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:03.051+0000 7fcfa71ff700 1 --2- 172.21.15.118:0/4117076965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcfa00c6bd0 0x7fcfa0154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:03.052 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:03.051+0000 7fcfa71ff700 1 --2- 172.21.15.118:0/4117076965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfa00c7f90 0x7fcfa00ac230 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:03.052 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:03.051+0000 7fcfa71ff700 1 -- 172.21.15.118:0/4117076965 >> 172.21.15.118:0/4117076965 conn(0x7fcfa00ccaa0 msgr2=0x7fcfa014dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:03.053 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:03.051+0000 7fcfa71ff700 1 -- 172.21.15.118:0/4117076965 shutdown_connections 2023-09-28T04:23:03.053 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:03.051+0000 7fcfa71ff700 1 -- 172.21.15.118:0/4117076965 wait complete. 2023-09-28T04:23:03.066 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-28T04:23:03.073 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:03.072+0000 7f8955c6a1c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-28T04:23:03.285 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:03.285+0000 7f0560e251c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-28T04:23:03.420 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:03.420+0000 7f8955c6a1c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-28T04:23:03.510 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:03.509+0000 7f8955c6a1c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-28T04:23:03.603 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:03.603+0000 7f0560e251c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-28T04:23:03.745 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:03.745+0000 7f0560e251c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-28T04:23:04.102 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:04.102+0000 7f0560e251c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-28T04:23:04.125 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:04.125+0000 7f8955c6a1c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-28T04:23:04.247 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:04.247+0000 7f0560e251c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-28T04:23:04.396 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:04.396+0000 7f0560e251c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-28T04:23:04.498 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:04.497+0000 7f8955c6a1c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-28T04:23:04.498 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:04.498+0000 7f0560e251c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-28T04:23:04.681 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:04.680+0000 7f8955c6a1c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-28T04:23:05.153 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:05.152+0000 7f8955c6a1c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-28T04:23:05.397 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:05.396+0000 7f8955c6a1c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-28T04:23:05.523 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:05.523+0000 7f0525509700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-28T04:23:05.523 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-09-28T04:23:05.523+0000 7f0525509700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-28T04:23:05.590 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:05.590+0000 7f8955c6a1c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-28T04:23:05.709 INFO:tasks.ceph.osd.4.smithi174.stderr:2023-09-28T04:23:05.709+0000 7fc8df778540 -1 osd.4 0 log_to_monitors true 2023-09-28T04:23:05.720 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-09-28T04:23:05.720+0000 7f8955c6a1c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-28T04:23:05.765 INFO:tasks.ceph.osd.5.smithi174.stderr:2023-09-28T04:23:05.765+0000 7f8c7029e540 -1 osd.5 0 log_to_monitors true 2023-09-28T04:23:05.791 INFO:tasks.ceph.osd.6.smithi174.stderr:2023-09-28T04:23:05.791+0000 7f7ef955a540 -1 osd.6 0 log_to_monitors true 2023-09-28T04:23:05.796 INFO:tasks.ceph.osd.7.smithi174.stderr:2023-09-28T04:23:05.796+0000 7fc67ede0540 -1 osd.7 0 log_to_monitors true 2023-09-28T04:23:05.855 INFO:tasks.ceph.osd.3.smithi118.stderr:2023-09-28T04:23:05.855+0000 7ff16771f540 -1 osd.3 0 log_to_monitors true 2023-09-28T04:23:05.920 INFO:tasks.ceph.osd.2.smithi118.stderr:2023-09-28T04:23:05.919+0000 7fd21ac24540 -1 osd.2 0 log_to_monitors true 2023-09-28T04:23:05.941 INFO:tasks.ceph.osd.1.smithi118.stderr:2023-09-28T04:23:05.941+0000 7fa5544bc540 -1 osd.1 0 log_to_monitors true 2023-09-28T04:23:06.187 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-09-28T04:23:06.187+0000 7fd1f0157540 -1 osd.0 0 log_to_monitors true 2023-09-28T04:23:08.510 INFO:tasks.ceph.osd.7.smithi174.stderr:2023-09-28T04:23:08.510+0000 7fc6771e8700 -1 osd.7 0 waiting for initial osdmap 2023-09-28T04:23:08.516 INFO:tasks.ceph.osd.7.smithi174.stderr:2023-09-28T04:23:08.516+0000 7fc66e7dc700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T04:23:08.526 INFO:tasks.ceph.osd.5.smithi174.stderr:2023-09-28T04:23:08.526+0000 7f8c66ea3700 -1 osd.5 0 waiting for initial osdmap 2023-09-28T04:23:08.528 INFO:tasks.ceph.osd.6.smithi174.stderr:2023-09-28T04:23:08.527+0000 7f7ef015f700 -1 osd.6 0 waiting for initial osdmap 2023-09-28T04:23:08.530 INFO:tasks.ceph.osd.5.smithi174.stderr:2023-09-28T04:23:08.530+0000 7f8c5fc9a700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T04:23:08.531 INFO:tasks.ceph.osd.6.smithi174.stderr:2023-09-28T04:23:08.531+0000 7f7ee8f56700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T04:23:08.542 INFO:tasks.ceph.osd.4.smithi174.stderr:2023-09-28T04:23:08.542+0000 7fc8d7b80700 -1 osd.4 0 waiting for initial osdmap 2023-09-28T04:23:08.545 INFO:tasks.ceph.osd.4.smithi174.stderr:2023-09-28T04:23:08.545+0000 7fc8cf174700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T04:23:08.772 INFO:tasks.ceph.osd.1.smithi118.stderr:2023-09-28T04:23:08.770+0000 7fa547ff6700 -1 osd.1 0 waiting for initial osdmap 2023-09-28T04:23:08.780 INFO:tasks.ceph.osd.1.smithi118.stderr:2023-09-28T04:23:08.779+0000 7fa540fe8700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T04:23:08.808 INFO:tasks.ceph.osd.3.smithi118.stderr:2023-09-28T04:23:08.807+0000 7ff15b1f6700 -1 osd.3 0 waiting for initial osdmap 2023-09-28T04:23:08.814 INFO:tasks.ceph.osd.3.smithi118.stderr:2023-09-28T04:23:08.814+0000 7ff1541e8700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T04:23:08.854 INFO:tasks.ceph.osd.2.smithi118.stderr:2023-09-28T04:23:08.853+0000 7fd20e7f6700 -1 osd.2 0 waiting for initial osdmap 2023-09-28T04:23:08.859 INFO:tasks.ceph.osd.2.smithi118.stderr:2023-09-28T04:23:08.858+0000 7fd2077e8700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T04:23:09.032 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-09-28T04:23:09.032+0000 7fd1e3bf6700 -1 osd.0 0 waiting for initial osdmap 2023-09-28T04:23:09.037 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-09-28T04:23:09.036+0000 7fd1dcbe8700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T04:23:09.872 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:10.038 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.038+0000 7f33e91ff700 1 Processor -- start 2023-09-28T04:23:10.038 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.038+0000 7f33e91ff700 1 -- start start 2023-09-28T04:23:10.039 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.039+0000 7f33e91ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f33e40c7f90 0x7f33e4156650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:10.040 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.039+0000 7f33e91ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e40c8360 0x7f33e414f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:10.040 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.039+0000 7f33e91ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e40c16a0 con 0x7f33e40c6bd0 2023-09-28T04:23:10.040 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.039+0000 7f33e91ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e40692f0 con 0x7f33e40c7f90 2023-09-28T04:23:10.040 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.039+0000 7f33e91ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e4063af0 con 0x7f33e40c8360 2023-09-28T04:23:10.041 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.039+0000 7f33e359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e40c8360 0x7f33e414f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:10.042 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.039+0000 7f33e2d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f33e40c7f90 0x7f33e4156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:10.042 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.039+0000 7f33e2d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f33e40c7f90 0x7f33e4156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:51166/0 (socket says 172.21.15.118:51166) 2023-09-28T04:23:10.042 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.039+0000 7f33e359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e40c8360 0x7f33e414f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:45216/0 (socket says 172.21.15.118:45216) 2023-09-28T04:23:10.042 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.039+0000 7f33e2d9d700 1 -- 172.21.15.118:0/537548907 learned_addr learned my addr 172.21.15.118:0/537548907 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:10.042 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.040+0000 7f33e2d9d700 1 -- 172.21.15.118:0/537548907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e40c8360 msgr2=0x7f33e414f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:10.042 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.040+0000 7f33e2d9d700 1 --2- 172.21.15.118:0/537548907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e40c8360 0x7f33e414f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.042 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.040+0000 7f33e2d9d700 1 -- 172.21.15.118:0/537548907 >> v1:172.21.15.174:6789/0 conn(0x7f33e40c6bd0 legacy=0x7f33e4068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:10.042 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.040+0000 7f33e2d9d700 1 -- 172.21.15.118:0/537548907 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e4063db0 con 0x7f33e40c7f90 2023-09-28T04:23:10.042 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.040+0000 7f33e359e700 1 --2- 172.21.15.118:0/537548907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e40c8360 0x7f33e414f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:10.043 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.040+0000 7f33e1d9b700 1 -- 172.21.15.118:0/537548907 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420951228 0 0) 0x7f33e40c16a0 con 0x7f33e40c6bd0 2023-09-28T04:23:10.043 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.040+0000 7f33e2d9d700 1 --2- 172.21.15.118:0/537548907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33e40c7f90 0x7f33e4156650 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33d40099b0 tx=0x7f33d4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11f68cb8db47ac8e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:10.043 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.040+0000 7f33e1d9b700 1 -- 172.21.15.118:0/537548907 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4009ea0 con 0x7f33e40c7f90 2023-09-28T04:23:10.043 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.040+0000 7f33e1d9b700 1 -- 172.21.15.118:0/537548907 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d400b8f0 con 0x7f33e40c7f90 2023-09-28T04:23:10.043 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.040+0000 7f33e1d9b700 1 -- 172.21.15.118:0/537548907 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d400bc90 con 0x7f33e40c7f90 2023-09-28T04:23:10.043 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.041+0000 7f33e91ff700 1 -- 172.21.15.118:0/537548907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33e40c7f90 msgr2=0x7f33e4156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:10.043 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.041+0000 7f33e91ff700 1 --2- 172.21.15.118:0/537548907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33e40c7f90 0x7f33e4156650 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33d40099b0 tx=0x7f33d4009250 comp rx=0 tx=0).stop 2023-09-28T04:23:10.043 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.041+0000 7f33e91ff700 1 -- 172.21.15.118:0/537548907 shutdown_connections 2023-09-28T04:23:10.043 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.041+0000 7f33e91ff700 1 --2- 172.21.15.118:0/537548907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e40c8360 0x7f33e414f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.043 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.041+0000 7f33e91ff700 1 --2- 172.21.15.118:0/537548907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33e40c7f90 0x7f33e4156650 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.043 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.041+0000 7f33e91ff700 1 -- 172.21.15.118:0/537548907 >> 172.21.15.118:0/537548907 conn(0x7f33e40ccaa0 msgr2=0x7f33e40632c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:10.043 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.041+0000 7f33e91ff700 1 -- 172.21.15.118:0/537548907 shutdown_connections 2023-09-28T04:23:10.043 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.041+0000 7f33e91ff700 1 -- 172.21.15.118:0/537548907 wait complete. 2023-09-28T04:23:10.045 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.042+0000 7f33e91ff700 1 Processor -- start 2023-09-28T04:23:10.046 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.043+0000 7f33e91ff700 1 -- start start 2023-09-28T04:23:10.046 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.043+0000 7f33e91ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33e40c6bd0 0x7f33e415af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:10.046 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.043+0000 7f33e91ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e40c7f90 0x7f33e4154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:10.046 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.043+0000 7f33e91ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33e40c8360 0x7f33e4154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:10.046 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.043+0000 7f33e91ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e415c3d0 con 0x7f33e40c8360 2023-09-28T04:23:10.046 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.043+0000 7f33e91ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e4155300 con 0x7f33e40c6bd0 2023-09-28T04:23:10.046 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.043+0000 7f33e91ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e415a310 con 0x7f33e40c7f90 2023-09-28T04:23:10.046 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.044+0000 7f33e2d9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33e40c6bd0 0x7f33e415af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:10.046 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.044+0000 7f33e359e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33e40c8360 0x7f33e4154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:10.046 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.044+0000 7f33e2d9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33e40c6bd0 0x7f33e415af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:51178/0 (socket says 172.21.15.118:51178) 2023-09-28T04:23:10.047 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.044+0000 7f33e2d9d700 1 -- 172.21.15.118:0/1779509545 learned_addr learned my addr 172.21.15.118:0/1779509545 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:10.047 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.044+0000 7f33e259c700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e40c7f90 0x7f33e4154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:10.047 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.044+0000 7f33e2d9d700 1 -- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e40c7f90 msgr2=0x7f33e4154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:10.047 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.044+0000 7f33e2d9d700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e40c7f90 0x7f33e4154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.047 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.044+0000 7f33e2d9d700 1 -- 172.21.15.118:0/1779509545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33e40c8360 msgr2=0x7f33e4154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:10.047 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.044+0000 7f33e2d9d700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33e40c8360 0x7f33e4154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.047 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.044+0000 7f33e2d9d700 1 -- 172.21.15.118:0/1779509545 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc009a20 con 0x7f33e40c6bd0 2023-09-28T04:23:10.047 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.044+0000 7f33e359e700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33e40c8360 0x7f33e4154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:10.047 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.044+0000 7f33e259c700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e40c7f90 0x7f33e4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:10.047 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.044+0000 7f33e2d9d700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33e40c6bd0 0x7f33e415af80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f33d4006fd0 tx=0x7f33d4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:10.047 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.045+0000 7f33caffd700 1 -- 172.21.15.118:0/1779509545 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d400ba60 con 0x7f33e40c6bd0 2023-09-28T04:23:10.047 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.045+0000 7f33caffd700 1 -- 172.21.15.118:0/1779509545 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d400bbc0 con 0x7f33e40c6bd0 2023-09-28T04:23:10.047 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.045+0000 7f33e91ff700 1 -- 172.21.15.118:0/1779509545 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d40094f0 con 0x7f33e40c6bd0 2023-09-28T04:23:10.048 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.045+0000 7f33caffd700 1 -- 172.21.15.118:0/1779509545 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4026680 con 0x7f33e40c6bd0 2023-09-28T04:23:10.048 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.045+0000 7f33e91ff700 1 -- 172.21.15.118:0/1779509545 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e415a540 con 0x7f33e40c6bd0 2023-09-28T04:23:10.048 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.046+0000 7f33e91ff700 1 -- 172.21.15.118:0/1779509545 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e40713e0 con 0x7f33e40c6bd0 2023-09-28T04:23:10.048 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.047+0000 7f33caffd700 1 -- 172.21.15.118:0/1779509545 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 84984+0+0 (secure 0 0 0) 0x7f33d4023030 con 0x7f33e40c6bd0 2023-09-28T04:23:10.048 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.048+0000 7f33caffd700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f33d00672a0 0x7f33d0069750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:10.049 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.048+0000 7f33caffd700 1 -- 172.21.15.118:0/1779509545 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f33d4084fe0 con 0x7f33e40c6bd0 2023-09-28T04:23:10.049 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.048+0000 7f33e259c700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f33d00672a0 0x7f33d0069750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:10.049 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.048+0000 7f33e259c700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f33d00672a0 0x7f33d0069750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f33d8007fd0 tx=0x7f33d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:10.053 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.052+0000 7f33caffd700 1 -- 172.21.15.118:0/1779509545 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f33d4052690 con 0x7f33e40c6bd0 2023-09-28T04:23:10.243 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.243+0000 7f33e91ff700 1 -- 172.21.15.118:0/1779509545 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33e404c3c0 con 0x7f33e40c6bd0 2023-09-28T04:23:10.244 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.244+0000 7f33caffd700 1 -- 172.21.15.118:0/1779509545 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10540 (secure 0 0 0) 0x7f33d4055cb0 con 0x7f33e40c6bd0 2023-09-28T04:23:10.245 INFO:teuthology.misc.health.smithi118.stdout: 2023-09-28T04:23:10.245 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":13,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:09.517312+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:10.247 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.246+0000 7f33e91ff700 1 -- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f33d00672a0 msgr2=0x7f33d0069750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:10.247 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.246+0000 7f33e91ff700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f33d00672a0 0x7f33d0069750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f33d8007fd0 tx=0x7f33d8009040 comp rx=0 tx=0).stop 2023-09-28T04:23:10.247 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.246+0000 7f33e91ff700 1 -- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33e40c6bd0 msgr2=0x7f33e415af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:10.247 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.246+0000 7f33e91ff700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33e40c6bd0 0x7f33e415af80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f33d4006fd0 tx=0x7f33d4017000 comp rx=0 tx=0).stop 2023-09-28T04:23:10.247 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.246+0000 7f33e91ff700 1 -- 172.21.15.118:0/1779509545 shutdown_connections 2023-09-28T04:23:10.247 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.246+0000 7f33e91ff700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f33d00672a0 0x7f33d0069750 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.247 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.246+0000 7f33e91ff700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33e40c8360 0x7f33e4154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.247 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.246+0000 7f33e91ff700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33e40c6bd0 0x7f33e415af80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.247 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.246+0000 7f33e91ff700 1 --2- 172.21.15.118:0/1779509545 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33e40c7f90 0x7f33e4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.248 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.246+0000 7f33e91ff700 1 -- 172.21.15.118:0/1779509545 >> 172.21.15.118:0/1779509545 conn(0x7f33e40ccaa0 msgr2=0x7f33e414dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:10.248 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.246+0000 7f33e91ff700 1 -- 172.21.15.118:0/1779509545 shutdown_connections 2023-09-28T04:23:10.248 INFO:teuthology.misc.health.smithi118.stderr:2023-09-28T04:23:10.246+0000 7f33e91ff700 1 -- 172.21.15.118:0/1779509545 wait complete. 2023-09-28T04:23:10.262 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-09-28T04:23:10.262 INFO:tasks.ceph:Creating RBD pool 2023-09-28T04:23:10.262 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-28T04:23:10.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.444+0000 7f848d5ff700 1 Processor -- start 2023-09-28T04:23:10.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.444+0000 7f848d5ff700 1 -- start start 2023-09-28T04:23:10.448 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.445+0000 7f848d5ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f848814fa90 0x7f8488156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:10.448 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.445+0000 7f848d5ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84880c84c0 0x7f8488068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:10.448 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.445+0000 7f848d5ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84880c8030 con 0x7f848814fe60 2023-09-28T04:23:10.448 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.445+0000 7f848d5ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84880c7180 con 0x7f848814fa90 2023-09-28T04:23:10.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.445+0000 7f848d5ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84880c7420 con 0x7f84880c84c0 2023-09-28T04:23:10.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.446+0000 7f8486ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f848814fa90 0x7f8488156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:10.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.446+0000 7f84877fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84880c84c0 0x7f8488068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:10.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.446+0000 7f84867fc700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f848814fe60 0x7f84880cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46050/0 (socket says 172.21.15.118:46050) 2023-09-28T04:23:10.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.446+0000 7f84867fc700 1 -- 172.21.15.118:0/1713267960 learned_addr learned my addr 172.21.15.118:0/1713267960 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:10.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.446+0000 7f8485ffb700 1 -- 172.21.15.118:0/1713267960 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774412542 0 0) 0x7f84880c8030 con 0x7f848814fe60 2023-09-28T04:23:10.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.446+0000 7f8485ffb700 1 -- 172.21.15.118:0/1713267960 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8470003570 con 0x7f848814fe60 2023-09-28T04:23:10.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.446+0000 7f84877fe700 1 -- 172.21.15.118:0/1713267960 >> v2:172.21.15.174:3300/0 conn(0x7f848814fa90 msgr2=0x7f8488156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:10.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.446+0000 7f84877fe700 1 --2- 172.21.15.118:0/1713267960 >> v2:172.21.15.174:3300/0 conn(0x7f848814fa90 0x7f8488156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.446+0000 7f84877fe700 1 -- 172.21.15.118:0/1713267960 >> v1:172.21.15.174:6789/0 conn(0x7f848814fe60 legacy=0x7f84880cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:10.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.446+0000 7f84877fe700 1 -- 172.21.15.118:0/1713267960 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84880c7700 con 0x7f84880c84c0 2023-09-28T04:23:10.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.446+0000 7f84877fe700 1 --2- 172.21.15.118:0/1713267960 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84880c84c0 0x7f8488068b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8480009e60 tx=0x7f8480009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d174da9057a2869c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:10.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.446+0000 7f8485ffb700 1 -- 172.21.15.118:0/1713267960 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848000e070 con 0x7f84880c84c0 2023-09-28T04:23:10.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.447+0000 7f8485ffb700 1 -- 172.21.15.118:0/1713267960 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848000bab0 con 0x7f84880c84c0 2023-09-28T04:23:10.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.447+0000 7f8485ffb700 1 -- 172.21.15.118:0/1713267960 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848000be70 con 0x7f84880c84c0 2023-09-28T04:23:10.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.447+0000 7f848d5ff700 1 -- 172.21.15.118:0/1713267960 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84880c84c0 msgr2=0x7f8488068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:10.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.447+0000 7f848d5ff700 1 --2- 172.21.15.118:0/1713267960 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84880c84c0 0x7f8488068b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8480009e60 tx=0x7f8480009780 comp rx=0 tx=0).stop 2023-09-28T04:23:10.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.447+0000 7f848d5ff700 1 -- 172.21.15.118:0/1713267960 shutdown_connections 2023-09-28T04:23:10.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.447+0000 7f848d5ff700 1 --2- 172.21.15.118:0/1713267960 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84880c84c0 0x7f8488068b90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.447+0000 7f848d5ff700 1 --2- 172.21.15.118:0/1713267960 >> v2:172.21.15.174:3300/0 conn(0x7f848814fa90 0x7f8488156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.447+0000 7f848d5ff700 1 -- 172.21.15.118:0/1713267960 >> 172.21.15.118:0/1713267960 conn(0x7f8488063cd0 msgr2=0x7f84880cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.447+0000 7f848d5ff700 1 -- 172.21.15.118:0/1713267960 shutdown_connections 2023-09-28T04:23:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.447+0000 7f848d5ff700 1 -- 172.21.15.118:0/1713267960 wait complete. 2023-09-28T04:23:10.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.449+0000 7f848d5ff700 1 Processor -- start 2023-09-28T04:23:10.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.449+0000 7f848d5ff700 1 -- start start 2023-09-28T04:23:10.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f848d5ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84880c84c0 0x7f8488154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:10.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f848d5ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f848814fa90 0x7f848815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:10.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f848d5ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f848814fe60 0x7f8488148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:10.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f848d5ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84881546a0 con 0x7f848814fe60 2023-09-28T04:23:10.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f848d5ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8488152be0 con 0x7f848814fa90 2023-09-28T04:23:10.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f848d5ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8488159c60 con 0x7f84880c84c0 2023-09-28T04:23:10.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f84877fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f848814fe60 0x7f8488148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:10.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f84877fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f848814fe60 0x7f8488148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38110/0 (socket says 172.21.15.118:38110) 2023-09-28T04:23:10.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f84877fe700 1 -- 172.21.15.118:0/3506819417 learned_addr learned my addr 172.21.15.118:0/3506819417 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:10.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f84867fc700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f848814fa90 0x7f848815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:10.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f8486ffd700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84880c84c0 0x7f8488154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:10.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f84877fe700 1 -- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84880c84c0 msgr2=0x7f8488154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:10.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f84877fe700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84880c84c0 0x7f8488154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f84877fe700 1 -- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f848814fa90 msgr2=0x7f848815b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:10.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f84877fe700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f848814fa90 0x7f848815b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:10.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.450+0000 7f84877fe700 1 -- 172.21.15.118:0/3506819417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8480009a20 con 0x7f848814fe60 2023-09-28T04:23:10.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.451+0000 7f84877fe700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f848814fe60 0x7f8488148db0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f84880c7560 tx=0x7f8480019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:10.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.451+0000 7f846effd700 1 -- 172.21.15.118:0/3506819417 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480012e10 con 0x7f848814fe60 2023-09-28T04:23:10.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.451+0000 7f846effd700 1 -- 172.21.15.118:0/3506819417 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8480027470 con 0x7f848814fe60 2023-09-28T04:23:10.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.451+0000 7f846effd700 1 -- 172.21.15.118:0/3506819417 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480027830 con 0x7f848814fe60 2023-09-28T04:23:10.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.451+0000 7f848d5ff700 1 -- 172.21.15.118:0/3506819417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8488151430 con 0x7f848814fe60 2023-09-28T04:23:10.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.451+0000 7f848d5ff700 1 -- 172.21.15.118:0/3506819417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848815be70 con 0x7f848814fe60 2023-09-28T04:23:10.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.452+0000 7f848d5ff700 1 -- 172.21.15.118:0/3506819417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848815c030 con 0x7f848814fe60 2023-09-28T04:23:10.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.453+0000 7f846effd700 1 -- 172.21.15.118:0/3506819417 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 84984+0+0 (secure 0 0 0) 0x7f8480024070 con 0x7f848814fe60 2023-09-28T04:23:10.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.454+0000 7f846effd700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f84740672a0 0x7f8474069750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:10.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.454+0000 7f846effd700 1 -- 172.21.15.118:0/3506819417 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f8480086f90 con 0x7f848814fe60 2023-09-28T04:23:10.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.454+0000 7f8486ffd700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f84740672a0 0x7f8474069750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:10.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.455+0000 7f8486ffd700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f84740672a0 0x7f8474069750 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8478009d10 tx=0x7f84780091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:10.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.459+0000 7f846effd700 1 -- 172.21.15.118:0/3506819417 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8480054500 con 0x7f848814fe60 2023-09-28T04:23:10.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:10.658+0000 7f848d5ff700 1 -- 172.21.15.118:0/3506819417 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f84881556a0 con 0x7f848814fe60 2023-09-28T04:23:11.598 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.597+0000 7f846effd700 1 -- 172.21.15.118:0/3506819417 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f84881556a0 con 0x7f848814fe60 2023-09-28T04:23:11.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.602+0000 7f848d5ff700 1 -- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f84740672a0 msgr2=0x7f8474069750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:11.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.602+0000 7f848d5ff700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f84740672a0 0x7f8474069750 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8478009d10 tx=0x7f84780091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:11.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.602+0000 7f848d5ff700 1 -- 172.21.15.118:0/3506819417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f848814fe60 msgr2=0x7f8488148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:11.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.602+0000 7f848d5ff700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f848814fe60 0x7f8488148db0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f84880c7560 tx=0x7f8480019000 comp rx=0 tx=0).stop 2023-09-28T04:23:11.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.602+0000 7f848d5ff700 1 -- 172.21.15.118:0/3506819417 shutdown_connections 2023-09-28T04:23:11.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.602+0000 7f848d5ff700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f84740672a0 0x7f8474069750 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:11.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.602+0000 7f848d5ff700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f848814fe60 0x7f8488148db0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:11.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.602+0000 7f848d5ff700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84880c84c0 0x7f8488154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:11.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.602+0000 7f848d5ff700 1 --2- 172.21.15.118:0/3506819417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f848814fa90 0x7f848815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:11.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.602+0000 7f848d5ff700 1 -- 172.21.15.118:0/3506819417 >> 172.21.15.118:0/3506819417 conn(0x7f8488063cd0 msgr2=0x7f848814c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:11.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.603+0000 7f848d5ff700 1 -- 172.21.15.118:0/3506819417 shutdown_connections 2023-09-28T04:23:11.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.603+0000 7f848d5ff700 1 -- 172.21.15.118:0/3506819417 wait complete. 2023-09-28T04:23:11.605 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'rbd' created 2023-09-28T04:23:11.625 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-28T04:23:11.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.822+0000 7fd1cc1ff700 1 Processor -- start 2023-09-28T04:23:11.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.823+0000 7fd1cc1ff700 1 -- start start 2023-09-28T04:23:11.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.824+0000 7fd1cc1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c40677f0 0x7fd1c4155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:11.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.824+0000 7fd1cc1ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1c4067bc0 0x7fd1c406bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:11.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.824+0000 7fd1cc1ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c414c410 con 0x7fd1c406ed80 2023-09-28T04:23:11.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.824+0000 7fd1cc1ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c4156110 con 0x7fd1c4067bc0 2023-09-28T04:23:11.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.824+0000 7fd1cc1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c406c3e0 con 0x7fd1c40677f0 2023-09-28T04:23:11.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.824+0000 7fd1c9f9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c40677f0 0x7fd1c4155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:11.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.824+0000 7fd1c979a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd1c406ed80 0x7fd1c40c2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:55410/0 (socket says 172.21.15.118:55410) 2023-09-28T04:23:11.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.824+0000 7fd1c979a700 1 -- 172.21.15.118:0/481160596 learned_addr learned my addr 172.21.15.118:0/481160596 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:11.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.824+0000 7fd1ca79c700 1 --2- 172.21.15.118:0/481160596 >> v2:172.21.15.174:3300/0 conn(0x7fd1c4067bc0 0x7fd1c406bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:11.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.825+0000 7fd1c9f9b700 1 -- 172.21.15.118:0/481160596 >> v2:172.21.15.174:3300/0 conn(0x7fd1c4067bc0 msgr2=0x7fd1c406bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:11.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.825+0000 7fd1c9f9b700 1 --2- 172.21.15.118:0/481160596 >> v2:172.21.15.174:3300/0 conn(0x7fd1c4067bc0 0x7fd1c406bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:11.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.825+0000 7fd1c8f99700 1 -- 172.21.15.118:0/481160596 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798305437 0 0) 0x7fd1c414c410 con 0x7fd1c406ed80 2023-09-28T04:23:11.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.825+0000 7fd1c9f9b700 1 -- 172.21.15.118:0/481160596 >> v1:172.21.15.118:6789/0 conn(0x7fd1c406ed80 legacy=0x7fd1c40c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:11.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.825+0000 7fd1c9f9b700 1 -- 172.21.15.118:0/481160596 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c406e8f0 con 0x7fd1c40677f0 2023-09-28T04:23:11.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.825+0000 7fd1ca79c700 1 --2- 172.21.15.118:0/481160596 >> v2:172.21.15.174:3300/0 conn(0x7fd1c4067bc0 0x7fd1c406bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:11.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.825+0000 7fd1c9f9b700 1 --2- 172.21.15.118:0/481160596 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c40677f0 0x7fd1c4155bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00098e0 tx=0x7fd1c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95f68a568210a5df server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:11.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.825+0000 7fd1c8f99700 1 -- 172.21.15.118:0/481160596 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c000b640 con 0x7fd1c40677f0 2023-09-28T04:23:11.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.825+0000 7fd1c8f99700 1 -- 172.21.15.118:0/481160596 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c000b7a0 con 0x7fd1c40677f0 2023-09-28T04:23:11.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.825+0000 7fd1c8f99700 1 -- 172.21.15.118:0/481160596 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c000bb40 con 0x7fd1c40677f0 2023-09-28T04:23:11.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.826+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/481160596 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c40677f0 msgr2=0x7fd1c4155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:11.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.826+0000 7fd1cc1ff700 1 --2- 172.21.15.118:0/481160596 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c40677f0 0x7fd1c4155bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00098e0 tx=0x7fd1c00091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:11.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.826+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/481160596 shutdown_connections 2023-09-28T04:23:11.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.826+0000 7fd1cc1ff700 1 --2- 172.21.15.118:0/481160596 >> v2:172.21.15.174:3300/0 conn(0x7fd1c4067bc0 0x7fd1c406bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:11.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.826+0000 7fd1cc1ff700 1 --2- 172.21.15.118:0/481160596 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c40677f0 0x7fd1c4155bd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:11.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.826+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/481160596 >> 172.21.15.118:0/481160596 conn(0x7fd1c40c7ba0 msgr2=0x7fd1c40c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:11.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.826+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/481160596 shutdown_connections 2023-09-28T04:23:11.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.826+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/481160596 wait complete. 2023-09-28T04:23:11.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.827+0000 7fd1cc1ff700 1 Processor -- start 2023-09-28T04:23:11.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.827+0000 7fd1cc1ff700 1 -- start start 2023-09-28T04:23:11.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.828+0000 7fd1cc1ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1c40677f0 0x7fd1c414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:11.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.828+0000 7fd1cc1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c4067bc0 0x7fd1c414c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:11.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.828+0000 7fd1cc1ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1c406ed80 0x7fd1c4168af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:11.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.828+0000 7fd1cc1ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4168660 con 0x7fd1c40677f0 2023-09-28T04:23:11.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.828+0000 7fd1cc1ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c414fab0 con 0x7fd1c406ed80 2023-09-28T04:23:11.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.828+0000 7fd1cc1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c414f4b0 con 0x7fd1c4067bc0 2023-09-28T04:23:11.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1c9f9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1c40677f0 0x7fd1c414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:11.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1c979a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c4067bc0 0x7fd1c414c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:11.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1ca79c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1c406ed80 0x7fd1c4168af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:11.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1c9f9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1c40677f0 0x7fd1c414ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38124/0 (socket says 172.21.15.118:38124) 2023-09-28T04:23:11.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1c9f9b700 1 -- 172.21.15.118:0/1410732642 learned_addr learned my addr 172.21.15.118:0/1410732642 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:11.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1ca79c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1c406ed80 0x7fd1c4168af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:51218/0 (socket says 172.21.15.118:51218) 2023-09-28T04:23:11.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1ca79c700 1 -- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c4067bc0 msgr2=0x7fd1c414c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:11.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1ca79c700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c4067bc0 0x7fd1c414c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:11.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1ca79c700 1 -- 172.21.15.118:0/1410732642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1c40677f0 msgr2=0x7fd1c414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:11.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1ca79c700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1c40677f0 0x7fd1c414ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:11.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1ca79c700 1 -- 172.21.15.118:0/1410732642 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc009a20 con 0x7fd1c406ed80 2023-09-28T04:23:11.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1c979a700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c4067bc0 0x7fd1c414c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:11.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1c9f9b700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1c40677f0 0x7fd1c414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:11.833 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1ca79c700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1c406ed80 0x7fd1c4168af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009f10 tx=0x7fd1bc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:11.833 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1b9ffb700 1 -- 172.21.15.118:0/1410732642 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00cc00 con 0x7fd1c406ed80 2023-09-28T04:23:11.833 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1b9ffb700 1 -- 172.21.15.118:0/1410732642 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc00f040 con 0x7fd1c406ed80 2023-09-28T04:23:11.833 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/1410732642 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c0009420 con 0x7fd1c406ed80 2023-09-28T04:23:11.833 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.829+0000 7fd1b9ffb700 1 -- 172.21.15.118:0/1410732642 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc014480 con 0x7fd1c406ed80 2023-09-28T04:23:11.833 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.830+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/1410732642 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c4150030 con 0x7fd1c406ed80 2023-09-28T04:23:11.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.831+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/1410732642 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c41687d0 con 0x7fd1c406ed80 2023-09-28T04:23:11.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.832+0000 7fd1b9ffb700 1 -- 172.21.15.118:0/1410732642 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 84984+0+0 (secure 0 0 0) 0x7fd1bc003020 con 0x7fd1c406ed80 2023-09-28T04:23:11.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.832+0000 7fd1b9ffb700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd1a80672a0 0x7fd1a8069750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:11.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.832+0000 7fd1b9ffb700 1 -- 172.21.15.118:0/1410732642 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5195+0+0 (secure 0 0 0) 0x7fd1bc085190 con 0x7fd1c406ed80 2023-09-28T04:23:11.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.833+0000 7fd1c9f9b700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd1a80672a0 0x7fd1a8069750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:11.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.833+0000 7fd1c9f9b700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd1a80672a0 0x7fd1a8069750 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0003080 tx=0x7fd1c0018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:11.837 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:11.836+0000 7fd1b9ffb700 1 -- 172.21.15.118:0/1410732642 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd1bc052430 con 0x7fd1c406ed80 2023-09-28T04:23:12.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.044+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/1410732642 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd1c4071980 con 0x7fd1c406ed80 2023-09-28T04:23:12.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.598+0000 7fd1b9ffb700 1 -- 172.21.15.118:0/1410732642 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd1bc055a50 con 0x7fd1c406ed80 2023-09-28T04:23:12.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.602+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd1a80672a0 msgr2=0x7fd1a8069750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:12.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.602+0000 7fd1cc1ff700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd1a80672a0 0x7fd1a8069750 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0003080 tx=0x7fd1c0018000 comp rx=0 tx=0).stop 2023-09-28T04:23:12.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.602+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1c406ed80 msgr2=0x7fd1c4168af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:12.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.602+0000 7fd1cc1ff700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1c406ed80 0x7fd1c4168af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009f10 tx=0x7fd1bc00b040 comp rx=0 tx=0).stop 2023-09-28T04:23:12.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.602+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/1410732642 shutdown_connections 2023-09-28T04:23:12.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.602+0000 7fd1cc1ff700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd1a80672a0 0x7fd1a8069750 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:12.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.603+0000 7fd1cc1ff700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1c406ed80 0x7fd1c4168af0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:12.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.603+0000 7fd1cc1ff700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1c40677f0 0x7fd1c414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:12.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.603+0000 7fd1cc1ff700 1 --2- 172.21.15.118:0/1410732642 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1c4067bc0 0x7fd1c414c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:12.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.603+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/1410732642 >> 172.21.15.118:0/1410732642 conn(0x7fd1c40c7ba0 msgr2=0x7fd1c40c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:12.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.603+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/1410732642 shutdown_connections 2023-09-28T04:23:12.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.603+0000 7fd1cc1ff700 1 -- 172.21.15.118:0/1410732642 wait complete. 2023-09-28T04:23:12.606 INFO:teuthology.orchestra.run.smithi118.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-28T04:23:12.621 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-28T04:23:12.622 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-28T04:23:12.622 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-28T04:23:12.626 INFO:tasks.ceph.mds.a:Started 2023-09-28T04:23:12.626 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-28T04:23:12.626 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-28T04:23:12.630 INFO:tasks.ceph.mds.c:Started 2023-09-28T04:23:12.630 INFO:tasks.ceph.mds.e:Restarting daemon 2023-09-28T04:23:12.630 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2023-09-28T04:23:12.634 INFO:tasks.ceph.mds.e:Started 2023-09-28T04:23:12.635 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-28T04:23:12.635 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-28T04:23:12.637 INFO:tasks.ceph.mds.b:Started 2023-09-28T04:23:12.637 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-28T04:23:12.637 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-28T04:23:12.639 INFO:tasks.ceph.mds.d:Started 2023-09-28T04:23:12.639 INFO:tasks.ceph.mds.f:Restarting daemon 2023-09-28T04:23:12.639 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2023-09-28T04:23:12.641 INFO:tasks.ceph.mds.f:Started 2023-09-28T04:23:12.641 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-28T04:23:12.641 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:12.717 INFO:tasks.ceph.mds.f.smithi174.stdout:starting mds.f at 2023-09-28T04:23:12.717 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2023-09-28T04:23:12.722 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2023-09-28T04:23:12.802 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2023-09-28T04:23:12.804 INFO:tasks.ceph.mds.e.smithi118.stdout:starting mds.e at 2023-09-28T04:23:12.809 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2023-09-28T04:23:12.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.862+0000 7fab087ff700 1 Processor -- start 2023-09-28T04:23:12.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.862+0000 7fab087ff700 1 -- start start 2023-09-28T04:23:12.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.863+0000 7fab087ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fab000adf10 0x7fab001562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:12.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.863+0000 7fab087ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab00089830 0x7fab0014f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:12.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.863+0000 7fab087ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fab000ae2e0 0x7fab0014f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:12.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.863+0000 7fab087ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab000cce60 con 0x7fab000ae2e0 2023-09-28T04:23:12.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.863+0000 7fab087ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab000c75e0 con 0x7fab000adf10 2023-09-28T04:23:12.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.863+0000 7fab087ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab000ae910 con 0x7fab00089830 2023-09-28T04:23:12.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.863+0000 7fab0659b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fab000adf10 0x7fab001562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:12.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.863+0000 7fab05d9a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab00089830 0x7fab0014f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:12.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.863+0000 7fab0659b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fab000adf10 0x7fab001562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:51278/0 (socket says 172.21.15.118:51278) 2023-09-28T04:23:12.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.863+0000 7fab0659b700 1 -- 172.21.15.118:0/1277441317 learned_addr learned my addr 172.21.15.118:0/1277441317 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:12.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.863+0000 7fab05d9a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab00089830 0x7fab0014f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:45322/0 (socket says 172.21.15.118:45322) 2023-09-28T04:23:12.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.863+0000 7fab06d9c700 1 --2- 172.21.15.118:0/1277441317 >> v2:172.21.15.118:3300/0 conn(0x7fab000ae2e0 0x7fab0014f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:12.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.864+0000 7fab0659b700 1 -- 172.21.15.118:0/1277441317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab00089830 msgr2=0x7fab0014f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:12.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.864+0000 7fab0659b700 1 --2- 172.21.15.118:0/1277441317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab00089830 0x7fab0014f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:12.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.864+0000 7fab0659b700 1 -- 172.21.15.118:0/1277441317 >> v2:172.21.15.118:3300/0 conn(0x7fab000ae2e0 msgr2=0x7fab0014f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:12.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.864+0000 7fab0659b700 1 --2- 172.21.15.118:0/1277441317 >> v2:172.21.15.118:3300/0 conn(0x7fab000ae2e0 0x7fab0014f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:12.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.864+0000 7fab0659b700 1 -- 172.21.15.118:0/1277441317 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab000c7980 con 0x7fab000adf10 2023-09-28T04:23:12.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.864+0000 7fab0659b700 1 --2- 172.21.15.118:0/1277441317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab000adf10 0x7fab001562b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fab00089d20 tx=0x7faafc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46ed49d3ed6022a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:12.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.864+0000 7fab05599700 1 -- 172.21.15.118:0/1277441317 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc009e70 con 0x7fab000adf10 2023-09-28T04:23:12.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.864+0000 7fab05599700 1 -- 172.21.15.118:0/1277441317 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc00b860 con 0x7fab000adf10 2023-09-28T04:23:12.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.864+0000 7fab05599700 1 -- 172.21.15.118:0/1277441317 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc00bc00 con 0x7fab000adf10 2023-09-28T04:23:12.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.865+0000 7fab087ff700 1 -- 172.21.15.118:0/1277441317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab000adf10 msgr2=0x7fab001562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:12.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.865+0000 7fab087ff700 1 --2- 172.21.15.118:0/1277441317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab000adf10 0x7fab001562b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fab00089d20 tx=0x7faafc009250 comp rx=0 tx=0).stop 2023-09-28T04:23:12.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.865+0000 7fab087ff700 1 -- 172.21.15.118:0/1277441317 shutdown_connections 2023-09-28T04:23:12.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.865+0000 7fab087ff700 1 --2- 172.21.15.118:0/1277441317 >> v2:172.21.15.118:3300/0 conn(0x7fab000ae2e0 0x7fab0014f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:12.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.865+0000 7fab087ff700 1 --2- 172.21.15.118:0/1277441317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab000adf10 0x7fab001562b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:12.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.865+0000 7fab087ff700 1 --2- 172.21.15.118:0/1277441317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab00089830 0x7fab0014f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:12.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.865+0000 7fab087ff700 1 -- 172.21.15.118:0/1277441317 >> 172.21.15.118:0/1277441317 conn(0x7fab00063cc0 msgr2=0x7fab000cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:12.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.866+0000 7fab087ff700 1 -- 172.21.15.118:0/1277441317 shutdown_connections 2023-09-28T04:23:12.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.866+0000 7fab087ff700 1 -- 172.21.15.118:0/1277441317 wait complete. 2023-09-28T04:23:12.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.867+0000 7fab087ff700 1 Processor -- start 2023-09-28T04:23:12.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.867+0000 7fab087ff700 1 -- start start 2023-09-28T04:23:12.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab087ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab00089830 0x7fab001596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:12.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab087ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab000adf10 0x7fab00168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:12.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab087ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab000ae2e0 0x7fab00153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:12.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab087ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab000af150 con 0x7fab000adf10 2023-09-28T04:23:12.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab087ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab001550d0 con 0x7fab000ae2e0 2023-09-28T04:23:12.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab087ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab00169bb0 con 0x7fab00089830 2023-09-28T04:23:12.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab0659b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab00089830 0x7fab001596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:12.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab0659b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab00089830 0x7fab001596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:45332/0 (socket says 172.21.15.118:45332) 2023-09-28T04:23:12.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab0659b700 1 -- 172.21.15.118:0/871495965 learned_addr learned my addr 172.21.15.118:0/871495965 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:12.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab05d9a700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab000adf10 0x7fab00168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:12.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab06d9c700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab000ae2e0 0x7fab00153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:12.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab0659b700 1 -- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab000ae2e0 msgr2=0x7fab00153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:12.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab0659b700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab000ae2e0 0x7fab00153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:12.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab0659b700 1 -- 172.21.15.118:0/871495965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab000adf10 msgr2=0x7fab00168ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:12.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab0659b700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab000adf10 0x7fab00168ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:12.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.869+0000 7fab0659b700 1 -- 172.21.15.118:0/871495965 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc0094f0 con 0x7fab00089830 2023-09-28T04:23:12.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.870+0000 7fab0659b700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab00089830 0x7fab001596e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab00089550 tx=0x7faafc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:12.872 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.871+0000 7faaf67fc700 1 -- 172.21.15.118:0/871495965 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc00bbe0 con 0x7fab00089830 2023-09-28T04:23:12.872 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.872+0000 7fab087ff700 1 -- 172.21.15.118:0/871495965 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab001565c0 con 0x7fab00089830 2023-09-28T04:23:12.872 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.872+0000 7fab087ff700 1 -- 172.21.15.118:0/871495965 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab00153750 con 0x7fab00089830 2023-09-28T04:23:12.872 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.872+0000 7faaf67fc700 1 -- 172.21.15.118:0/871495965 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc000c90 con 0x7fab00089830 2023-09-28T04:23:12.873 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.872+0000 7faaf67fc700 1 -- 172.21.15.118:0/871495965 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc011650 con 0x7fab00089830 2023-09-28T04:23:12.873 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.873+0000 7fab087ff700 1 -- 172.21.15.118:0/871495965 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab00156750 con 0x7fab00089830 2023-09-28T04:23:12.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.874+0000 7faaf67fc700 1 -- 172.21.15.118:0/871495965 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 84984+0+0 (secure 0 0 0) 0x7faafc011a80 con 0x7fab00089830 2023-09-28T04:23:12.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.874+0000 7faaf67fc700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7faae40672a0 0x7faae4069750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:12.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.875+0000 7faaf67fc700 1 -- 172.21.15.118:0/871495965 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7faafc085ca0 con 0x7fab00089830 2023-09-28T04:23:12.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.875+0000 7fab05d9a700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7faae40672a0 0x7faae4069750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:12.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.875+0000 7fab05d9a700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7faae40672a0 0x7faae4069750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fab00159190 tx=0x7faaf00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:12.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:12.879+0000 7faaf67fc700 1 -- 172.21.15.118:0/871495965 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7faafc052f30 con 0x7fab00089830 2023-09-28T04:23:13.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.076+0000 7fab087ff700 1 -- 172.21.15.118:0/871495965 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab00156110 con 0x7fab00089830 2023-09-28T04:23:13.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.077+0000 7faaf67fc700 1 -- 172.21.15.118:0/871495965 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13804 (secure 0 0 0) 0x7faafc056550 con 0x7fab00089830 2023-09-28T04:23:13.078 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:13.078 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:12.595089+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T04:23:10.586895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T04:23:10.697802+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:07.142219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.951857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.911133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.882482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.688096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.764671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.767264+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.763816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:13.080 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.079+0000 7fab087ff700 1 -- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7faae40672a0 msgr2=0x7faae4069750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.080 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.079+0000 7fab087ff700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7faae40672a0 0x7faae4069750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fab00159190 tx=0x7faaf00091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.080 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.079+0000 7fab087ff700 1 -- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab00089830 msgr2=0x7fab001596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.079+0000 7fab087ff700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab00089830 0x7fab001596e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab00089550 tx=0x7faafc017000 comp rx=0 tx=0).stop 2023-09-28T04:23:13.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.080+0000 7fab087ff700 1 -- 172.21.15.118:0/871495965 shutdown_connections 2023-09-28T04:23:13.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.080+0000 7fab087ff700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7faae40672a0 0x7faae4069750 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.080+0000 7fab087ff700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab000ae2e0 0x7fab00153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.080+0000 7fab087ff700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fab00089830 0x7fab001596e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.080+0000 7fab087ff700 1 --2- 172.21.15.118:0/871495965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab000adf10 0x7fab00168ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.080+0000 7fab087ff700 1 -- 172.21.15.118:0/871495965 >> 172.21.15.118:0/871495965 conn(0x7fab00063cc0 msgr2=0x7fab000ca700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:13.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.080+0000 7fab087ff700 1 -- 172.21.15.118:0/871495965 shutdown_connections 2023-09-28T04:23:13.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.080+0000 7fab087ff700 1 -- 172.21.15.118:0/871495965 wait complete. 2023-09-28T04:23:13.097 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-28T04:23:10.586895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-28T04:23:10.697802+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-28T04:23:13.097 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-28T04:23:13.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.288+0000 7fad469ff700 1 Processor -- start 2023-09-28T04:23:13.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.289+0000 7fad469ff700 1 -- start start 2023-09-28T04:23:13.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.290+0000 7fad469ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad40089830 0x7fad401562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:13.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.290+0000 7fad469ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad400c7980 con 0x7fad4014f9f0 2023-09-28T04:23:13.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.290+0000 7fad469ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad400ccbc0 con 0x7fad400adf10 2023-09-28T04:23:13.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.290+0000 7fad469ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad400cce60 con 0x7fad40089830 2023-09-28T04:23:13.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.290+0000 7fad3f7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fad4014f9f0 0x7fad400c7e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:55434/0 (socket says 172.21.15.118:55434) 2023-09-28T04:23:13.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.290+0000 7fad3f7fe700 1 -- 172.21.15.118:0/231969504 learned_addr learned my addr 172.21.15.118:0/231969504 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:13.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.290+0000 7fad44f9c700 1 --2- 172.21.15.118:0/231969504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad40089830 0x7fad401562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:13.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.290+0000 7fad3effd700 1 -- 172.21.15.118:0/231969504 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334352757 0 0) 0x7fad400c7980 con 0x7fad4014f9f0 2023-09-28T04:23:13.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.291+0000 7fad3effd700 1 -- 172.21.15.118:0/231969504 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad28003570 con 0x7fad4014f9f0 2023-09-28T04:23:13.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.291+0000 7fad3effd700 1 -- 172.21.15.118:0/231969504 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190422759 0 0) 0x7fad400ccbc0 con 0x7fad400adf10 2023-09-28T04:23:13.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.291+0000 7fad3effd700 1 -- 172.21.15.118:0/231969504 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad400c7980 con 0x7fad400adf10 2023-09-28T04:23:13.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.291+0000 7fad44f9c700 1 -- 172.21.15.118:0/231969504 >> v1:172.21.15.174:6789/0 conn(0x7fad400adf10 legacy=0x7fad4014f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.291+0000 7fad44f9c700 1 -- 172.21.15.118:0/231969504 >> v1:172.21.15.118:6789/0 conn(0x7fad4014f9f0 legacy=0x7fad400c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.291+0000 7fad44f9c700 1 -- 172.21.15.118:0/231969504 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad400c7020 con 0x7fad40089830 2023-09-28T04:23:13.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.291+0000 7fad44f9c700 1 --2- 172.21.15.118:0/231969504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad40089830 0x7fad401562b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad38009e90 tx=0x7fad38009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=232143732d21ff93 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:13.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.291+0000 7fad3effd700 1 -- 172.21.15.118:0/231969504 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3800e070 con 0x7fad40089830 2023-09-28T04:23:13.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.291+0000 7fad3effd700 1 -- 172.21.15.118:0/231969504 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3800bb80 con 0x7fad40089830 2023-09-28T04:23:13.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.291+0000 7fad3effd700 1 -- 172.21.15.118:0/231969504 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38012430 con 0x7fad40089830 2023-09-28T04:23:13.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.292+0000 7fad469ff700 1 -- 172.21.15.118:0/231969504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad40089830 msgr2=0x7fad401562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.292+0000 7fad469ff700 1 --2- 172.21.15.118:0/231969504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad40089830 0x7fad401562b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad38009e90 tx=0x7fad38009780 comp rx=0 tx=0).stop 2023-09-28T04:23:13.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.292+0000 7fad469ff700 1 -- 172.21.15.118:0/231969504 shutdown_connections 2023-09-28T04:23:13.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.292+0000 7fad469ff700 1 --2- 172.21.15.118:0/231969504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad40089830 0x7fad401562b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.292+0000 7fad469ff700 1 -- 172.21.15.118:0/231969504 >> 172.21.15.118:0/231969504 conn(0x7fad40063cc0 msgr2=0x7fad400cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:13.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.292+0000 7fad469ff700 1 -- 172.21.15.118:0/231969504 shutdown_connections 2023-09-28T04:23:13.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.292+0000 7fad469ff700 1 -- 172.21.15.118:0/231969504 wait complete. 2023-09-28T04:23:13.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.294+0000 7fad469ff700 1 Processor -- start 2023-09-28T04:23:13.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.294+0000 7fad469ff700 1 -- start start 2023-09-28T04:23:13.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.295+0000 7fad469ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad40089830 0x7fad400c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:13.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.295+0000 7fad469ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400adf10 0x7fad40152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:13.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.295+0000 7fad469ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad4014f9f0 0x7fad4014a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:13.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.295+0000 7fad469ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad400c75e0 con 0x7fad40089830 2023-09-28T04:23:13.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.295+0000 7fad469ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad400b16a0 con 0x7fad400adf10 2023-09-28T04:23:13.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.295+0000 7fad469ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad40165cc0 con 0x7fad4014f9f0 2023-09-28T04:23:13.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.295+0000 7fad3f7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400adf10 0x7fad40152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:13.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.295+0000 7fad44f9c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad4014f9f0 0x7fad4014a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:13.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.295+0000 7fad3ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad40089830 0x7fad400c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:13.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad3f7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400adf10 0x7fad40152830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:51290/0 (socket says 172.21.15.118:51290) 2023-09-28T04:23:13.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad44f9c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad4014f9f0 0x7fad4014a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:45340/0 (socket says 172.21.15.118:45340) 2023-09-28T04:23:13.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad3f7fe700 1 -- 172.21.15.118:0/2118434350 learned_addr learned my addr 172.21.15.118:0/2118434350 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:13.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad3f7fe700 1 -- 172.21.15.118:0/2118434350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad4014f9f0 msgr2=0x7fad4014a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad3f7fe700 1 --2- 172.21.15.118:0/2118434350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad4014f9f0 0x7fad4014a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad3f7fe700 1 -- 172.21.15.118:0/2118434350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad40089830 msgr2=0x7fad400c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad3f7fe700 1 --2- 172.21.15.118:0/2118434350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad40089830 0x7fad400c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad3f7fe700 1 -- 172.21.15.118:0/2118434350 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad38009a20 con 0x7fad400adf10 2023-09-28T04:23:13.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad3ffff700 1 --2- 172.21.15.118:0/2118434350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad40089830 0x7fad400c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:13.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad3f7fe700 1 --2- 172.21.15.118:0/2118434350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400adf10 0x7fad40152830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad3400c790 tx=0x7fad34007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:13.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad27fff700 1 -- 172.21.15.118:0/2118434350 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34005b30 con 0x7fad400adf10 2023-09-28T04:23:13.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad27fff700 1 -- 172.21.15.118:0/2118434350 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad34005c90 con 0x7fad400adf10 2023-09-28T04:23:13.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad469ff700 1 -- 172.21.15.118:0/2118434350 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4015af60 con 0x7fad400adf10 2023-09-28T04:23:13.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.296+0000 7fad27fff700 1 -- 172.21.15.118:0/2118434350 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34007320 con 0x7fad400adf10 2023-09-28T04:23:13.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.297+0000 7fad469ff700 1 -- 172.21.15.118:0/2118434350 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad40165670 con 0x7fad400adf10 2023-09-28T04:23:13.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.298+0000 7fad469ff700 1 -- 172.21.15.118:0/2118434350 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad40071980 con 0x7fad400adf10 2023-09-28T04:23:13.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.298+0000 7fad27fff700 1 -- 172.21.15.118:0/2118434350 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 84984+0+0 (secure 0 0 0) 0x7fad3401b3b0 con 0x7fad400adf10 2023-09-28T04:23:13.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.299+0000 7fad27fff700 1 --2- 172.21.15.118:0/2118434350 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fad2c0672a0 0x7fad2c069750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:13.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.299+0000 7fad27fff700 1 -- 172.21.15.118:0/2118434350 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fad34083c20 con 0x7fad400adf10 2023-09-28T04:23:13.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.299+0000 7fad3ffff700 1 --2- 172.21.15.118:0/2118434350 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fad2c0672a0 0x7fad2c069750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:13.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.300+0000 7fad3ffff700 1 --2- 172.21.15.118:0/2118434350 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fad2c0672a0 0x7fad2c069750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fad30007fd0 tx=0x7fad30007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:13.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.304+0000 7fad27fff700 1 -- 172.21.15.118:0/2118434350 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fad3404b570 con 0x7fad400adf10 2023-09-28T04:23:13.468 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.468+0000 7fad27fff700 1 -- 172.21.15.118:0/2118434350 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fad34051330 con 0x7fad400adf10 2023-09-28T04:23:13.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.495+0000 7fad469ff700 1 -- 172.21.15.118:0/2118434350 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad40153140 con 0x7fad400adf10 2023-09-28T04:23:13.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.496+0000 7fad27fff700 1 -- 172.21.15.118:0/2118434350 <== mon.1 v2:172.21.15.174:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad34050f60 con 0x7fad400adf10 2023-09-28T04:23:13.497 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2023-09-28T04:23:13.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.498+0000 7fad469ff700 1 -- 172.21.15.118:0/2118434350 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fad2c0672a0 msgr2=0x7fad2c069750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.498+0000 7fad469ff700 1 --2- 172.21.15.118:0/2118434350 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fad2c0672a0 0x7fad2c069750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fad30007fd0 tx=0x7fad30007d50 comp rx=0 tx=0).stop 2023-09-28T04:23:13.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.498+0000 7fad469ff700 1 -- 172.21.15.118:0/2118434350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400adf10 msgr2=0x7fad40152830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.498+0000 7fad469ff700 1 --2- 172.21.15.118:0/2118434350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400adf10 0x7fad40152830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad3400c790 tx=0x7fad34007e20 comp rx=0 tx=0).stop 2023-09-28T04:23:13.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.498+0000 7fad469ff700 1 -- 172.21.15.118:0/2118434350 shutdown_connections 2023-09-28T04:23:13.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.498+0000 7fad469ff700 1 --2- 172.21.15.118:0/2118434350 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fad2c0672a0 0x7fad2c069750 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.498+0000 7fad469ff700 1 --2- 172.21.15.118:0/2118434350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad4014f9f0 0x7fad4014a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.498+0000 7fad469ff700 1 --2- 172.21.15.118:0/2118434350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad40089830 0x7fad400c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.498+0000 7fad469ff700 1 --2- 172.21.15.118:0/2118434350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400adf10 0x7fad40152830 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.498+0000 7fad469ff700 1 -- 172.21.15.118:0/2118434350 >> 172.21.15.118:0/2118434350 conn(0x7fad40063cc0 msgr2=0x7fad400cb750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:13.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.499+0000 7fad469ff700 1 -- 172.21.15.118:0/2118434350 shutdown_connections 2023-09-28T04:23:13.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.499+0000 7fad469ff700 1 -- 172.21.15.118:0/2118434350 wait complete. 2023-09-28T04:23:13.516 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-28T04:23:13.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.710+0000 7f3d3b1ff700 1 Processor -- start 2023-09-28T04:23:13.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.710+0000 7f3d3b1ff700 1 -- start start 2023-09-28T04:23:13.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.711+0000 7f3d3b1ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d3414fa90 0x7f3d34156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:13.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.711+0000 7f3d3b1ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3d340c84c0 0x7f3d34068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:13.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.711+0000 7f3d3b1ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d340c8030 con 0x7f3d3414fe60 2023-09-28T04:23:13.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.712+0000 7f3d3b1ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d340c7180 con 0x7f3d3414fa90 2023-09-28T04:23:13.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.712+0000 7f3d3b1ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d340c7420 con 0x7f3d340c84c0 2023-09-28T04:23:13.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.712+0000 7f3d38f9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d3414fa90 0x7f3d34156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:13.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.712+0000 7f3d3979c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3d340c84c0 0x7f3d34068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:13.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.712+0000 7f3d33fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f3d3414fe60 0x7f3d340cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46108/0 (socket says 172.21.15.118:46108) 2023-09-28T04:23:13.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.712+0000 7f3d33fff700 1 -- 172.21.15.118:0/152117941 learned_addr learned my addr 172.21.15.118:0/152117941 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:13.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.712+0000 7f3d337fe700 1 -- 172.21.15.118:0/152117941 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429850682 0 0) 0x7f3d340c8030 con 0x7f3d3414fe60 2023-09-28T04:23:13.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.712+0000 7f3d38f9b700 1 -- 172.21.15.118:0/152117941 >> v2:172.21.15.174:3300/0 conn(0x7f3d340c84c0 msgr2=0x7f3d34068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:13.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.712+0000 7f3d38f9b700 1 --2- 172.21.15.118:0/152117941 >> v2:172.21.15.174:3300/0 conn(0x7f3d340c84c0 0x7f3d34068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.712+0000 7f3d38f9b700 1 -- 172.21.15.118:0/152117941 >> v1:172.21.15.174:6789/0 conn(0x7f3d3414fe60 legacy=0x7f3d340cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.712+0000 7f3d38f9b700 1 -- 172.21.15.118:0/152117941 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d340c7700 con 0x7f3d3414fa90 2023-09-28T04:23:13.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.712+0000 7f3d38f9b700 1 --2- 172.21.15.118:0/152117941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d3414fa90 0x7f3d34156430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3d340c64b0 tx=0x7f3d280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b6f4f2fa3c87d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:13.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.713+0000 7f3d337fe700 1 -- 172.21.15.118:0/152117941 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28011630 con 0x7f3d3414fa90 2023-09-28T04:23:13.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.713+0000 7f3d337fe700 1 -- 172.21.15.118:0/152117941 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d28011790 con 0x7f3d3414fa90 2023-09-28T04:23:13.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.713+0000 7f3d337fe700 1 -- 172.21.15.118:0/152117941 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28011b30 con 0x7f3d3414fa90 2023-09-28T04:23:13.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.713+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/152117941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d3414fa90 msgr2=0x7f3d34156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.713+0000 7f3d3b1ff700 1 --2- 172.21.15.118:0/152117941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d3414fa90 0x7f3d34156430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3d340c64b0 tx=0x7f3d280091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.713+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/152117941 shutdown_connections 2023-09-28T04:23:13.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.713+0000 7f3d3b1ff700 1 --2- 172.21.15.118:0/152117941 >> v2:172.21.15.174:3300/0 conn(0x7f3d340c84c0 0x7f3d34068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.713+0000 7f3d3b1ff700 1 --2- 172.21.15.118:0/152117941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d3414fa90 0x7f3d34156430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.713+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/152117941 >> 172.21.15.118:0/152117941 conn(0x7f3d34063cd0 msgr2=0x7f3d340cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:13.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.713+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/152117941 shutdown_connections 2023-09-28T04:23:13.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.713+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/152117941 wait complete. 2023-09-28T04:23:13.717 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.715+0000 7f3d3b1ff700 1 Processor -- start 2023-09-28T04:23:13.717 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.715+0000 7f3d3b1ff700 1 -- start start 2023-09-28T04:23:13.717 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d3b1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d340c84c0 0x7f3d340cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:13.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d3b1ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d3414fa90 0x7f3d340cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:13.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d3b1ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d3414fe60 0x7f3d340c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:13.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d3b1ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d340c2de0 con 0x7f3d3414fe60 2023-09-28T04:23:13.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d3b1ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d340ccc40 con 0x7f3d3414fa90 2023-09-28T04:23:13.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d3b1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d34167390 con 0x7f3d340c84c0 2023-09-28T04:23:13.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d3979c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d3414fe60 0x7f3d340c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:13.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d33fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d3414fa90 0x7f3d340cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:13.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d3979c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d3414fe60 0x7f3d340c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38242/0 (socket says 172.21.15.118:38242) 2023-09-28T04:23:13.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d3979c700 1 -- 172.21.15.118:0/2668195917 learned_addr learned my addr 172.21.15.118:0/2668195917 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:13.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d38f9b700 1 --2- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d340c84c0 0x7f3d340cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:13.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d38f9b700 1 -- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d3414fa90 msgr2=0x7f3d340cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d38f9b700 1 --2- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d3414fa90 0x7f3d340cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d38f9b700 1 -- 172.21.15.118:0/2668195917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d3414fe60 msgr2=0x7f3d340c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d38f9b700 1 --2- 172.21.15.118:0/2668195917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d3414fe60 0x7f3d340c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.716+0000 7f3d38f9b700 1 -- 172.21.15.118:0/2668195917 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d28009420 con 0x7f3d340c84c0 2023-09-28T04:23:13.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.717+0000 7f3d38f9b700 1 --2- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d340c84c0 0x7f3d340cc700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3d28016000 tx=0x7f3d28017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:13.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.717+0000 7f3d30ff9700 1 -- 172.21.15.118:0/2668195917 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28000d10 con 0x7f3d340c84c0 2023-09-28T04:23:13.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.717+0000 7f3d30ff9700 1 -- 172.21.15.118:0/2668195917 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d28011b10 con 0x7f3d340c84c0 2023-09-28T04:23:13.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.717+0000 7f3d30ff9700 1 -- 172.21.15.118:0/2668195917 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28025640 con 0x7f3d340c84c0 2023-09-28T04:23:13.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.717+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/2668195917 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d341664c0 con 0x7f3d340c84c0 2023-09-28T04:23:13.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.717+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/2668195917 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d34166a60 con 0x7f3d340c84c0 2023-09-28T04:23:13.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.718+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/2668195917 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d34071980 con 0x7f3d340c84c0 2023-09-28T04:23:13.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.719+0000 7f3d30ff9700 1 -- 172.21.15.118:0/2668195917 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3d280193b0 con 0x7f3d340c84c0 2023-09-28T04:23:13.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.719+0000 7f3d30ff9700 1 --2- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3d18067330 0x7f3d180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:13.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.719+0000 7f3d30ff9700 1 -- 172.21.15.118:0/2668195917 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3d28086120 con 0x7f3d340c84c0 2023-09-28T04:23:13.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.720+0000 7f3d33fff700 1 --2- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3d18067330 0x7f3d180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:13.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.720+0000 7f3d33fff700 1 --2- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3d18067330 0x7f3d180697e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3d3414c0e0 tx=0x7f3d20007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:13.725 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.724+0000 7f3d30ff9700 1 -- 172.21.15.118:0/2668195917 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3d280532d0 con 0x7f3d340c84c0 2023-09-28T04:23:13.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.918+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/2668195917 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3d340c3300 con 0x7f3d340c84c0 2023-09-28T04:23:13.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.918+0000 7f3d30ff9700 1 -- 172.21.15.118:0/2668195917 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3d280568f0 con 0x7f3d340c84c0 2023-09-28T04:23:13.919 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2023-09-28T04:23:13.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.920+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3d18067330 msgr2=0x7f3d180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.920+0000 7f3d3b1ff700 1 --2- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3d18067330 0x7f3d180697e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3d3414c0e0 tx=0x7f3d20007d30 comp rx=0 tx=0).stop 2023-09-28T04:23:13.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.920+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d340c84c0 msgr2=0x7f3d340cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:13.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.920+0000 7f3d3b1ff700 1 --2- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d340c84c0 0x7f3d340cc700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3d28016000 tx=0x7f3d28017000 comp rx=0 tx=0).stop 2023-09-28T04:23:13.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.920+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/2668195917 shutdown_connections 2023-09-28T04:23:13.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.920+0000 7f3d3b1ff700 1 --2- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3d18067330 0x7f3d180697e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.921+0000 7f3d3b1ff700 1 --2- 172.21.15.118:0/2668195917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d3414fe60 0x7f3d340c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.921+0000 7f3d3b1ff700 1 --2- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d340c84c0 0x7f3d340cc700 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.921+0000 7f3d3b1ff700 1 --2- 172.21.15.118:0/2668195917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d3414fa90 0x7f3d340cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:13.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.921+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/2668195917 >> 172.21.15.118:0/2668195917 conn(0x7f3d34063cd0 msgr2=0x7f3d3414c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:13.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.921+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/2668195917 shutdown_connections 2023-09-28T04:23:13.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:13.921+0000 7f3d3b1ff700 1 -- 172.21.15.118:0/2668195917 wait complete. 2023-09-28T04:23:13.938 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T04:23:14.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.126+0000 7f74cc1ff700 1 Processor -- start 2023-09-28T04:23:14.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.126+0000 7f74cc1ff700 1 -- start start 2023-09-28T04:23:14.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.127+0000 7f74cc1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74c414fa90 0x7f74c4156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:14.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.127+0000 7f74cc1ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f74c414fe60 0x7f74c4068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:14.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.127+0000 7f74cc1ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f74c40c84c0 0x7f74c40cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:14.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.127+0000 7f74cc1ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c40c8030 con 0x7f74c40c84c0 2023-09-28T04:23:14.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.127+0000 7f74cc1ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c40c7180 con 0x7f74c414fe60 2023-09-28T04:23:14.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.127+0000 7f74cc1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40c7420 con 0x7f74c414fa90 2023-09-28T04:23:14.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.128+0000 7f74ca79c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f74c40c84c0 0x7f74c40cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:14.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.128+0000 7f74c979a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f74c414fe60 0x7f74c4068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:14.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.128+0000 7f74c9f9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74c414fa90 0x7f74c4156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:14.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.128+0000 7f74ca79c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f74c40c84c0 0x7f74c40cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38252/0 (socket says 172.21.15.118:38252) 2023-09-28T04:23:14.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.128+0000 7f74ca79c700 1 -- 172.21.15.118:0/2809417094 learned_addr learned my addr 172.21.15.118:0/2809417094 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:14.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.128+0000 7f74c9f9b700 1 -- 172.21.15.118:0/2809417094 >> v2:172.21.15.174:3300/0 conn(0x7f74c414fe60 msgr2=0x7f74c4068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:14.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.128+0000 7f74c9f9b700 1 --2- 172.21.15.118:0/2809417094 >> v2:172.21.15.174:3300/0 conn(0x7f74c414fe60 0x7f74c4068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.128+0000 7f74c9f9b700 1 -- 172.21.15.118:0/2809417094 >> v2:172.21.15.118:3300/0 conn(0x7f74c40c84c0 msgr2=0x7f74c40cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:14.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.128+0000 7f74c9f9b700 1 --2- 172.21.15.118:0/2809417094 >> v2:172.21.15.118:3300/0 conn(0x7f74c40c84c0 0x7f74c40cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.128+0000 7f74c9f9b700 1 -- 172.21.15.118:0/2809417094 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c40c7700 con 0x7f74c414fa90 2023-09-28T04:23:14.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.128+0000 7f74c979a700 1 --2- 172.21.15.118:0/2809417094 >> v2:172.21.15.174:3300/0 conn(0x7f74c414fe60 0x7f74c4068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:14.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.128+0000 7f74c9f9b700 1 --2- 172.21.15.118:0/2809417094 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74c414fa90 0x7f74c4156430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f74c4064450 tx=0x7f74c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40a824bebb69637c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:14.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.129+0000 7f74c8f99700 1 -- 172.21.15.118:0/2809417094 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0011630 con 0x7f74c414fa90 2023-09-28T04:23:14.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.129+0000 7f74c8f99700 1 -- 172.21.15.118:0/2809417094 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c00117b0 con 0x7f74c414fa90 2023-09-28T04:23:14.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.129+0000 7f74c8f99700 1 -- 172.21.15.118:0/2809417094 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0011b70 con 0x7f74c414fa90 2023-09-28T04:23:14.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.129+0000 7f74cc1ff700 1 -- 172.21.15.118:0/2809417094 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74c414fa90 msgr2=0x7f74c4156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:14.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.129+0000 7f74cc1ff700 1 --2- 172.21.15.118:0/2809417094 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74c414fa90 0x7f74c4156430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f74c4064450 tx=0x7f74c00091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.129+0000 7f74cc1ff700 1 -- 172.21.15.118:0/2809417094 shutdown_connections 2023-09-28T04:23:14.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.129+0000 7f74cc1ff700 1 --2- 172.21.15.118:0/2809417094 >> v2:172.21.15.118:3300/0 conn(0x7f74c40c84c0 0x7f74c40cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.129+0000 7f74cc1ff700 1 --2- 172.21.15.118:0/2809417094 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74c414fa90 0x7f74c4156430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.129+0000 7f74cc1ff700 1 --2- 172.21.15.118:0/2809417094 >> v2:172.21.15.174:3300/0 conn(0x7f74c414fe60 0x7f74c4068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.129+0000 7f74cc1ff700 1 -- 172.21.15.118:0/2809417094 >> 172.21.15.118:0/2809417094 conn(0x7f74c4063cd0 msgr2=0x7f74c40cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:14.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.129+0000 7f74cc1ff700 1 -- 172.21.15.118:0/2809417094 shutdown_connections 2023-09-28T04:23:14.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.129+0000 7f74cc1ff700 1 -- 172.21.15.118:0/2809417094 wait complete. 2023-09-28T04:23:14.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.131+0000 7f74cc1ff700 1 Processor -- start 2023-09-28T04:23:14.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.131+0000 7f74cc1ff700 1 -- start start 2023-09-28T04:23:14.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74cc1ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74c40c84c0 0x7f74c4166050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:14.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74cc1ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74c414fa90 0x7f74c40c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:14.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74cc1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74c414fe60 0x7f74c414a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:14.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74cc1ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4166590 con 0x7f74c414fa90 2023-09-28T04:23:14.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74cc1ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c41502a0 con 0x7f74c40c84c0 2023-09-28T04:23:14.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74cc1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4152af0 con 0x7f74c414fe60 2023-09-28T04:23:14.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74c979a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74c414fa90 0x7f74c40c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:14.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74c979a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74c414fa90 0x7f74c40c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38254/0 (socket says 172.21.15.118:38254) 2023-09-28T04:23:14.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74c979a700 1 -- 172.21.15.118:0/385546053 learned_addr learned my addr 172.21.15.118:0/385546053 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:14.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74c9f9b700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74c40c84c0 0x7f74c4166050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:14.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74ca79c700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74c414fe60 0x7f74c414a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:14.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74c979a700 1 -- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74c414fe60 msgr2=0x7f74c414a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:14.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74c979a700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74c414fe60 0x7f74c414a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74c979a700 1 -- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74c40c84c0 msgr2=0x7f74c4166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:14.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74c979a700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74c40c84c0 0x7f74c4166050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74c979a700 1 -- 172.21.15.118:0/385546053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b4009420 con 0x7f74c414fa90 2023-09-28T04:23:14.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.132+0000 7f74c979a700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74c414fa90 0x7f74c40c5a60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f74b400ecb0 tx=0x7f74b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:14.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.133+0000 7f74b9ffb700 1 -- 172.21.15.118:0/385546053 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b400c850 con 0x7f74c414fa90 2023-09-28T04:23:14.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.133+0000 7f74b9ffb700 1 -- 172.21.15.118:0/385546053 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b400c9b0 con 0x7f74c414fa90 2023-09-28T04:23:14.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.133+0000 7f74b9ffb700 1 -- 172.21.15.118:0/385546053 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b400cd50 con 0x7f74c414fa90 2023-09-28T04:23:14.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.133+0000 7f74cc1ff700 1 -- 172.21.15.118:0/385546053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c0009420 con 0x7f74c414fa90 2023-09-28T04:23:14.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.133+0000 7f74cc1ff700 1 -- 172.21.15.118:0/385546053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c4152d90 con 0x7f74c414fa90 2023-09-28T04:23:14.137 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.134+0000 7f74cc1ff700 1 -- 172.21.15.118:0/385546053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c4071980 con 0x7f74c414fa90 2023-09-28T04:23:14.137 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.135+0000 7f74b9ffb700 1 -- 172.21.15.118:0/385546053 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f74b4013680 con 0x7f74c414fa90 2023-09-28T04:23:14.137 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.136+0000 7f74b9ffb700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f74a8067330 0x7f74a80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:14.137 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.136+0000 7f74b9ffb700 1 -- 172.21.15.118:0/385546053 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f74b40848c0 con 0x7f74c414fa90 2023-09-28T04:23:14.137 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.136+0000 7f74c9f9b700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f74a8067330 0x7f74a80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:14.137 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.136+0000 7f74c9f9b700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f74a8067330 0x7f74a80697e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f74c4064450 tx=0x7f74c0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:14.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.141+0000 7f74b9ffb700 1 -- 172.21.15.118:0/385546053 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f74b4051a70 con 0x7f74c414fa90 2023-09-28T04:23:14.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.372+0000 7f74cc1ff700 1 -- 172.21.15.118:0/385546053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74c40c6a60 con 0x7f74c414fa90 2023-09-28T04:23:14.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.373+0000 7f74b9ffb700 1 -- 172.21.15.118:0/385546053 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5048 (secure 0 0 0) 0x7f74b4055090 con 0x7f74c414fa90 2023-09-28T04:23:14.374 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:14.374 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3635601230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3635601230},{"type":"v1","addr":"172.21.15.174:6837","nonce":3635601230}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2662305504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2662305504},{"type":"v1","addr":"172.21.15.174:6839","nonce":2662305504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/524044984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":524044984},{"type":"v1","addr":"172.21.15.118:6833","nonce":524044984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/1739320088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1739320088},{"type":"v1","addr":"172.21.15.174:6836","nonce":1739320088}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2977056141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2977056141},{"type":"v1","addr":"172.21.15.118:6835","nonce":2977056141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/233759601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":233759601},{"type":"v1","addr":"172.21.15.118:6837","nonce":233759601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-09-28T04:23:14.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.375+0000 7f74cc1ff700 1 -- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f74a8067330 msgr2=0x7f74a80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:14.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.375+0000 7f74cc1ff700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f74a8067330 0x7f74a80697e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f74c4064450 tx=0x7f74c0017000 comp rx=0 tx=0).stop 2023-09-28T04:23:14.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.376+0000 7f74cc1ff700 1 -- 172.21.15.118:0/385546053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74c414fa90 msgr2=0x7f74c40c5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:14.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.376+0000 7f74cc1ff700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74c414fa90 0x7f74c40c5a60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f74b400ecb0 tx=0x7f74b40091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.376+0000 7f74cc1ff700 1 -- 172.21.15.118:0/385546053 shutdown_connections 2023-09-28T04:23:14.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.376+0000 7f74cc1ff700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f74a8067330 0x7f74a80697e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.376+0000 7f74cc1ff700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74c414fe60 0x7f74c414a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.376+0000 7f74cc1ff700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74c40c84c0 0x7f74c4166050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.376+0000 7f74cc1ff700 1 --2- 172.21.15.118:0/385546053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74c414fa90 0x7f74c40c5a60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.376+0000 7f74cc1ff700 1 -- 172.21.15.118:0/385546053 >> 172.21.15.118:0/385546053 conn(0x7f74c4063cd0 msgr2=0x7f74c41557c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:14.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.376+0000 7f74cc1ff700 1 -- 172.21.15.118:0/385546053 shutdown_connections 2023-09-28T04:23:14.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.376+0000 7f74cc1ff700 1 -- 172.21.15.118:0/385546053 wait complete. 2023-09-28T04:23:14.378 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 3 2023-09-28T04:23:14.393 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:14.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.582+0000 7f2e691ff700 1 Processor -- start 2023-09-28T04:23:14.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.583+0000 7f2e691ff700 1 -- start start 2023-09-28T04:23:14.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.584+0000 7f2e691ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e640c1850 0x7f2e64153e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:14.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.584+0000 7f2e691ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2e6414d230 0x7f2e6414d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:14.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.584+0000 7f2e691ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e640bef30 con 0x7f2e640c1c20 2023-09-28T04:23:14.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.584+0000 7f2e691ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e640c5510 con 0x7f2e6414d230 2023-09-28T04:23:14.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.584+0000 7f2e691ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e640c2bd0 con 0x7f2e640c1850 2023-09-28T04:23:14.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.584+0000 7f2e6259c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2e640c1c20 0x7f2e640c24c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:55448/0 (socket says 172.21.15.118:55448) 2023-09-28T04:23:14.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.584+0000 7f2e6259c700 1 -- 172.21.15.118:0/517786062 learned_addr learned my addr 172.21.15.118:0/517786062 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:14.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.584+0000 7f2e6359e700 1 --2- 172.21.15.118:0/517786062 >> v2:172.21.15.174:3300/0 conn(0x7f2e6414d230 0x7f2e6414d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:14.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.584+0000 7f2e62d9d700 1 --2- 172.21.15.118:0/517786062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e640c1850 0x7f2e64153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:14.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.584+0000 7f2e61d9b700 1 -- 172.21.15.118:0/517786062 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281485283 0 0) 0x7f2e640bef30 con 0x7f2e640c1c20 2023-09-28T04:23:14.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.585+0000 7f2e61d9b700 1 -- 172.21.15.118:0/517786062 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e4c003570 con 0x7f2e640c1c20 2023-09-28T04:23:14.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.585+0000 7f2e6359e700 1 -- 172.21.15.118:0/517786062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e640c1850 msgr2=0x7f2e64153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:14.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.585+0000 7f2e6359e700 1 --2- 172.21.15.118:0/517786062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e640c1850 0x7f2e64153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.585+0000 7f2e6359e700 1 -- 172.21.15.118:0/517786062 >> v1:172.21.15.118:6789/0 conn(0x7f2e640c1c20 legacy=0x7f2e640c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:14.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.585+0000 7f2e6359e700 1 -- 172.21.15.118:0/517786062 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6414dbd0 con 0x7f2e6414d230 2023-09-28T04:23:14.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.585+0000 7f2e62d9d700 1 --2- 172.21.15.118:0/517786062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e640c1850 0x7f2e64153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:14.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.585+0000 7f2e6359e700 1 --2- 172.21.15.118:0/517786062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e6414d230 0x7f2e6414d690 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009e90 tx=0x7f2e5c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db7e7e982d5c1338 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:14.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.585+0000 7f2e61d9b700 1 -- 172.21.15.118:0/517786062 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c00e070 con 0x7f2e6414d230 2023-09-28T04:23:14.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.585+0000 7f2e61d9b700 1 -- 172.21.15.118:0/517786062 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c00bbd0 con 0x7f2e6414d230 2023-09-28T04:23:14.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.585+0000 7f2e61d9b700 1 -- 172.21.15.118:0/517786062 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c012430 con 0x7f2e6414d230 2023-09-28T04:23:14.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.586+0000 7f2e691ff700 1 -- 172.21.15.118:0/517786062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e6414d230 msgr2=0x7f2e6414d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:14.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.586+0000 7f2e691ff700 1 --2- 172.21.15.118:0/517786062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e6414d230 0x7f2e6414d690 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009e90 tx=0x7f2e5c009780 comp rx=0 tx=0).stop 2023-09-28T04:23:14.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.586+0000 7f2e691ff700 1 -- 172.21.15.118:0/517786062 shutdown_connections 2023-09-28T04:23:14.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.586+0000 7f2e691ff700 1 --2- 172.21.15.118:0/517786062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e6414d230 0x7f2e6414d690 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.586+0000 7f2e691ff700 1 --2- 172.21.15.118:0/517786062 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e640c1850 0x7f2e64153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.586+0000 7f2e691ff700 1 -- 172.21.15.118:0/517786062 >> 172.21.15.118:0/517786062 conn(0x7f2e64067630 msgr2=0x7f2e64067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:14.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.586+0000 7f2e691ff700 1 -- 172.21.15.118:0/517786062 shutdown_connections 2023-09-28T04:23:14.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.586+0000 7f2e691ff700 1 -- 172.21.15.118:0/517786062 wait complete. 2023-09-28T04:23:14.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.587+0000 7f2e691ff700 1 Processor -- start 2023-09-28T04:23:14.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.587+0000 7f2e691ff700 1 -- start start 2023-09-28T04:23:14.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.588+0000 7f2e691ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e640c1850 0x7f2e64151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:14.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.588+0000 7f2e691ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e640c1c20 0x7f2e64151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:14.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.588+0000 7f2e691ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e6414d230 0x7f2e6414b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:14.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.588+0000 7f2e691ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64157bf0 con 0x7f2e640c1c20 2023-09-28T04:23:14.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.588+0000 7f2e691ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6406e470 con 0x7f2e640c1850 2023-09-28T04:23:14.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.588+0000 7f2e691ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6406e950 con 0x7f2e6414d230 2023-09-28T04:23:14.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e62d9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e640c1850 0x7f2e64151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:14.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e62d9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e640c1850 0x7f2e64151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:51352/0 (socket says 172.21.15.118:51352) 2023-09-28T04:23:14.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e62d9d700 1 -- 172.21.15.118:0/4115373672 learned_addr learned my addr 172.21.15.118:0/4115373672 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:14.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e6359e700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e6414d230 0x7f2e6414b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:14.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e6259c700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e640c1c20 0x7f2e64151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:14.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e62d9d700 1 -- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e6414d230 msgr2=0x7f2e6414b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:14.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e62d9d700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e6414d230 0x7f2e6414b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e62d9d700 1 -- 172.21.15.118:0/4115373672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e640c1c20 msgr2=0x7f2e64151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:14.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e62d9d700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e640c1c20 0x7f2e64151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e62d9d700 1 -- 172.21.15.118:0/4115373672 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54009420 con 0x7f2e640c1850 2023-09-28T04:23:14.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e6359e700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e6414d230 0x7f2e6414b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:14.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e62d9d700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e640c1850 0x7f2e64151570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400ecb0 tx=0x7f2e540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:14.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e4affd700 1 -- 172.21.15.118:0/4115373672 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400c850 con 0x7f2e640c1850 2023-09-28T04:23:14.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e4affd700 1 -- 172.21.15.118:0/4115373672 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400c9b0 con 0x7f2e640c1850 2023-09-28T04:23:14.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.589+0000 7f2e691ff700 1 -- 172.21.15.118:0/4115373672 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c009a20 con 0x7f2e640c1850 2023-09-28T04:23:14.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.590+0000 7f2e4affd700 1 -- 172.21.15.118:0/4115373672 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400cd30 con 0x7f2e640c1850 2023-09-28T04:23:14.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.590+0000 7f2e691ff700 1 -- 172.21.15.118:0/4115373672 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6406e670 con 0x7f2e640c1850 2023-09-28T04:23:14.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.591+0000 7f2e691ff700 1 -- 172.21.15.118:0/4115373672 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6414ced0 con 0x7f2e640c1850 2023-09-28T04:23:14.594 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.591+0000 7f2e4affd700 1 -- 172.21.15.118:0/4115373672 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2e54013680 con 0x7f2e640c1850 2023-09-28T04:23:14.594 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.592+0000 7f2e4affd700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2e500673b0 0x7f2e50069860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:14.594 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.592+0000 7f2e4affd700 1 -- 172.21.15.118:0/4115373672 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2e54084b30 con 0x7f2e640c1850 2023-09-28T04:23:14.594 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.592+0000 7f2e6259c700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2e500673b0 0x7f2e50069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:14.594 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.593+0000 7f2e6259c700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2e500673b0 0x7f2e50069860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e641599f0 tx=0x7f2e58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:14.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.597+0000 7f2e4affd700 1 -- 172.21.15.118:0/4115373672 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2e54051ce0 con 0x7f2e640c1850 2023-09-28T04:23:14.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.786+0000 7f2e691ff700 1 -- 172.21.15.118:0/4115373672 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e64071980 con 0x7f2e640c1850 2023-09-28T04:23:14.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.787+0000 7f2e4affd700 1 -- 172.21.15.118:0/4115373672 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13791 (secure 0 0 0) 0x7f2e54055300 con 0x7f2e640c1850 2023-09-28T04:23:14.788 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:14.788 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":17,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:13.596473+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T04:23:10.586895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T04:23:10.697802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:07.142219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.951857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.911133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.882482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.688096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.764671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.767264+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.763816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:14.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.789+0000 7f2e691ff700 1 -- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2e500673b0 msgr2=0x7f2e50069860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:14.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.789+0000 7f2e691ff700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2e500673b0 0x7f2e50069860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e641599f0 tx=0x7f2e58009040 comp rx=0 tx=0).stop 2023-09-28T04:23:14.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.790+0000 7f2e691ff700 1 -- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e640c1850 msgr2=0x7f2e64151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:14.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.790+0000 7f2e691ff700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e640c1850 0x7f2e64151570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400ecb0 tx=0x7f2e540091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.790+0000 7f2e691ff700 1 -- 172.21.15.118:0/4115373672 shutdown_connections 2023-09-28T04:23:14.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.790+0000 7f2e691ff700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2e500673b0 0x7f2e50069860 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.790+0000 7f2e691ff700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2e6414d230 0x7f2e6414b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.790+0000 7f2e691ff700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e640c1850 0x7f2e64151570 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.790+0000 7f2e691ff700 1 --2- 172.21.15.118:0/4115373672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e640c1c20 0x7f2e64151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:14.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.790+0000 7f2e691ff700 1 -- 172.21.15.118:0/4115373672 >> 172.21.15.118:0/4115373672 conn(0x7f2e64067630 msgr2=0x7f2e64067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:14.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.790+0000 7f2e691ff700 1 -- 172.21.15.118:0/4115373672 shutdown_connections 2023-09-28T04:23:14.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:14.790+0000 7f2e691ff700 1 -- 172.21.15.118:0/4115373672 wait complete. 2023-09-28T04:23:14.808 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-28T04:23:10.586895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-28T04:23:10.697802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-28T04:23:14.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-28T04:23:15.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.000+0000 7f72109ff700 1 Processor -- start 2023-09-28T04:23:15.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.001+0000 7f72109ff700 1 -- start start 2023-09-28T04:23:15.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.002+0000 7f72109ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f720c0ca6c0 0x7f720c156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.002+0000 7f72109ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f720c0c4ab0 0x7f720c14f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.002+0000 7f72109ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720c0c73e0 con 0x7f720c0c5e30 2023-09-28T04:23:15.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.002+0000 7f72109ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720c0c0b60 con 0x7f720c0c4ab0 2023-09-28T04:23:15.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.002+0000 7f72109ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720c0c67d0 con 0x7f720c0ca6c0 2023-09-28T04:23:15.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.002+0000 7f720a59c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f720c0c5e30 0x7f720c0c9fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:55464/0 (socket says 172.21.15.118:55464) 2023-09-28T04:23:15.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.002+0000 7f720a59c700 1 -- 172.21.15.118:0/1911799079 learned_addr learned my addr 172.21.15.118:0/1911799079 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:15.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.002+0000 7f720ad9d700 1 --2- 172.21.15.118:0/1911799079 >> v2:172.21.15.118:3300/0 conn(0x7f720c0c4ab0 0x7f720c14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.002+0000 7f7209d9b700 1 --2- 172.21.15.118:0/1911799079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f720c0ca6c0 0x7f720c156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.002+0000 7f720959a700 1 -- 172.21.15.118:0/1911799079 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362645636 0 0) 0x7f720c0c73e0 con 0x7f720c0c5e30 2023-09-28T04:23:15.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.003+0000 7f720959a700 1 -- 172.21.15.118:0/1911799079 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71f4003570 con 0x7f720c0c5e30 2023-09-28T04:23:15.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.003+0000 7f720ad9d700 1 -- 172.21.15.118:0/1911799079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f720c0ca6c0 msgr2=0x7f720c156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:15.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.003+0000 7f720ad9d700 1 --2- 172.21.15.118:0/1911799079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f720c0ca6c0 0x7f720c156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.003+0000 7f720ad9d700 1 -- 172.21.15.118:0/1911799079 >> v1:172.21.15.118:6789/0 conn(0x7f720c0c5e30 legacy=0x7f720c0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.003+0000 7f720ad9d700 1 -- 172.21.15.118:0/1911799079 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c0c6ab0 con 0x7f720c0c4ab0 2023-09-28T04:23:15.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.003+0000 7f720ad9d700 1 --2- 172.21.15.118:0/1911799079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f720c0c4ab0 0x7f720c14f440 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7204009e60 tx=0x7f7204009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad5fb43416f8fc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:15.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.003+0000 7f720959a700 1 -- 172.21.15.118:0/1911799079 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720400e070 con 0x7f720c0c4ab0 2023-09-28T04:23:15.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.003+0000 7f720959a700 1 -- 172.21.15.118:0/1911799079 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720400bb40 con 0x7f720c0c4ab0 2023-09-28T04:23:15.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.003+0000 7f720959a700 1 -- 172.21.15.118:0/1911799079 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7204012430 con 0x7f720c0c4ab0 2023-09-28T04:23:15.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.003+0000 7f72109ff700 1 -- 172.21.15.118:0/1911799079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f720c0c4ab0 msgr2=0x7f720c14f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.003+0000 7f72109ff700 1 --2- 172.21.15.118:0/1911799079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f720c0c4ab0 0x7f720c14f440 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7204009e60 tx=0x7f7204009780 comp rx=0 tx=0).stop 2023-09-28T04:23:15.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.004+0000 7f72109ff700 1 -- 172.21.15.118:0/1911799079 shutdown_connections 2023-09-28T04:23:15.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.004+0000 7f72109ff700 1 --2- 172.21.15.118:0/1911799079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f720c0c4ab0 0x7f720c14f440 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.004+0000 7f72109ff700 1 --2- 172.21.15.118:0/1911799079 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f720c0ca6c0 0x7f720c156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.004+0000 7f72109ff700 1 -- 172.21.15.118:0/1911799079 >> 172.21.15.118:0/1911799079 conn(0x7f720c063230 msgr2=0x7f720c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:15.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.004+0000 7f72109ff700 1 -- 172.21.15.118:0/1911799079 shutdown_connections 2023-09-28T04:23:15.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.004+0000 7f72109ff700 1 -- 172.21.15.118:0/1911799079 wait complete. 2023-09-28T04:23:15.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.006+0000 7f72109ff700 1 Processor -- start 2023-09-28T04:23:15.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.006+0000 7f72109ff700 1 -- start start 2023-09-28T04:23:15.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.007+0000 7f72109ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f720c0c4ab0 0x7f720c14b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.007+0000 7f72109ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f720c0c5e30 0x7f720c1667c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.007+0000 7f72109ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f720c0ca6c0 0x7f720c166d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.007+0000 7f72109ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c168fe0 con 0x7f720c0c4ab0 2023-09-28T04:23:15.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.007+0000 7f72109ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c14e9c0 con 0x7f720c0ca6c0 2023-09-28T04:23:15.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.007+0000 7f72109ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720c14eca0 con 0x7f720c0c5e30 2023-09-28T04:23:15.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.007+0000 7f720a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f720c0c4ab0 0x7f720c14b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.007+0000 7f720a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f720c0c4ab0 0x7f720c14b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38282/0 (socket says 172.21.15.118:38282) 2023-09-28T04:23:15.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.007+0000 7f720a59c700 1 -- 172.21.15.118:0/3706305425 learned_addr learned my addr 172.21.15.118:0/3706305425 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:15.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.007+0000 7f7209d9b700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f720c0c5e30 0x7f720c1667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.007+0000 7f720ad9d700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f720c0ca6c0 0x7f720c166d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.008+0000 7f720a59c700 1 -- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f720c0c5e30 msgr2=0x7f720c1667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.008+0000 7f720a59c700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f720c0c5e30 0x7f720c1667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.008+0000 7f720a59c700 1 -- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f720c0ca6c0 msgr2=0x7f720c166d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.008+0000 7f720a59c700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f720c0ca6c0 0x7f720c166d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.008+0000 7f720a59c700 1 -- 172.21.15.118:0/3706305425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7204009a20 con 0x7f720c0c4ab0 2023-09-28T04:23:15.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.008+0000 7f720a59c700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f720c0c4ab0 0x7f720c14b8b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00c790 tx=0x7f71fc007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:15.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.008+0000 7f71fa7fc700 1 -- 172.21.15.118:0/3706305425 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0072e0 con 0x7f720c0c4ab0 2023-09-28T04:23:15.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.008+0000 7f71fa7fc700 1 -- 172.21.15.118:0/3706305425 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc007440 con 0x7f720c0c4ab0 2023-09-28T04:23:15.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.008+0000 7f72109ff700 1 -- 172.21.15.118:0/3706305425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720c14ef80 con 0x7f720c0c4ab0 2023-09-28T04:23:15.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.008+0000 7f71fa7fc700 1 -- 172.21.15.118:0/3706305425 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0057f0 con 0x7f720c0c4ab0 2023-09-28T04:23:15.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.008+0000 7f72109ff700 1 -- 172.21.15.118:0/3706305425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720c14bdf0 con 0x7f720c0c4ab0 2023-09-28T04:23:15.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.009+0000 7f72109ff700 1 -- 172.21.15.118:0/3706305425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720c166100 con 0x7f720c0c4ab0 2023-09-28T04:23:15.012 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.010+0000 7f71fa7fc700 1 -- 172.21.15.118:0/3706305425 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f71fc005be0 con 0x7f720c0c4ab0 2023-09-28T04:23:15.012 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.011+0000 7f71fa7fc700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f71ec067330 0x7f71ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.012 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.011+0000 7f71fa7fc700 1 -- 172.21.15.118:0/3706305425 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f71fc083cd0 con 0x7f720c0c4ab0 2023-09-28T04:23:15.012 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.012+0000 7f7209d9b700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f71ec067330 0x7f71ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.012 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.012+0000 7f7209d9b700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f71ec067330 0x7f71ec0697e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f720c0c6f40 tx=0x7f72000091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:15.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.015+0000 7f71fa7fc700 1 -- 172.21.15.118:0/3706305425 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f71fc04b570 con 0x7f720c0c4ab0 2023-09-28T04:23:15.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.202+0000 7f72109ff700 1 -- 172.21.15.118:0/3706305425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f720c0713a0 con 0x7f720c0c4ab0 2023-09-28T04:23:15.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.203+0000 7f71fa7fc700 1 -- 172.21.15.118:0/3706305425 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71fc017070 con 0x7f720c0c4ab0 2023-09-28T04:23:15.203 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2023-09-28T04:23:15.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.205+0000 7f72109ff700 1 -- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f71ec067330 msgr2=0x7f71ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.205+0000 7f72109ff700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f71ec067330 0x7f71ec0697e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f720c0c6f40 tx=0x7f72000091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.205+0000 7f72109ff700 1 -- 172.21.15.118:0/3706305425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f720c0c4ab0 msgr2=0x7f720c14b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.205+0000 7f72109ff700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f720c0c4ab0 0x7f720c14b8b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00c790 tx=0x7f71fc007c80 comp rx=0 tx=0).stop 2023-09-28T04:23:15.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.205+0000 7f72109ff700 1 -- 172.21.15.118:0/3706305425 shutdown_connections 2023-09-28T04:23:15.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.205+0000 7f72109ff700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f71ec067330 0x7f71ec0697e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.205+0000 7f72109ff700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f720c0ca6c0 0x7f720c166d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.205+0000 7f72109ff700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f720c0c4ab0 0x7f720c14b8b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.205+0000 7f72109ff700 1 --2- 172.21.15.118:0/3706305425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f720c0c5e30 0x7f720c1667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.205+0000 7f72109ff700 1 -- 172.21.15.118:0/3706305425 >> 172.21.15.118:0/3706305425 conn(0x7f720c063230 msgr2=0x7f720c0c5180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:15.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.205+0000 7f72109ff700 1 -- 172.21.15.118:0/3706305425 shutdown_connections 2023-09-28T04:23:15.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.205+0000 7f72109ff700 1 -- 172.21.15.118:0/3706305425 wait complete. 2023-09-28T04:23:15.222 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-28T04:23:15.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.417+0000 7fb92dfff700 1 Processor -- start 2023-09-28T04:23:15.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.417+0000 7fb92dfff700 1 -- start start 2023-09-28T04:23:15.420 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb92dfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb9280c1850 0x7fb928153e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb92dfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb92814d230 0x7fb92814d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb92dfff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92814dc10 con 0x7fb9280c1c20 2023-09-28T04:23:15.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb92dfff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9280c5510 con 0x7fb9280c1850 2023-09-28T04:23:15.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb92dfff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280c2bd0 con 0x7fb92814d230 2023-09-28T04:23:15.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb9277fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb9280c1850 0x7fb928153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb91ffff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fb9280c1c20 0x7fb9280c24c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46124/0 (socket says 172.21.15.118:46124) 2023-09-28T04:23:15.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb91ffff700 1 -- 172.21.15.118:0/2254741182 learned_addr learned my addr 172.21.15.118:0/2254741182 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:15.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb927fff700 1 --2- 172.21.15.118:0/2254741182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb92814d230 0x7fb92814d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb926ffd700 1 -- 172.21.15.118:0/2254741182 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094106060 0 0) 0x7fb92814dc10 con 0x7fb9280c1c20 2023-09-28T04:23:15.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb926ffd700 1 -- 172.21.15.118:0/2254741182 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb914003570 con 0x7fb9280c1c20 2023-09-28T04:23:15.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb927fff700 1 -- 172.21.15.118:0/2254741182 >> v2:172.21.15.174:3300/0 conn(0x7fb9280c1850 msgr2=0x7fb928153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:15.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb927fff700 1 --2- 172.21.15.118:0/2254741182 >> v2:172.21.15.174:3300/0 conn(0x7fb9280c1850 0x7fb928153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb927fff700 1 -- 172.21.15.118:0/2254741182 >> v1:172.21.15.174:6789/0 conn(0x7fb9280c1c20 legacy=0x7fb9280c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb927fff700 1 -- 172.21.15.118:0/2254741182 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9280bef30 con 0x7fb92814d230 2023-09-28T04:23:15.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.419+0000 7fb9277fe700 1 --2- 172.21.15.118:0/2254741182 >> v2:172.21.15.174:3300/0 conn(0x7fb9280c1850 0x7fb928153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:15.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.420+0000 7fb927fff700 1 --2- 172.21.15.118:0/2254741182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb92814d230 0x7fb92814d6d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb920009e60 tx=0x7fb920009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4049d5daddc7e933 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:15.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.420+0000 7fb926ffd700 1 -- 172.21.15.118:0/2254741182 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92000e070 con 0x7fb92814d230 2023-09-28T04:23:15.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.420+0000 7fb926ffd700 1 -- 172.21.15.118:0/2254741182 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92000bb40 con 0x7fb92814d230 2023-09-28T04:23:15.423 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.420+0000 7fb926ffd700 1 -- 172.21.15.118:0/2254741182 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb920012430 con 0x7fb92814d230 2023-09-28T04:23:15.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.420+0000 7fb92dfff700 1 -- 172.21.15.118:0/2254741182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb92814d230 msgr2=0x7fb92814d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.420+0000 7fb92dfff700 1 --2- 172.21.15.118:0/2254741182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb92814d230 0x7fb92814d6d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb920009e60 tx=0x7fb920009780 comp rx=0 tx=0).stop 2023-09-28T04:23:15.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.421+0000 7fb92dfff700 1 -- 172.21.15.118:0/2254741182 shutdown_connections 2023-09-28T04:23:15.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.421+0000 7fb92dfff700 1 --2- 172.21.15.118:0/2254741182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb92814d230 0x7fb92814d6d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.421+0000 7fb92dfff700 1 --2- 172.21.15.118:0/2254741182 >> v2:172.21.15.174:3300/0 conn(0x7fb9280c1850 0x7fb928153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.421+0000 7fb92dfff700 1 -- 172.21.15.118:0/2254741182 >> 172.21.15.118:0/2254741182 conn(0x7fb928067630 msgr2=0x7fb928067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:15.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.421+0000 7fb92dfff700 1 -- 172.21.15.118:0/2254741182 shutdown_connections 2023-09-28T04:23:15.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.421+0000 7fb92dfff700 1 -- 172.21.15.118:0/2254741182 wait complete. 2023-09-28T04:23:15.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.422+0000 7fb92dfff700 1 Processor -- start 2023-09-28T04:23:15.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.422+0000 7fb92dfff700 1 -- start start 2023-09-28T04:23:15.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.423+0000 7fb92dfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9280c1850 0x7fb928165a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.423+0000 7fb92dfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9280c1c20 0x7fb928067bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.423+0000 7fb92dfff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb92814d230 0x7fb9280b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.423+0000 7fb92dfff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280b9d40 con 0x7fb9280c1850 2023-09-28T04:23:15.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.423+0000 7fb92dfff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb928169490 con 0x7fb92814d230 2023-09-28T04:23:15.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.423+0000 7fb92dfff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb928164ff0 con 0x7fb9280c1c20 2023-09-28T04:23:15.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.423+0000 7fb91ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9280c1c20 0x7fb928067bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.423+0000 7fb9277fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9280c1850 0x7fb928165a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.423+0000 7fb927fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb92814d230 0x7fb9280b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.423+0000 7fb91ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9280c1c20 0x7fb928067bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:45402/0 (socket says 172.21.15.118:45402) 2023-09-28T04:23:15.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.423+0000 7fb91ffff700 1 -- 172.21.15.118:0/3775035994 learned_addr learned my addr 172.21.15.118:0/3775035994 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:15.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.423+0000 7fb9277fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9280c1850 0x7fb928165a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38290/0 (socket says 172.21.15.118:38290) 2023-09-28T04:23:15.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.424+0000 7fb9277fe700 1 -- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9280c1c20 msgr2=0x7fb928067bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.424+0000 7fb9277fe700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9280c1c20 0x7fb928067bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.424+0000 7fb9277fe700 1 -- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb92814d230 msgr2=0x7fb9280b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.424+0000 7fb9277fe700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb92814d230 0x7fb9280b8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.424+0000 7fb9277fe700 1 -- 172.21.15.118:0/3775035994 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb918009420 con 0x7fb9280c1850 2023-09-28T04:23:15.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.424+0000 7fb927fff700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb92814d230 0x7fb9280b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:15.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.424+0000 7fb91ffff700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9280c1c20 0x7fb928067bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:15.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.424+0000 7fb9277fe700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9280c1850 0x7fb928165a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb91800ec80 tx=0x7fb9180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:15.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.424+0000 7fb91f7fe700 1 -- 172.21.15.118:0/3775035994 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918009700 con 0x7fb9280c1850 2023-09-28T04:23:15.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.424+0000 7fb91f7fe700 1 -- 172.21.15.118:0/3775035994 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91800c850 con 0x7fb9280c1850 2023-09-28T04:23:15.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.424+0000 7fb91f7fe700 1 -- 172.21.15.118:0/3775035994 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91800cc10 con 0x7fb9280c1850 2023-09-28T04:23:15.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.424+0000 7fb92dfff700 1 -- 172.21.15.118:0/3775035994 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb920009a20 con 0x7fb9280c1850 2023-09-28T04:23:15.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.425+0000 7fb92dfff700 1 -- 172.21.15.118:0/3775035994 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9280ba440 con 0x7fb9280c1850 2023-09-28T04:23:15.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.426+0000 7fb92dfff700 1 -- 172.21.15.118:0/3775035994 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb928071980 con 0x7fb9280c1850 2023-09-28T04:23:15.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.426+0000 7fb91f7fe700 1 -- 172.21.15.118:0/3775035994 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb918013470 con 0x7fb9280c1850 2023-09-28T04:23:15.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.428+0000 7fb91f7fe700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb908067360 0x7fb908069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.428+0000 7fb91f7fe700 1 -- 172.21.15.118:0/3775035994 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb918084a30 con 0x7fb9280c1850 2023-09-28T04:23:15.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.428+0000 7fb91ffff700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb908067360 0x7fb908069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.429+0000 7fb91ffff700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb908067360 0x7fb908069810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb9280bafd0 tx=0x7fb910009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:15.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.432+0000 7fb91f7fe700 1 -- 172.21.15.118:0/3775035994 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb918051be0 con 0x7fb9280c1850 2023-09-28T04:23:15.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.620+0000 7fb92dfff700 1 -- 172.21.15.118:0/3775035994 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb928152de0 con 0x7fb9280c1850 2023-09-28T04:23:15.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.621+0000 7fb91f7fe700 1 -- 172.21.15.118:0/3775035994 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb918055200 con 0x7fb9280c1850 2023-09-28T04:23:15.621 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2023-09-28T04:23:15.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.623+0000 7fb92dfff700 1 -- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb908067360 msgr2=0x7fb908069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.623+0000 7fb92dfff700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb908067360 0x7fb908069810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb9280bafd0 tx=0x7fb910009040 comp rx=0 tx=0).stop 2023-09-28T04:23:15.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.623+0000 7fb92dfff700 1 -- 172.21.15.118:0/3775035994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9280c1850 msgr2=0x7fb928165a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.623+0000 7fb92dfff700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9280c1850 0x7fb928165a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb91800ec80 tx=0x7fb9180091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.623+0000 7fb92dfff700 1 -- 172.21.15.118:0/3775035994 shutdown_connections 2023-09-28T04:23:15.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.623+0000 7fb92dfff700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb908067360 0x7fb908069810 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.623+0000 7fb92dfff700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb92814d230 0x7fb9280b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.623+0000 7fb92dfff700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9280c1850 0x7fb928165a00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.623+0000 7fb92dfff700 1 --2- 172.21.15.118:0/3775035994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9280c1c20 0x7fb928067bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.623+0000 7fb92dfff700 1 -- 172.21.15.118:0/3775035994 >> 172.21.15.118:0/3775035994 conn(0x7fb928067630 msgr2=0x7fb9281590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:15.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.623+0000 7fb92dfff700 1 -- 172.21.15.118:0/3775035994 shutdown_connections 2023-09-28T04:23:15.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.623+0000 7fb92dfff700 1 -- 172.21.15.118:0/3775035994 wait complete. 2023-09-28T04:23:15.641 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-28T04:23:15.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.831+0000 7f18615ff700 1 Processor -- start 2023-09-28T04:23:15.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.831+0000 7f18615ff700 1 -- start start 2023-09-28T04:23:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.832+0000 7f18615ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f185c0c38c0 0x7f185c15d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.832+0000 7f18615ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c14c3c0 con 0x7f185c152640 2023-09-28T04:23:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.832+0000 7f18615ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c152a70 con 0x7f185c06f1c0 2023-09-28T04:23:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.832+0000 7f18615ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c0c24c0 con 0x7f185c0c38c0 2023-09-28T04:23:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.832+0000 7f185b7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f185c0c38c0 0x7f185c15d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.832+0000 7f185a7fc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f185c152640 0x7f185c0c31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:55466/0 (socket says 172.21.15.118:55466) 2023-09-28T04:23:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.833+0000 7f185a7fc700 1 -- 172.21.15.118:0/2268839669 learned_addr learned my addr 172.21.15.118:0/2268839669 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.833+0000 7f185b7fe700 1 -- 172.21.15.118:0/2268839669 >> v1:172.21.15.174:6789/0 conn(0x7f185c06f1c0 legacy=0x7f185c06b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.833+0000 7f185b7fe700 1 -- 172.21.15.118:0/2268839669 >> v1:172.21.15.118:6789/0 conn(0x7f185c152640 legacy=0x7f185c0c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.833+0000 7f185b7fe700 1 -- 172.21.15.118:0/2268839669 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c06c2c0 con 0x7f185c0c38c0 2023-09-28T04:23:15.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.833+0000 7f185b7fe700 1 --2- 172.21.15.118:0/2268839669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185c0c38c0 0x7f185c15d4e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f185400af70 tx=0x7f185400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2d1045aa5d536c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:15.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.833+0000 7f1859ffb700 1 -- 172.21.15.118:0/2268839669 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400f070 con 0x7f185c0c38c0 2023-09-28T04:23:15.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.833+0000 7f1859ffb700 1 -- 172.21.15.118:0/2268839669 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185400a2e0 con 0x7f185c0c38c0 2023-09-28T04:23:15.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.833+0000 7f1859ffb700 1 -- 172.21.15.118:0/2268839669 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400cd20 con 0x7f185c0c38c0 2023-09-28T04:23:15.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.834+0000 7f18615ff700 1 -- 172.21.15.118:0/2268839669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185c0c38c0 msgr2=0x7f185c15d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.834+0000 7f18615ff700 1 --2- 172.21.15.118:0/2268839669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185c0c38c0 0x7f185c15d4e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f185400af70 tx=0x7f185400a890 comp rx=0 tx=0).stop 2023-09-28T04:23:15.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.834+0000 7f18615ff700 1 -- 172.21.15.118:0/2268839669 shutdown_connections 2023-09-28T04:23:15.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.834+0000 7f18615ff700 1 --2- 172.21.15.118:0/2268839669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185c0c38c0 0x7f185c15d4e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.834+0000 7f18615ff700 1 -- 172.21.15.118:0/2268839669 >> 172.21.15.118:0/2268839669 conn(0x7f185c067630 msgr2=0x7f185c067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:15.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.834+0000 7f18615ff700 1 -- 172.21.15.118:0/2268839669 shutdown_connections 2023-09-28T04:23:15.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.834+0000 7f18615ff700 1 -- 172.21.15.118:0/2268839669 wait complete. 2023-09-28T04:23:15.837 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.835+0000 7f18615ff700 1 Processor -- start 2023-09-28T04:23:15.837 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.836+0000 7f18615ff700 1 -- start start 2023-09-28T04:23:15.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.836+0000 7f18615ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f185c06f1c0 0x7f185c14dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.836+0000 7f18615ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f185c0c38c0 0x7f185c0c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f18615ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185c152640 0x7f185c162f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f18615ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c14d020 con 0x7f185c152640 2023-09-28T04:23:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f18615ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c156830 con 0x7f185c0c38c0 2023-09-28T04:23:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f18615ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c14c6f0 con 0x7f185c06f1c0 2023-09-28T04:23:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f185b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185c152640 0x7f185c162f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f185b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185c152640 0x7f185c162f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38304/0 (socket says 172.21.15.118:38304) 2023-09-28T04:23:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f185b7fe700 1 -- 172.21.15.118:0/3944501359 learned_addr learned my addr 172.21.15.118:0/3944501359 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f185a7fc700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f185c0c38c0 0x7f185c0c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f185affd700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f185c06f1c0 0x7f185c14dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f185b7fe700 1 -- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f185c06f1c0 msgr2=0x7f185c14dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f185b7fe700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f185c06f1c0 0x7f185c14dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f185b7fe700 1 -- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f185c0c38c0 msgr2=0x7f185c0c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:15.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f185b7fe700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f185c0c38c0 0x7f185c0c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:15.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f185b7fe700 1 -- 172.21.15.118:0/3944501359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185400ab30 con 0x7f185c152640 2023-09-28T04:23:15.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.837+0000 7f185b7fe700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185c152640 0x7f185c162f60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f185c06d6b0 tx=0x7f1854019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:15.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.838+0000 7f1842ffd700 1 -- 172.21.15.118:0/3944501359 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854009d30 con 0x7f185c152640 2023-09-28T04:23:15.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.838+0000 7f1842ffd700 1 -- 172.21.15.118:0/3944501359 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1854026460 con 0x7f185c152640 2023-09-28T04:23:15.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.838+0000 7f1842ffd700 1 -- 172.21.15.118:0/3944501359 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854026820 con 0x7f185c152640 2023-09-28T04:23:15.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.838+0000 7f18615ff700 1 -- 172.21.15.118:0/3944501359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c14c9d0 con 0x7f185c152640 2023-09-28T04:23:15.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.838+0000 7f18615ff700 1 -- 172.21.15.118:0/3944501359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c06fa90 con 0x7f185c152640 2023-09-28T04:23:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.839+0000 7f18615ff700 1 -- 172.21.15.118:0/3944501359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c14d1d0 con 0x7f185c152640 2023-09-28T04:23:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.840+0000 7f1842ffd700 1 -- 172.21.15.118:0/3944501359 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1854003050 con 0x7f185c152640 2023-09-28T04:23:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.841+0000 7f1842ffd700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1848067360 0x7f1848069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:15.841 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.841+0000 7f1842ffd700 1 -- 172.21.15.118:0/3944501359 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1854086bf0 con 0x7f185c152640 2023-09-28T04:23:15.842 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.841+0000 7f185affd700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1848067360 0x7f1848069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:15.842 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.842+0000 7f185affd700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1848067360 0x7f1848069810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f184c003a80 tx=0x7f184c007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:15.845 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:15.844+0000 7f1842ffd700 1 -- 172.21.15.118:0/3944501359 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f185c14d1d0 con 0x7f185c152640 2023-09-28T04:23:16.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.039+0000 7f18615ff700 1 -- 172.21.15.118:0/3944501359 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f185c14d1d0 con 0x7f185c152640 2023-09-28T04:23:16.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.040+0000 7f1842ffd700 1 -- 172.21.15.118:0/3944501359 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f185402b090 con 0x7f185c152640 2023-09-28T04:23:16.040 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:16.041 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2023-09-28T04:23:16.041 INFO:teuthology.orchestra.run.smithi118.stdout: { 2023-09-28T04:23:16.041 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2023-09-28T04:23:16.041 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2023-09-28T04:23:16.041 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-09-28T04:23:16.041 INFO:teuthology.orchestra.run.smithi118.stdout: { 2023-09-28T04:23:16.041 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 2, 2023-09-28T04:23:16.041 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": "rbd" 2023-09-28T04:23:16.041 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-09-28T04:23:16.041 INFO:teuthology.orchestra.run.smithi118.stdout:] 2023-09-28T04:23:16.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.042+0000 7f18615ff700 1 -- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1848067360 msgr2=0x7f1848069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:16.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.042+0000 7f18615ff700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1848067360 0x7f1848069810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f184c003a80 tx=0x7f184c007ec0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.042+0000 7f18615ff700 1 -- 172.21.15.118:0/3944501359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185c152640 msgr2=0x7f185c162f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:16.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.042+0000 7f18615ff700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185c152640 0x7f185c162f60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f185c06d6b0 tx=0x7f1854019000 comp rx=0 tx=0).stop 2023-09-28T04:23:16.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.042+0000 7f18615ff700 1 -- 172.21.15.118:0/3944501359 shutdown_connections 2023-09-28T04:23:16.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.042+0000 7f18615ff700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1848067360 0x7f1848069810 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.042+0000 7f18615ff700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185c152640 0x7f185c162f60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.042+0000 7f18615ff700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f185c06f1c0 0x7f185c14dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.042+0000 7f18615ff700 1 --2- 172.21.15.118:0/3944501359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f185c0c38c0 0x7f185c0c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.042+0000 7f18615ff700 1 -- 172.21.15.118:0/3944501359 >> 172.21.15.118:0/3944501359 conn(0x7f185c067630 msgr2=0x7f185c155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:16.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.042+0000 7f18615ff700 1 -- 172.21.15.118:0/3944501359 shutdown_connections 2023-09-28T04:23:16.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.042+0000 7f18615ff700 1 -- 172.21.15.118:0/3944501359 wait complete. 2023-09-28T04:23:16.059 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-28T04:23:16.059 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-28T04:23:16.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.251+0000 7f33051ff700 1 Processor -- start 2023-09-28T04:23:16.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.251+0000 7f33051ff700 1 -- start start 2023-09-28T04:23:16.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.253+0000 7f33051ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f33000c12a0 0x7f33001562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:16.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.253+0000 7f33051ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33000c9d70 0x7f33000ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:16.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.253+0000 7f33051ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3300089ca0 con 0x7f33000c0ed0 2023-09-28T04:23:16.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.253+0000 7f33051ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33000cce80 con 0x7f33000c12a0 2023-09-28T04:23:16.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.253+0000 7f33051ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33000ca6f0 con 0x7f33000c9d70 2023-09-28T04:23:16.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.253+0000 7f32fed9d700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f33000c0ed0 0x7f33000cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:55482/0 (socket says 172.21.15.118:55482) 2023-09-28T04:23:16.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.253+0000 7f32fed9d700 1 -- 172.21.15.118:0/1213999768 learned_addr learned my addr 172.21.15.118:0/1213999768 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:16.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.253+0000 7f32fe59c700 1 --2- 172.21.15.118:0/1213999768 >> v2:172.21.15.174:3300/0 conn(0x7f33000c12a0 0x7f33001562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:16.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.253+0000 7f32ff59e700 1 --2- 172.21.15.118:0/1213999768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33000c9d70 0x7f33000ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:16.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.253+0000 7f32fdd9b700 1 -- 172.21.15.118:0/1213999768 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415691101 0 0) 0x7f3300089ca0 con 0x7f33000c0ed0 2023-09-28T04:23:16.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.253+0000 7f32fdd9b700 1 -- 172.21.15.118:0/1213999768 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e8003570 con 0x7f33000c0ed0 2023-09-28T04:23:16.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.254+0000 7f32fe59c700 1 -- 172.21.15.118:0/1213999768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33000c9d70 msgr2=0x7f33000ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:16.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.254+0000 7f32fe59c700 1 --2- 172.21.15.118:0/1213999768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33000c9d70 0x7f33000ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.254+0000 7f32fe59c700 1 -- 172.21.15.118:0/1213999768 >> v1:172.21.15.118:6789/0 conn(0x7f33000c0ed0 legacy=0x7f33000cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:16.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.254+0000 7f32fe59c700 1 -- 172.21.15.118:0/1213999768 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000c8400 con 0x7f33000c12a0 2023-09-28T04:23:16.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.254+0000 7f32fe59c700 1 --2- 172.21.15.118:0/1213999768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33000c12a0 0x7f33001562b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009940 tx=0x7f32f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b424d928ede2a86 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:16.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.254+0000 7f32fdd9b700 1 -- 172.21.15.118:0/1213999768 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4011630 con 0x7f33000c12a0 2023-09-28T04:23:16.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.254+0000 7f32fdd9b700 1 -- 172.21.15.118:0/1213999768 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f4011790 con 0x7f33000c12a0 2023-09-28T04:23:16.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.254+0000 7f32fdd9b700 1 -- 172.21.15.118:0/1213999768 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4011b50 con 0x7f33000c12a0 2023-09-28T04:23:16.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.254+0000 7f33051ff700 1 -- 172.21.15.118:0/1213999768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33000c12a0 msgr2=0x7f33001562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:16.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.254+0000 7f33051ff700 1 --2- 172.21.15.118:0/1213999768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33000c12a0 0x7f33001562b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009940 tx=0x7f32f40091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.255+0000 7f33051ff700 1 -- 172.21.15.118:0/1213999768 shutdown_connections 2023-09-28T04:23:16.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.255+0000 7f33051ff700 1 --2- 172.21.15.118:0/1213999768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33000c9d70 0x7f33000ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.255+0000 7f33051ff700 1 --2- 172.21.15.118:0/1213999768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33000c12a0 0x7f33001562b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.255+0000 7f33051ff700 1 -- 172.21.15.118:0/1213999768 >> 172.21.15.118:0/1213999768 conn(0x7f3300063d00 msgr2=0x7f33000cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:16.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.255+0000 7f33051ff700 1 -- 172.21.15.118:0/1213999768 shutdown_connections 2023-09-28T04:23:16.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.255+0000 7f33051ff700 1 -- 172.21.15.118:0/1213999768 wait complete. 2023-09-28T04:23:16.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.256+0000 7f33051ff700 1 Processor -- start 2023-09-28T04:23:16.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.256+0000 7f33051ff700 1 -- start start 2023-09-28T04:23:16.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.257+0000 7f33051ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33000c0ed0 0x7f330014bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:16.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.257+0000 7f33051ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33000c12a0 0x7f3300151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:16.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.257+0000 7f33051ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33000c9d70 0x7f3300146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:16.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.257+0000 7f33051ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330014b0b0 con 0x7f33000c12a0 2023-09-28T04:23:16.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.257+0000 7f33051ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330014c290 con 0x7f33000c9d70 2023-09-28T04:23:16.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.257+0000 7f33051ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330014a4e0 con 0x7f33000c0ed0 2023-09-28T04:23:16.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.257+0000 7f32fe59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33000c12a0 0x7f3300151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:16.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.257+0000 7f32fe59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33000c12a0 0x7f3300151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38306/0 (socket says 172.21.15.118:38306) 2023-09-28T04:23:16.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.257+0000 7f32fe59c700 1 -- 172.21.15.118:0/1095765898 learned_addr learned my addr 172.21.15.118:0/1095765898 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:16.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.257+0000 7f32fed9d700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33000c0ed0 0x7f330014bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:16.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.257+0000 7f32ff59e700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33000c9d70 0x7f3300146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:16.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.258+0000 7f32fe59c700 1 -- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33000c0ed0 msgr2=0x7f330014bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:16.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.258+0000 7f32fe59c700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33000c0ed0 0x7f330014bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.258+0000 7f32fe59c700 1 -- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33000c9d70 msgr2=0x7f3300146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:16.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.258+0000 7f32fe59c700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33000c9d70 0x7f3300146160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.258+0000 7f32fe59c700 1 -- 172.21.15.118:0/1095765898 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f4009420 con 0x7f33000c12a0 2023-09-28T04:23:16.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.258+0000 7f32ff59e700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33000c9d70 0x7f3300146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:16.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.258+0000 7f32fe59c700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33000c12a0 0x7f3300151280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f32f4013000 tx=0x7f32f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:16.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.258+0000 7f32e6ffd700 1 -- 172.21.15.118:0/1095765898 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f401f070 con 0x7f33000c12a0 2023-09-28T04:23:16.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.258+0000 7f32e6ffd700 1 -- 172.21.15.118:0/1095765898 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f4000bc0 con 0x7f33000c12a0 2023-09-28T04:23:16.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.258+0000 7f33051ff700 1 -- 172.21.15.118:0/1095765898 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330014a780 con 0x7f33000c12a0 2023-09-28T04:23:16.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.258+0000 7f32e6ffd700 1 -- 172.21.15.118:0/1095765898 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4011b50 con 0x7f33000c12a0 2023-09-28T04:23:16.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.258+0000 7f33051ff700 1 -- 172.21.15.118:0/1095765898 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330014ad40 con 0x7f33000c12a0 2023-09-28T04:23:16.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.259+0000 7f33051ff700 1 -- 172.21.15.118:0/1095765898 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33000713a0 con 0x7f33000c12a0 2023-09-28T04:23:16.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.260+0000 7f32e6ffd700 1 -- 172.21.15.118:0/1095765898 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f32f4023070 con 0x7f33000c12a0 2023-09-28T04:23:16.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.261+0000 7f32e6ffd700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f32ec067330 0x7f32ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:16.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.261+0000 7f32e6ffd700 1 -- 172.21.15.118:0/1095765898 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f32f4085af0 con 0x7f33000c12a0 2023-09-28T04:23:16.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.261+0000 7f32fed9d700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f32ec067330 0x7f32ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:16.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.262+0000 7f32fed9d700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f32ec067330 0x7f32ec0697e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32f0007fd0 tx=0x7f32f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:16.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.265+0000 7f32e6ffd700 1 -- 172.21.15.118:0/1095765898 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f32f4052d40 con 0x7f33000c12a0 2023-09-28T04:23:16.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.453+0000 7f33051ff700 1 -- 172.21.15.118:0/1095765898 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3300071980 con 0x7f33000c12a0 2023-09-28T04:23:16.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.883+0000 7f32e6ffd700 1 -- 172.21.15.118:0/1095765898 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f32f402a0b0 con 0x7f33000c12a0 2023-09-28T04:23:16.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.887+0000 7f33051ff700 1 -- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f32ec067330 msgr2=0x7f32ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:16.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.887+0000 7f33051ff700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f32ec067330 0x7f32ec0697e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32f0007fd0 tx=0x7f32f0009040 comp rx=0 tx=0).stop 2023-09-28T04:23:16.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.887+0000 7f33051ff700 1 -- 172.21.15.118:0/1095765898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33000c12a0 msgr2=0x7f3300151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:16.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.887+0000 7f33051ff700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33000c12a0 0x7f3300151280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f32f4013000 tx=0x7f32f4017000 comp rx=0 tx=0).stop 2023-09-28T04:23:16.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.887+0000 7f33051ff700 1 -- 172.21.15.118:0/1095765898 shutdown_connections 2023-09-28T04:23:16.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.887+0000 7f33051ff700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f32ec067330 0x7f32ec0697e0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32f0007fd0 tx=0x7f32f0009040 comp rx=0 tx=0).stop 2023-09-28T04:23:16.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.887+0000 7f33051ff700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33000c9d70 0x7f3300146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.887+0000 7f33051ff700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f33000c0ed0 0x7f330014bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.887+0000 7f33051ff700 1 --2- 172.21.15.118:0/1095765898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33000c12a0 0x7f3300151280 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:16.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.887+0000 7f33051ff700 1 -- 172.21.15.118:0/1095765898 >> 172.21.15.118:0/1095765898 conn(0x7f3300063d00 msgr2=0x7f3300152ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:16.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.891+0000 7f33051ff700 1 -- 172.21.15.118:0/1095765898 shutdown_connections 2023-09-28T04:23:16.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:16.892+0000 7f33051ff700 1 -- 172.21.15.118:0/1095765898 wait complete. 2023-09-28T04:23:16.893 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2023-09-28T04:23:16.910 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-28T04:23:17.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.106+0000 7f3d15dff700 1 Processor -- start 2023-09-28T04:23:17.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.106+0000 7f3d15dff700 1 -- start start 2023-09-28T04:23:17.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.107+0000 7f3d15dff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d1014fa90 0x7f3d10156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:17.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.107+0000 7f3d15dff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d1014fe60 0x7f3d10068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:17.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.107+0000 7f3d15dff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3d100c84c0 0x7f3d100cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:17.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.107+0000 7f3d15dff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d100c8030 con 0x7f3d1014fa90 2023-09-28T04:23:17.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.107+0000 7f3d15dff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d100c7180 con 0x7f3d100c84c0 2023-09-28T04:23:17.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.107+0000 7f3d15dff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d100c7420 con 0x7f3d1014fe60 2023-09-28T04:23:17.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.107+0000 7f3d0f7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d1014fa90 0x7f3d10156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:17.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.107+0000 7f3d0f7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d1014fa90 0x7f3d10156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38308/0 (socket says 172.21.15.118:38308) 2023-09-28T04:23:17.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.107+0000 7f3d0f7fe700 1 -- 172.21.15.118:0/499273672 learned_addr learned my addr 172.21.15.118:0/499273672 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:17.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.107+0000 7f3d0effd700 1 --2- 172.21.15.118:0/499273672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d1014fe60 0x7f3d10068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:17.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.107+0000 7f3d0ffff700 1 --2- 172.21.15.118:0/499273672 >> v2:172.21.15.174:3300/0 conn(0x7f3d100c84c0 0x7f3d100cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:17.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.108+0000 7f3d0f7fe700 1 -- 172.21.15.118:0/499273672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d1014fe60 msgr2=0x7f3d10068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:17.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.108+0000 7f3d0f7fe700 1 --2- 172.21.15.118:0/499273672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d1014fe60 0x7f3d10068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:17.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.108+0000 7f3d0f7fe700 1 -- 172.21.15.118:0/499273672 >> v2:172.21.15.174:3300/0 conn(0x7f3d100c84c0 msgr2=0x7f3d100cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:17.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.108+0000 7f3d0f7fe700 1 --2- 172.21.15.118:0/499273672 >> v2:172.21.15.174:3300/0 conn(0x7f3d100c84c0 0x7f3d100cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:17.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.108+0000 7f3d0f7fe700 1 -- 172.21.15.118:0/499273672 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d100c7700 con 0x7f3d1014fa90 2023-09-28T04:23:17.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.108+0000 7f3d0ffff700 1 --2- 172.21.15.118:0/499273672 >> v2:172.21.15.174:3300/0 conn(0x7f3d100c84c0 0x7f3d100cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:17.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.108+0000 7f3d0f7fe700 1 --2- 172.21.15.118:0/499273672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d1014fa90 0x7f3d10156430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3d100c9e30 tx=0x7f3d00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9854684ab9c6ee7a server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:17.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.108+0000 7f3d0e7fc700 1 -- 172.21.15.118:0/499273672 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000b640 con 0x7f3d1014fa90 2023-09-28T04:23:17.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.108+0000 7f3d0e7fc700 1 -- 172.21.15.118:0/499273672 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0000b7a0 con 0x7f3d1014fa90 2023-09-28T04:23:17.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.108+0000 7f3d0e7fc700 1 -- 172.21.15.118:0/499273672 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000bb60 con 0x7f3d1014fa90 2023-09-28T04:23:17.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.109+0000 7f3d15dff700 1 -- 172.21.15.118:0/499273672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d1014fa90 msgr2=0x7f3d10156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:17.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.109+0000 7f3d15dff700 1 --2- 172.21.15.118:0/499273672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d1014fa90 0x7f3d10156430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3d100c9e30 tx=0x7f3d00009250 comp rx=0 tx=0).stop 2023-09-28T04:23:17.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.109+0000 7f3d15dff700 1 -- 172.21.15.118:0/499273672 shutdown_connections 2023-09-28T04:23:17.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.109+0000 7f3d15dff700 1 --2- 172.21.15.118:0/499273672 >> v2:172.21.15.174:3300/0 conn(0x7f3d100c84c0 0x7f3d100cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:17.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.109+0000 7f3d15dff700 1 --2- 172.21.15.118:0/499273672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d1014fa90 0x7f3d10156430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:17.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.109+0000 7f3d15dff700 1 --2- 172.21.15.118:0/499273672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d1014fe60 0x7f3d10068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:17.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.109+0000 7f3d15dff700 1 -- 172.21.15.118:0/499273672 >> 172.21.15.118:0/499273672 conn(0x7f3d10063cd0 msgr2=0x7f3d100cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:17.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.109+0000 7f3d15dff700 1 -- 172.21.15.118:0/499273672 shutdown_connections 2023-09-28T04:23:17.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.109+0000 7f3d15dff700 1 -- 172.21.15.118:0/499273672 wait complete. 2023-09-28T04:23:17.115 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.110+0000 7f3d15dff700 1 Processor -- start 2023-09-28T04:23:17.115 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.111+0000 7f3d15dff700 1 -- start start 2023-09-28T04:23:17.115 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.111+0000 7f3d15dff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d100c84c0 0x7f3d1015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:17.115 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.111+0000 7f3d15dff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d1014fa90 0x7f3d10155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:17.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.111+0000 7f3d15dff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d1014fe60 0x7f3d1014c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:17.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.111+0000 7f3d15dff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101502a0 con 0x7f3d100c84c0 2023-09-28T04:23:17.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.112+0000 7f3d15dff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101548f0 con 0x7f3d1014fe60 2023-09-28T04:23:17.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.112+0000 7f3d15dff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101537b0 con 0x7f3d1014fa90 2023-09-28T04:23:17.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.112+0000 7f3d0f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d100c84c0 0x7f3d1015b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:17.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.112+0000 7f3d0f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d100c84c0 0x7f3d1015b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:38314/0 (socket says 172.21.15.118:38314) 2023-09-28T04:23:17.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.112+0000 7f3d0f7fe700 1 -- 172.21.15.118:0/2757039798 learned_addr learned my addr 172.21.15.118:0/2757039798 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:17.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.112+0000 7f3d0effd700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d1014fa90 0x7f3d10155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:17.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.112+0000 7f3d0ffff700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d1014fe60 0x7f3d1014c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:17.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.112+0000 7f3d0f7fe700 1 -- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d1014fa90 msgr2=0x7f3d10155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:17.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.112+0000 7f3d0f7fe700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d1014fa90 0x7f3d10155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:17.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.112+0000 7f3d0f7fe700 1 -- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d1014fe60 msgr2=0x7f3d1014c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:17.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.112+0000 7f3d0f7fe700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d1014fe60 0x7f3d1014c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:17.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.112+0000 7f3d0f7fe700 1 -- 172.21.15.118:0/2757039798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d08009a20 con 0x7f3d100c84c0 2023-09-28T04:23:17.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.112+0000 7f3d0f7fe700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d100c84c0 0x7f3d1015b690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d10064880 tx=0x7f3d00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:17.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.113+0000 7f3cf77fe700 1 -- 172.21.15.118:0/2757039798 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00000d10 con 0x7f3d100c84c0 2023-09-28T04:23:17.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.113+0000 7f3cf77fe700 1 -- 172.21.15.118:0/2757039798 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0000bb20 con 0x7f3d100c84c0 2023-09-28T04:23:17.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.113+0000 7f3d15dff700 1 -- 172.21.15.118:0/2757039798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d000094f0 con 0x7f3d100c84c0 2023-09-28T04:23:17.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.113+0000 7f3cf77fe700 1 -- 172.21.15.118:0/2757039798 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00011670 con 0x7f3d100c84c0 2023-09-28T04:23:17.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.113+0000 7f3d15dff700 1 -- 172.21.15.118:0/2757039798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d101504b0 con 0x7f3d100c84c0 2023-09-28T04:23:17.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.114+0000 7f3d15dff700 1 -- 172.21.15.118:0/2757039798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d10071980 con 0x7f3d100c84c0 2023-09-28T04:23:17.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.115+0000 7f3cf77fe700 1 -- 172.21.15.118:0/2757039798 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3d000119e0 con 0x7f3d100c84c0 2023-09-28T04:23:17.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.116+0000 7f3cf77fe700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3cfc067330 0x7f3cfc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:17.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.116+0000 7f3cf77fe700 1 -- 172.21.15.118:0/2757039798 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f3d00086100 con 0x7f3d100c84c0 2023-09-28T04:23:17.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.116+0000 7f3d0effd700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3cfc067330 0x7f3cfc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:17.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.117+0000 7f3d0effd700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3cfc067330 0x7f3cfc0697e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d100aead0 tx=0x7f3d040091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:17.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.121+0000 7f3cf77fe700 1 -- 172.21.15.118:0/2757039798 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3d00053200 con 0x7f3d100c84c0 2023-09-28T04:23:17.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.311+0000 7f3d15dff700 1 -- 172.21.15.118:0/2757039798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3d100c6a60 con 0x7f3d100c84c0 2023-09-28T04:23:17.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.887+0000 7f3cf77fe700 1 -- 172.21.15.118:0/2757039798 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3d00056820 con 0x7f3d100c84c0 2023-09-28T04:23:17.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.891+0000 7f3d15dff700 1 -- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3cfc067330 msgr2=0x7f3cfc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:17.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.891+0000 7f3d15dff700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3cfc067330 0x7f3cfc0697e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d100aead0 tx=0x7f3d040091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:17.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.891+0000 7f3d15dff700 1 -- 172.21.15.118:0/2757039798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d100c84c0 msgr2=0x7f3d1015b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:17.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.891+0000 7f3d15dff700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d100c84c0 0x7f3d1015b690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d10064880 tx=0x7f3d00017000 comp rx=0 tx=0).stop 2023-09-28T04:23:17.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.892+0000 7f3d15dff700 1 -- 172.21.15.118:0/2757039798 shutdown_connections 2023-09-28T04:23:17.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.892+0000 7f3d15dff700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3cfc067330 0x7f3cfc0697e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:17.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.892+0000 7f3d15dff700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d1014fe60 0x7f3d1014c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:17.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.892+0000 7f3d15dff700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d100c84c0 0x7f3d1015b690 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:17.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.892+0000 7f3d15dff700 1 --2- 172.21.15.118:0/2757039798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d1014fa90 0x7f3d10155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:17.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.892+0000 7f3d15dff700 1 -- 172.21.15.118:0/2757039798 >> 172.21.15.118:0/2757039798 conn(0x7f3d10063cd0 msgr2=0x7f3d100cac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:17.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.897+0000 7f3d15dff700 1 -- 172.21.15.118:0/2757039798 shutdown_connections 2023-09-28T04:23:17.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:17.900+0000 7f3d15dff700 1 -- 172.21.15.118:0/2757039798 wait complete. 2023-09-28T04:23:17.906 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2023-09-28T04:23:17.929 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-28T04:23:18.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.120+0000 7f5dd59ff700 1 Processor -- start 2023-09-28T04:23:18.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.120+0000 7f5dd59ff700 1 -- start start 2023-09-28T04:23:18.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.121+0000 7f5dd59ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dd014fa90 0x7f5dd0156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:18.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.121+0000 7f5dd59ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5dd00c84c0 0x7f5dd0068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:18.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.121+0000 7f5dd59ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd00c8030 con 0x7f5dd014fe60 2023-09-28T04:23:18.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.121+0000 7f5dd59ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd00c7180 con 0x7f5dd00c84c0 2023-09-28T04:23:18.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.121+0000 7f5dd59ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd00c7420 con 0x7f5dd014fa90 2023-09-28T04:23:18.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.122+0000 7f5dcf7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5dd00c84c0 0x7f5dd0068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:18.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.122+0000 7f5dce7fc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5dd014fe60 0x7f5dd00cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46046/0 (socket says 172.21.15.118:46046) 2023-09-28T04:23:18.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.122+0000 7f5dce7fc700 1 -- 172.21.15.118:0/3740277996 learned_addr learned my addr 172.21.15.118:0/3740277996 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:18.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.122+0000 7f5dceffd700 1 --2- 172.21.15.118:0/3740277996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dd014fa90 0x7f5dd0156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:18.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.122+0000 7f5dceffd700 1 -- 172.21.15.118:0/3740277996 >> v2:172.21.15.118:3300/0 conn(0x7f5dd00c84c0 msgr2=0x7f5dd0068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:18.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.122+0000 7f5dceffd700 1 --2- 172.21.15.118:0/3740277996 >> v2:172.21.15.118:3300/0 conn(0x7f5dd00c84c0 0x7f5dd0068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.122+0000 7f5dceffd700 1 -- 172.21.15.118:0/3740277996 >> v1:172.21.15.118:6789/0 conn(0x7f5dd014fe60 legacy=0x7f5dd00cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:18.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.122+0000 7f5dcdffb700 1 -- 172.21.15.118:0/3740277996 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594922282 0 0) 0x7f5dd00c8030 con 0x7f5dd014fe60 2023-09-28T04:23:18.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.122+0000 7f5dceffd700 1 -- 172.21.15.118:0/3740277996 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd00c7700 con 0x7f5dd014fa90 2023-09-28T04:23:18.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.122+0000 7f5dceffd700 1 --2- 172.21.15.118:0/3740277996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dd014fa90 0x7f5dd0156430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00098e0 tx=0x7f5dc00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=155ccd85a9ff10a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:18.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.123+0000 7f5dcdffb700 1 -- 172.21.15.118:0/3740277996 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc000b640 con 0x7f5dd014fa90 2023-09-28T04:23:18.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.123+0000 7f5dcdffb700 1 -- 172.21.15.118:0/3740277996 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc000b7a0 con 0x7f5dd014fa90 2023-09-28T04:23:18.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.123+0000 7f5dcdffb700 1 -- 172.21.15.118:0/3740277996 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc000bb40 con 0x7f5dd014fa90 2023-09-28T04:23:18.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.123+0000 7f5dd59ff700 1 -- 172.21.15.118:0/3740277996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dd014fa90 msgr2=0x7f5dd0156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:18.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.123+0000 7f5dd59ff700 1 --2- 172.21.15.118:0/3740277996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dd014fa90 0x7f5dd0156430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00098e0 tx=0x7f5dc00091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.123+0000 7f5dd59ff700 1 -- 172.21.15.118:0/3740277996 shutdown_connections 2023-09-28T04:23:18.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.123+0000 7f5dd59ff700 1 --2- 172.21.15.118:0/3740277996 >> v2:172.21.15.118:3300/0 conn(0x7f5dd00c84c0 0x7f5dd0068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.123+0000 7f5dd59ff700 1 --2- 172.21.15.118:0/3740277996 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dd014fa90 0x7f5dd0156430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.123+0000 7f5dd59ff700 1 -- 172.21.15.118:0/3740277996 >> 172.21.15.118:0/3740277996 conn(0x7f5dd0063cd0 msgr2=0x7f5dd00cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:18.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.123+0000 7f5dd59ff700 1 -- 172.21.15.118:0/3740277996 shutdown_connections 2023-09-28T04:23:18.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.123+0000 7f5dd59ff700 1 -- 172.21.15.118:0/3740277996 wait complete. 2023-09-28T04:23:18.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.125+0000 7f5dd59ff700 1 Processor -- start 2023-09-28T04:23:18.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.125+0000 7f5dd59ff700 1 -- start start 2023-09-28T04:23:18.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.126+0000 7f5dd59ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd00c84c0 0x7f5dd00c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:18.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.126+0000 7f5dd59ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd014fa90 0x7f5dd0157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:18.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.126+0000 7f5dd59ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dd014fe60 0x7f5dd00c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:18.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.126+0000 7f5dd59ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd00c6150 con 0x7f5dd014fa90 2023-09-28T04:23:18.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.126+0000 7f5dd59ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd0155880 con 0x7f5dd00c84c0 2023-09-28T04:23:18.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.126+0000 7f5dd59ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd014c9a0 con 0x7f5dd014fe60 2023-09-28T04:23:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.126+0000 7f5dce7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd014fa90 0x7f5dd0157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.126+0000 7f5dce7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd014fa90 0x7f5dd0157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45236/0 (socket says 172.21.15.118:45236) 2023-09-28T04:23:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.126+0000 7f5dceffd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd00c84c0 0x7f5dd00c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.126+0000 7f5dce7fc700 1 -- 172.21.15.118:0/476162896 learned_addr learned my addr 172.21.15.118:0/476162896 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.126+0000 7f5dcf7fe700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dd014fe60 0x7f5dd00c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.127+0000 7f5dce7fc700 1 -- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dd014fe60 msgr2=0x7f5dd00c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.127+0000 7f5dce7fc700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dd014fe60 0x7f5dd00c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.127+0000 7f5dce7fc700 1 -- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd00c84c0 msgr2=0x7f5dd00c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.127+0000 7f5dce7fc700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd00c84c0 0x7f5dd00c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.127+0000 7f5dce7fc700 1 -- 172.21.15.118:0/476162896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc0009420 con 0x7f5dd014fa90 2023-09-28T04:23:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.127+0000 7f5dceffd700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd00c84c0 0x7f5dd00c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.127+0000 7f5dce7fc700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd014fa90 0x7f5dd0157ee0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400c5e0 tx=0x7f5dc4000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.127+0000 7f5db6ffd700 1 -- 172.21.15.118:0/476162896 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4005b30 con 0x7f5dd014fa90 2023-09-28T04:23:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.127+0000 7f5db6ffd700 1 -- 172.21.15.118:0/476162896 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc4005cb0 con 0x7f5dd014fa90 2023-09-28T04:23:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.127+0000 7f5dd59ff700 1 -- 172.21.15.118:0/476162896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd0158980 con 0x7f5dd014fa90 2023-09-28T04:23:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.127+0000 7f5db6ffd700 1 -- 172.21.15.118:0/476162896 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4007320 con 0x7f5dd014fa90 2023-09-28T04:23:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.127+0000 7f5dd59ff700 1 -- 172.21.15.118:0/476162896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd014e150 con 0x7f5dd014fa90 2023-09-28T04:23:18.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.128+0000 7f5dd59ff700 1 -- 172.21.15.118:0/476162896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd0155a30 con 0x7f5dd014fa90 2023-09-28T04:23:18.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.129+0000 7f5db6ffd700 1 -- 172.21.15.118:0/476162896 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5dc401c440 con 0x7f5dd014fa90 2023-09-28T04:23:18.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.130+0000 7f5db6ffd700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f5dbc067330 0x7f5dbc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:18.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.130+0000 7f5db6ffd700 1 -- 172.21.15.118:0/476162896 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f5dc4083ff0 con 0x7f5dd014fa90 2023-09-28T04:23:18.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.130+0000 7f5dceffd700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f5dbc067330 0x7f5dbc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:18.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.131+0000 7f5dceffd700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f5dbc067330 0x7f5dbc0697e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00093f0 tx=0x7f5dc0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:18.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.135+0000 7f5db6ffd700 1 -- 172.21.15.118:0/476162896 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5dc4050ed0 con 0x7f5dd014fa90 2023-09-28T04:23:18.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.368+0000 7f5dd59ff700 1 -- 172.21.15.118:0/476162896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5dd0071980 con 0x7f5dd014fa90 2023-09-28T04:23:18.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.373+0000 7f5db6ffd700 1 -- 172.21.15.118:0/476162896 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5dc40170c0 con 0x7f5dd014fa90 2023-09-28T04:23:18.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.381+0000 7f5dd59ff700 1 -- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f5dbc067330 msgr2=0x7f5dbc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:18.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.381+0000 7f5dd59ff700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f5dbc067330 0x7f5dbc0697e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00093f0 tx=0x7f5dc0017000 comp rx=0 tx=0).stop 2023-09-28T04:23:18.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.381+0000 7f5dd59ff700 1 -- 172.21.15.118:0/476162896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd014fa90 msgr2=0x7f5dd0157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:18.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.381+0000 7f5dd59ff700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd014fa90 0x7f5dd0157ee0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400c5e0 tx=0x7f5dc4000fe0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.386+0000 7f5dd59ff700 1 -- 172.21.15.118:0/476162896 shutdown_connections 2023-09-28T04:23:18.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.386+0000 7f5dd59ff700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f5dbc067330 0x7f5dbc0697e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.386+0000 7f5dd59ff700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5dd014fe60 0x7f5dd00c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.386+0000 7f5dd59ff700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd00c84c0 0x7f5dd00c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.386+0000 7f5dd59ff700 1 --2- 172.21.15.118:0/476162896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd014fa90 0x7f5dd0157ee0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.386+0000 7f5dd59ff700 1 -- 172.21.15.118:0/476162896 >> 172.21.15.118:0/476162896 conn(0x7f5dd0063cd0 msgr2=0x7f5dd014ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:18.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.393+0000 7f5dd59ff700 1 -- 172.21.15.118:0/476162896 shutdown_connections 2023-09-28T04:23:18.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.396+0000 7f5dd59ff700 1 -- 172.21.15.118:0/476162896 wait complete. 2023-09-28T04:23:18.404 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 3 and data pool 4 2023-09-28T04:23:18.420 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:18.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.608+0000 7ff7037ff700 1 Processor -- start 2023-09-28T04:23:18.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.608+0000 7ff7037ff700 1 -- start start 2023-09-28T04:23:18.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.609+0000 7ff7037ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6fc14f8b0 0x7ff6fc1557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:18.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.609+0000 7ff7037ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6fc14fc80 0x7ff6fc0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:18.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.609+0000 7ff7037ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc0633d0 con 0x7ff6fc0676a0 2023-09-28T04:23:18.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.609+0000 7ff7037ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc0c44b0 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.610+0000 7ff7037ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0bbd50 con 0x7ff6fc14fc80 2023-09-28T04:23:18.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.610+0000 7ff70159b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6fc14f8b0 0x7ff6fc1557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:18.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.610+0000 7ff700d9a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff6fc0676a0 0x7ff6fc0c8350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46050/0 (socket says 172.21.15.118:46050) 2023-09-28T04:23:18.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.610+0000 7ff701d9c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6fc14fc80 0x7ff6fc0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:18.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.610+0000 7ff700d9a700 1 -- 172.21.15.118:0/2247002600 learned_addr learned my addr 172.21.15.118:0/2247002600 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:18.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.610+0000 7ff701d9c700 1 -- 172.21.15.118:0/2247002600 >> v2:172.21.15.174:3300/0 conn(0x7ff6fc14f8b0 msgr2=0x7ff6fc1557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:18.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.610+0000 7ff701d9c700 1 --2- 172.21.15.118:0/2247002600 >> v2:172.21.15.174:3300/0 conn(0x7ff6fc14f8b0 0x7ff6fc1557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.610+0000 7ff701d9c700 1 -- 172.21.15.118:0/2247002600 >> v1:172.21.15.118:6789/0 conn(0x7ff6fc0676a0 legacy=0x7ff6fc0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:18.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.610+0000 7ff6f3fff700 1 -- 172.21.15.118:0/2247002600 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767545304 0 0) 0x7ff6fc0633d0 con 0x7ff6fc0676a0 2023-09-28T04:23:18.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.610+0000 7ff701d9c700 1 -- 172.21.15.118:0/2247002600 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0636b0 con 0x7ff6fc14fc80 2023-09-28T04:23:18.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.610+0000 7ff70159b700 1 --2- 172.21.15.118:0/2247002600 >> v2:172.21.15.174:3300/0 conn(0x7ff6fc14f8b0 0x7ff6fc1557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:18.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.610+0000 7ff701d9c700 1 --2- 172.21.15.118:0/2247002600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6fc14fc80 0x7ff6fc0c8fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009e60 tx=0x7ff6f4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df63335fd5fa6f61 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:18.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.611+0000 7ff6f3fff700 1 -- 172.21.15.118:0/2247002600 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f400e070 con 0x7ff6fc14fc80 2023-09-28T04:23:18.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.611+0000 7ff6f3fff700 1 -- 172.21.15.118:0/2247002600 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f400bb60 con 0x7ff6fc14fc80 2023-09-28T04:23:18.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.611+0000 7ff6f3fff700 1 -- 172.21.15.118:0/2247002600 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4012430 con 0x7ff6fc14fc80 2023-09-28T04:23:18.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.611+0000 7ff7037ff700 1 -- 172.21.15.118:0/2247002600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6fc14fc80 msgr2=0x7ff6fc0c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:18.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.611+0000 7ff7037ff700 1 --2- 172.21.15.118:0/2247002600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6fc14fc80 0x7ff6fc0c8fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009e60 tx=0x7ff6f4009780 comp rx=0 tx=0).stop 2023-09-28T04:23:18.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.611+0000 7ff7037ff700 1 -- 172.21.15.118:0/2247002600 shutdown_connections 2023-09-28T04:23:18.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.611+0000 7ff7037ff700 1 --2- 172.21.15.118:0/2247002600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6fc14fc80 0x7ff6fc0c8fa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.611+0000 7ff7037ff700 1 --2- 172.21.15.118:0/2247002600 >> v2:172.21.15.174:3300/0 conn(0x7ff6fc14f8b0 0x7ff6fc1557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.611+0000 7ff7037ff700 1 -- 172.21.15.118:0/2247002600 >> 172.21.15.118:0/2247002600 conn(0x7ff6fc06a3b0 msgr2=0x7ff6fc06a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:18.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.611+0000 7ff7037ff700 1 -- 172.21.15.118:0/2247002600 shutdown_connections 2023-09-28T04:23:18.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.611+0000 7ff7037ff700 1 -- 172.21.15.118:0/2247002600 wait complete. 2023-09-28T04:23:18.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.613+0000 7ff7037ff700 1 Processor -- start 2023-09-28T04:23:18.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.613+0000 7ff7037ff700 1 -- start start 2023-09-28T04:23:18.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff7037ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6fc0676a0 0x7ff6fc14e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:18.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff7037ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6fc14f8b0 0x7ff6fc0c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:18.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff7037ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6fc14fc80 0x7ff6fc152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:18.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff7037ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0c6960 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff7037ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc159dc0 con 0x7ff6fc14fc80 2023-09-28T04:23:18.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff7037ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0c63a0 con 0x7ff6fc0676a0 2023-09-28T04:23:18.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff700d9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6fc14f8b0 0x7ff6fc0c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:18.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff70159b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6fc0676a0 0x7ff6fc14e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:18.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff700d9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6fc14f8b0 0x7ff6fc0c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45248/0 (socket says 172.21.15.118:45248) 2023-09-28T04:23:18.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff700d9a700 1 -- 172.21.15.118:0/551559952 learned_addr learned my addr 172.21.15.118:0/551559952 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:18.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff701d9c700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6fc14fc80 0x7ff6fc152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:18.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff700d9a700 1 -- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6fc0676a0 msgr2=0x7ff6fc14e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:18.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff700d9a700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6fc0676a0 0x7ff6fc14e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff700d9a700 1 -- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6fc14fc80 msgr2=0x7ff6fc152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:18.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff700d9a700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6fc14fc80 0x7ff6fc152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff700d9a700 1 -- 172.21.15.118:0/551559952 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f80093c0 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.614+0000 7ff70159b700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6fc0676a0 0x7ff6fc14e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:18.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.615+0000 7ff700d9a700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6fc14f8b0 0x7ff6fc0c6f10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00c810 tx=0x7ff6ec007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:18.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.615+0000 7ff6f17fa700 1 -- 172.21.15.118:0/551559952 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec005c00 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.615+0000 7ff6f17fa700 1 -- 172.21.15.118:0/551559952 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec005d60 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.615+0000 7ff6f17fa700 1 -- 172.21.15.118:0/551559952 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec007300 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.615+0000 7ff7037ff700 1 -- 172.21.15.118:0/551559952 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f4009a20 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.615+0000 7ff7037ff700 1 -- 172.21.15.118:0/551559952 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc15ba50 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.616+0000 7ff7037ff700 1 -- 172.21.15.118:0/551559952 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc15c0a0 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.617+0000 7ff6f17fa700 1 -- 172.21.15.118:0/551559952 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff6ec01b3b0 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.617+0000 7ff6f17fa700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7ff6e0067330 0x7ff6e00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:18.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.618+0000 7ff6f17fa700 1 -- 172.21.15.118:0/551559952 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff6ec084120 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.618+0000 7ff70159b700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7ff6e0067330 0x7ff6e00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:18.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.618+0000 7ff70159b700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7ff6e0067330 0x7ff6e00697e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009fd0 tx=0x7ff6f8009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:18.622 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.622+0000 7ff6f17fa700 1 -- 172.21.15.118:0/551559952 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff6fc15c0a0 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.815 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.815+0000 7ff7037ff700 1 -- 172.21.15.118:0/551559952 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6fc15c0a0 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.816 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.816+0000 7ff6f17fa700 1 -- 172.21.15.118:0/551559952 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17023 (secure 0 0 0) 0x7ff6fc15c0a0 con 0x7ff6fc14f8b0 2023-09-28T04:23:18.817 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:18.817 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":20,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:18.369705+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T04:23:10.586895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T04:23:10.697802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T04:23:16.491417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T04:23:17.349188+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:07.142219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.951857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.911133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.882482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.688096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.764671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.767264+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.763816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:18.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.818+0000 7ff7037ff700 1 -- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7ff6e0067330 msgr2=0x7ff6e00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:18.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.818+0000 7ff7037ff700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7ff6e0067330 0x7ff6e00697e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009fd0 tx=0x7ff6f8009120 comp rx=0 tx=0).stop 2023-09-28T04:23:18.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.818+0000 7ff7037ff700 1 -- 172.21.15.118:0/551559952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6fc14f8b0 msgr2=0x7ff6fc0c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:18.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.818+0000 7ff7037ff700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6fc14f8b0 0x7ff6fc0c6f10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00c810 tx=0x7ff6ec007db0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.818+0000 7ff7037ff700 1 -- 172.21.15.118:0/551559952 shutdown_connections 2023-09-28T04:23:18.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.819+0000 7ff7037ff700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7ff6e0067330 0x7ff6e00697e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.819+0000 7ff7037ff700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6fc14fc80 0x7ff6fc152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.819+0000 7ff7037ff700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6fc0676a0 0x7ff6fc14e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.819+0000 7ff7037ff700 1 --2- 172.21.15.118:0/551559952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6fc14f8b0 0x7ff6fc0c6f10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:18.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.819+0000 7ff7037ff700 1 -- 172.21.15.118:0/551559952 >> 172.21.15.118:0/551559952 conn(0x7ff6fc06a3b0 msgr2=0x7ff6fc0c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:18.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.819+0000 7ff7037ff700 1 -- 172.21.15.118:0/551559952 shutdown_connections 2023-09-28T04:23:18.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:18.819+0000 7ff7037ff700 1 -- 172.21.15.118:0/551559952 wait complete. 2023-09-28T04:23:18.836 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:19.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.026+0000 7f3d5a7ff700 1 Processor -- start 2023-09-28T04:23:19.027 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.026+0000 7f3d5a7ff700 1 -- start start 2023-09-28T04:23:19.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d5a7ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d540676a0 0x7f3d541557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:19.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d5a7ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5414fc80 0x7f3d540c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:19.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d5a7ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d540633d0 con 0x7f3d5414f8b0 2023-09-28T04:23:19.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d5a7ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d540c44b0 con 0x7f3d540676a0 2023-09-28T04:23:19.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d5a7ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540bbd50 con 0x7f3d5414fc80 2023-09-28T04:23:19.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d537fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d540676a0 0x7f3d541557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:19.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d537fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d540676a0 0x7f3d541557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45256/0 (socket says 172.21.15.118:45256) 2023-09-28T04:23:19.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d537fe700 1 -- 172.21.15.118:0/296553912 learned_addr learned my addr 172.21.15.118:0/296553912 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:19.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d53fff700 1 --1- 172.21.15.118:0/296553912 >> v1:172.21.15.118:6789/0 conn(0x7f3d5414f8b0 0x7f3d540c8350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46064/0 (socket says 172.21.15.118:46064) 2023-09-28T04:23:19.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d58d9c700 1 --2- 172.21.15.118:0/296553912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5414fc80 0x7f3d540c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:19.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d537fe700 1 -- 172.21.15.118:0/296553912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5414fc80 msgr2=0x7f3d540c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:19.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d537fe700 1 --2- 172.21.15.118:0/296553912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5414fc80 0x7f3d540c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d537fe700 1 -- 172.21.15.118:0/296553912 >> v1:172.21.15.118:6789/0 conn(0x7f3d5414f8b0 legacy=0x7f3d540c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:19.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d537fe700 1 -- 172.21.15.118:0/296553912 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d540636b0 con 0x7f3d540676a0 2023-09-28T04:23:19.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d58d9c700 1 --2- 172.21.15.118:0/296553912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5414fc80 0x7f3d540c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:19.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.028+0000 7f3d52ffd700 1 -- 172.21.15.118:0/296553912 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697023306 0 0) 0x7f3d540633d0 con 0x7f3d5414f8b0 2023-09-28T04:23:19.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.029+0000 7f3d537fe700 1 --2- 172.21.15.118:0/296553912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d540676a0 0x7f3d541557a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3d480099b0 tx=0x7f3d48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c3f9c4db79c3de server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:19.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.029+0000 7f3d52ffd700 1 -- 172.21.15.118:0/296553912 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4800b860 con 0x7f3d540676a0 2023-09-28T04:23:19.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.029+0000 7f3d52ffd700 1 -- 172.21.15.118:0/296553912 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4800b9c0 con 0x7f3d540676a0 2023-09-28T04:23:19.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.029+0000 7f3d52ffd700 1 -- 172.21.15.118:0/296553912 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4800bd60 con 0x7f3d540676a0 2023-09-28T04:23:19.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.029+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/296553912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d540676a0 msgr2=0x7f3d541557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:19.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.029+0000 7f3d5a7ff700 1 --2- 172.21.15.118:0/296553912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d540676a0 0x7f3d541557a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3d480099b0 tx=0x7f3d48009250 comp rx=0 tx=0).stop 2023-09-28T04:23:19.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.029+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/296553912 shutdown_connections 2023-09-28T04:23:19.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.029+0000 7f3d5a7ff700 1 --2- 172.21.15.118:0/296553912 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d5414fc80 0x7f3d540c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.029+0000 7f3d5a7ff700 1 --2- 172.21.15.118:0/296553912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d540676a0 0x7f3d541557a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.029+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/296553912 >> 172.21.15.118:0/296553912 conn(0x7f3d5406a3b0 msgr2=0x7f3d5406a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:19.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.030+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/296553912 shutdown_connections 2023-09-28T04:23:19.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.030+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/296553912 wait complete. 2023-09-28T04:23:19.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.031+0000 7f3d5a7ff700 1 Processor -- start 2023-09-28T04:23:19.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.031+0000 7f3d5a7ff700 1 -- start start 2023-09-28T04:23:19.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.032+0000 7f3d5a7ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d540676a0 0x7f3d54166c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:19.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.032+0000 7f3d5a7ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5414f8b0 0x7f3d540c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:19.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.032+0000 7f3d5a7ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d5414fc80 0x7f3d54169720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:19.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.032+0000 7f3d5a7ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540c8530 con 0x7f3d5414f8b0 2023-09-28T04:23:19.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.032+0000 7f3d5a7ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540c6a10 con 0x7f3d5414fc80 2023-09-28T04:23:19.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.032+0000 7f3d5a7ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540c7f70 con 0x7f3d540676a0 2023-09-28T04:23:19.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.032+0000 7f3d537fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5414f8b0 0x7f3d540c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:19.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.032+0000 7f3d537fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5414f8b0 0x7f3d540c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45268/0 (socket says 172.21.15.118:45268) 2023-09-28T04:23:19.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.032+0000 7f3d537fe700 1 -- 172.21.15.118:0/1436461066 learned_addr learned my addr 172.21.15.118:0/1436461066 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:19.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.032+0000 7f3d53fff700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d540676a0 0x7f3d54166c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:19.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.032+0000 7f3d58d9c700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d5414fc80 0x7f3d54169720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:19.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.033+0000 7f3d537fe700 1 -- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d540676a0 msgr2=0x7f3d54166c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:19.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.033+0000 7f3d537fe700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d540676a0 0x7f3d54166c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.033+0000 7f3d537fe700 1 -- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d5414fc80 msgr2=0x7f3d54169720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:19.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.033+0000 7f3d537fe700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d5414fc80 0x7f3d54169720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.033+0000 7f3d537fe700 1 -- 172.21.15.118:0/1436461066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480094f0 con 0x7f3d5414f8b0 2023-09-28T04:23:19.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.033+0000 7f3d537fe700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5414f8b0 0x7f3d540c6ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d480090b0 tx=0x7f3d48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:19.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.033+0000 7f3d3bfff700 1 -- 172.21.15.118:0/1436461066 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48011d70 con 0x7f3d5414f8b0 2023-09-28T04:23:19.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.033+0000 7f3d3bfff700 1 -- 172.21.15.118:0/1436461066 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4801a450 con 0x7f3d5414f8b0 2023-09-28T04:23:19.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.033+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/1436461066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d540c8250 con 0x7f3d5414f8b0 2023-09-28T04:23:19.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.033+0000 7f3d3bfff700 1 -- 172.21.15.118:0/1436461066 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4801a810 con 0x7f3d5414f8b0 2023-09-28T04:23:19.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.033+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/1436461066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d540c66a0 con 0x7f3d5414f8b0 2023-09-28T04:23:19.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.034+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/1436461066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d540c6220 con 0x7f3d5414f8b0 2023-09-28T04:23:19.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.035+0000 7f3d3bfff700 1 -- 172.21.15.118:0/1436461066 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3d4801ac00 con 0x7f3d5414f8b0 2023-09-28T04:23:19.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.036+0000 7f3d3bfff700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3d40067360 0x7f3d40069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:19.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.036+0000 7f3d3bfff700 1 -- 172.21.15.118:0/1436461066 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3d48086180 con 0x7f3d5414f8b0 2023-09-28T04:23:19.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.037+0000 7f3d53fff700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3d40067360 0x7f3d40069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:19.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.037+0000 7f3d53fff700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3d40067360 0x7f3d40069810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d440012a0 tx=0x7f3d44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:19.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.041+0000 7f3d3bfff700 1 -- 172.21.15.118:0/1436461066 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3d540c6220 con 0x7f3d5414f8b0 2023-09-28T04:23:19.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.235+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/1436461066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d54169c60 con 0x7f3d5414f8b0 2023-09-28T04:23:19.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.236+0000 7f3d3bfff700 1 -- 172.21.15.118:0/1436461066 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17023 (secure 0 0 0) 0x7f3d54169c60 con 0x7f3d5414f8b0 2023-09-28T04:23:19.237 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:19.237 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":20,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:18.369705+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T04:23:10.586895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T04:23:10.697802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T04:23:16.491417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T04:23:17.349188+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:07.142219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.951857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.911133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.882482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.688096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.764671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.767264+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.763816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:19.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.239+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3d40067360 msgr2=0x7f3d40069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:19.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.239+0000 7f3d5a7ff700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3d40067360 0x7f3d40069810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d440012a0 tx=0x7f3d44009040 comp rx=0 tx=0).stop 2023-09-28T04:23:19.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.239+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/1436461066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5414f8b0 msgr2=0x7f3d540c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:19.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.239+0000 7f3d5a7ff700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5414f8b0 0x7f3d540c6ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d480090b0 tx=0x7f3d48017000 comp rx=0 tx=0).stop 2023-09-28T04:23:19.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.239+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/1436461066 shutdown_connections 2023-09-28T04:23:19.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.239+0000 7f3d5a7ff700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3d40067360 0x7f3d40069810 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.239+0000 7f3d5a7ff700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d5414fc80 0x7f3d54169720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.239+0000 7f3d5a7ff700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d540676a0 0x7f3d54166c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.239+0000 7f3d5a7ff700 1 --2- 172.21.15.118:0/1436461066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d5414f8b0 0x7f3d540c6ea0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.239+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/1436461066 >> 172.21.15.118:0/1436461066 conn(0x7f3d5406a3b0 msgr2=0x7f3d540c0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:19.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.239+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/1436461066 shutdown_connections 2023-09-28T04:23:19.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.239+0000 7f3d5a7ff700 1 -- 172.21.15.118:0/1436461066 wait complete. 2023-09-28T04:23:19.259 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-28T04:23:19.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.454+0000 7efff05ff700 1 Processor -- start 2023-09-28T04:23:19.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.455+0000 7efff05ff700 1 -- start start 2023-09-28T04:23:19.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.456+0000 7efff05ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effe814fa90 0x7effe8156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:19.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.456+0000 7efff05ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7effe814fe60 0x7effe8068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:19.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.456+0000 7efff05ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe80c8030 con 0x7effe80c84c0 2023-09-28T04:23:19.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.456+0000 7efff05ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe80c7180 con 0x7effe814fe60 2023-09-28T04:23:19.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.456+0000 7efff05ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe80c7420 con 0x7effe814fa90 2023-09-28T04:23:19.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.456+0000 7effedb9a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7effe814fe60 0x7effe8068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:19.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.456+0000 7effedb9a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7effe814fe60 0x7effe8068b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42124/0 (socket says 172.21.15.118:42124) 2023-09-28T04:23:19.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.456+0000 7effeeb9c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7effe80c84c0 0x7effe80cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46210/0 (socket says 172.21.15.118:46210) 2023-09-28T04:23:19.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.456+0000 7effedb9a700 1 -- 172.21.15.118:0/2598350651 learned_addr learned my addr 172.21.15.118:0/2598350651 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:19.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.456+0000 7effee39b700 1 --2- 172.21.15.118:0/2598350651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effe814fa90 0x7effe8156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:19.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.457+0000 7effed399700 1 -- 172.21.15.118:0/2598350651 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680784158 0 0) 0x7effe80c8030 con 0x7effe80c84c0 2023-09-28T04:23:19.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.457+0000 7effed399700 1 -- 172.21.15.118:0/2598350651 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd4003570 con 0x7effe80c84c0 2023-09-28T04:23:19.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.457+0000 7effedb9a700 1 -- 172.21.15.118:0/2598350651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effe814fa90 msgr2=0x7effe8156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:19.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.457+0000 7effedb9a700 1 --2- 172.21.15.118:0/2598350651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effe814fa90 0x7effe8156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.457+0000 7effedb9a700 1 -- 172.21.15.118:0/2598350651 >> v1:172.21.15.174:6789/0 conn(0x7effe80c84c0 legacy=0x7effe80cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:19.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.457+0000 7effedb9a700 1 -- 172.21.15.118:0/2598350651 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe80c7700 con 0x7effe814fe60 2023-09-28T04:23:19.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.457+0000 7effee39b700 1 --2- 172.21.15.118:0/2598350651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effe814fa90 0x7effe8156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:19.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.457+0000 7effedb9a700 1 --2- 172.21.15.118:0/2598350651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe814fe60 0x7effe8068b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7effd80099b0 tx=0x7effd8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eb58523239abc73 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:19.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.457+0000 7effed399700 1 -- 172.21.15.118:0/2598350651 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd800b680 con 0x7effe814fe60 2023-09-28T04:23:19.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.457+0000 7effed399700 1 -- 172.21.15.118:0/2598350651 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd800b7e0 con 0x7effe814fe60 2023-09-28T04:23:19.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.457+0000 7effed399700 1 -- 172.21.15.118:0/2598350651 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd800bb80 con 0x7effe814fe60 2023-09-28T04:23:19.465 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.458+0000 7efff05ff700 1 -- 172.21.15.118:0/2598350651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe814fe60 msgr2=0x7effe8068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:19.465 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.458+0000 7efff05ff700 1 --2- 172.21.15.118:0/2598350651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe814fe60 0x7effe8068b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7effd80099b0 tx=0x7effd8009250 comp rx=0 tx=0).stop 2023-09-28T04:23:19.465 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.458+0000 7efff05ff700 1 -- 172.21.15.118:0/2598350651 shutdown_connections 2023-09-28T04:23:19.465 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.458+0000 7efff05ff700 1 --2- 172.21.15.118:0/2598350651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effe814fa90 0x7effe8156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.465 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.458+0000 7efff05ff700 1 --2- 172.21.15.118:0/2598350651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe814fe60 0x7effe8068b90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.465 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.458+0000 7efff05ff700 1 -- 172.21.15.118:0/2598350651 >> 172.21.15.118:0/2598350651 conn(0x7effe8063cd0 msgr2=0x7effe80cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:19.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.458+0000 7efff05ff700 1 -- 172.21.15.118:0/2598350651 shutdown_connections 2023-09-28T04:23:19.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.458+0000 7efff05ff700 1 -- 172.21.15.118:0/2598350651 wait complete. 2023-09-28T04:23:19.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.459+0000 7efff05ff700 1 Processor -- start 2023-09-28T04:23:19.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.460+0000 7efff05ff700 1 -- start start 2023-09-28T04:23:19.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.460+0000 7efff05ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effe80c84c0 0x7effe8152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:19.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.460+0000 7efff05ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe814fa90 0x7effe8069dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:19.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.460+0000 7efff05ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe814fe60 0x7effe8151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:19.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.460+0000 7efff05ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe81668a0 con 0x7effe814fe60 2023-09-28T04:23:19.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.460+0000 7efff05ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe81519b0 con 0x7effe814fa90 2023-09-28T04:23:19.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.460+0000 7efff05ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe80c54e0 con 0x7effe80c84c0 2023-09-28T04:23:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.461+0000 7effeeb9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe814fe60 0x7effe8151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.461+0000 7effee39b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effe80c84c0 0x7effe8152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.461+0000 7effedb9a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe814fa90 0x7effe8069dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.461+0000 7effedb9a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe814fa90 0x7effe8069dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42132/0 (socket says 172.21.15.118:42132) 2023-09-28T04:23:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.461+0000 7effedb9a700 1 -- 172.21.15.118:0/1149530992 learned_addr learned my addr 172.21.15.118:0/1149530992 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.461+0000 7effee39b700 1 --2- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effe80c84c0 0x7effe8152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:58914/0 (socket says 172.21.15.118:58914) 2023-09-28T04:23:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.461+0000 7effedb9a700 1 -- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effe80c84c0 msgr2=0x7effe8152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.461+0000 7effedb9a700 1 --2- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effe80c84c0 0x7effe8152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.461+0000 7effedb9a700 1 -- 172.21.15.118:0/1149530992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe814fe60 msgr2=0x7effe8151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.461+0000 7effedb9a700 1 --2- 172.21.15.118:0/1149530992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe814fe60 0x7effe8151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:19.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.461+0000 7effedb9a700 1 -- 172.21.15.118:0/1149530992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe4009420 con 0x7effe814fa90 2023-09-28T04:23:19.468 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.461+0000 7effedb9a700 1 --2- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe814fa90 0x7effe8069dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7effe8064880 tx=0x7effd8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:19.468 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.462+0000 7effde7fc700 1 -- 172.21.15.118:0/1149530992 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd800b950 con 0x7effe814fa90 2023-09-28T04:23:19.468 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.462+0000 7effde7fc700 1 -- 172.21.15.118:0/1149530992 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd800bad0 con 0x7effe814fa90 2023-09-28T04:23:19.468 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.462+0000 7efff05ff700 1 -- 172.21.15.118:0/1149530992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd80094f0 con 0x7effe814fa90 2023-09-28T04:23:19.468 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.462+0000 7effde7fc700 1 -- 172.21.15.118:0/1149530992 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd801a680 con 0x7effe814fa90 2023-09-28T04:23:19.468 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.462+0000 7efff05ff700 1 -- 172.21.15.118:0/1149530992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe8166000 con 0x7effe814fa90 2023-09-28T04:23:19.468 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.463+0000 7efff05ff700 1 -- 172.21.15.118:0/1149530992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe8071980 con 0x7effe814fa90 2023-09-28T04:23:19.468 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.463+0000 7effde7fc700 1 -- 172.21.15.118:0/1149530992 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7effd801aa30 con 0x7effe814fa90 2023-09-28T04:23:19.468 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.464+0000 7effde7fc700 1 --2- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7effcc067330 0x7effcc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:19.468 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.464+0000 7effde7fc700 1 -- 172.21.15.118:0/1149530992 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7effd8086700 con 0x7effe814fa90 2023-09-28T04:23:19.469 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.465+0000 7effee39b700 1 --2- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7effcc067330 0x7effcc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:19.469 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.465+0000 7effee39b700 1 --2- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7effcc067330 0x7effcc0697e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7effe4009ea0 tx=0x7effe40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:19.469 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.469+0000 7effde7fc700 1 -- 172.21.15.118:0/1149530992 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7effd8053560 con 0x7effe814fa90 2023-09-28T04:23:19.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:19.700+0000 7efff05ff700 1 -- 172.21.15.118:0/1149530992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7effe8151af0 con 0x7effe814fa90 2023-09-28T04:23:20.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.381+0000 7effde7fc700 1 -- 172.21.15.118:0/1149530992 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7effd8056b80 con 0x7effe814fa90 2023-09-28T04:23:20.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.384+0000 7efff05ff700 1 -- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7effcc067330 msgr2=0x7effcc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:20.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.384+0000 7efff05ff700 1 --2- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7effcc067330 0x7effcc0697e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7effe4009ea0 tx=0x7effe40091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:20.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.384+0000 7efff05ff700 1 -- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe814fa90 msgr2=0x7effe8069dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:20.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.384+0000 7efff05ff700 1 --2- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe814fa90 0x7effe8069dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7effe8064880 tx=0x7effd8017000 comp rx=0 tx=0).stop 2023-09-28T04:23:20.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.384+0000 7efff05ff700 1 -- 172.21.15.118:0/1149530992 shutdown_connections 2023-09-28T04:23:20.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.384+0000 7efff05ff700 1 --2- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7effcc067330 0x7effcc0697e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:20.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.384+0000 7efff05ff700 1 --2- 172.21.15.118:0/1149530992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe814fe60 0x7effe8151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:20.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.384+0000 7efff05ff700 1 --2- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7effe80c84c0 0x7effe8152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:20.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.384+0000 7efff05ff700 1 --2- 172.21.15.118:0/1149530992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe814fa90 0x7effe8069dc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:20.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.384+0000 7efff05ff700 1 -- 172.21.15.118:0/1149530992 >> 172.21.15.118:0/1149530992 conn(0x7effe8063cd0 msgr2=0x7effe814d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:20.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.384+0000 7efff05ff700 1 -- 172.21.15.118:0/1149530992 shutdown_connections 2023-09-28T04:23:20.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.384+0000 7efff05ff700 1 -- 172.21.15.118:0/1149530992 wait complete. 2023-09-28T04:23:20.403 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300} 2023-09-28T04:23:20.403 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-09-28T04:23:20.595 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.595+0000 7fa94f9ff700 1 Processor -- start 2023-09-28T04:23:20.595 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.595+0000 7fa94f9ff700 1 -- start start 2023-09-28T04:23:20.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.596+0000 7fa94f9ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9480c4ab0 0x7fa948156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:20.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.596+0000 7fa94f9ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9480c73e0 con 0x7fa9480c5e30 2023-09-28T04:23:20.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.596+0000 7fa94f9ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9480c0b60 con 0x7fa9480ca6c0 2023-09-28T04:23:20.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.596+0000 7fa94f9ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9480c67d0 con 0x7fa9480c4ab0 2023-09-28T04:23:20.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.596+0000 7fa94d79b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa9480c5e30 0x7fa9480c9fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46066/0 (socket says 172.21.15.118:46066) 2023-09-28T04:23:20.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.596+0000 7fa94d79b700 1 -- 172.21.15.118:0/3413339261 learned_addr learned my addr 172.21.15.118:0/3413339261 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:20.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.596+0000 7fa94df9c700 1 --2- 172.21.15.118:0/3413339261 >> v2:172.21.15.174:3300/0 conn(0x7fa9480c4ab0 0x7fa948156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:20.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.597+0000 7fa93ffff700 1 -- 172.21.15.118:0/3413339261 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129007593 0 0) 0x7fa9480c73e0 con 0x7fa9480c5e30 2023-09-28T04:23:20.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.597+0000 7fa93ffff700 1 -- 172.21.15.118:0/3413339261 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa934003570 con 0x7fa9480c5e30 2023-09-28T04:23:20.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.597+0000 7fa93ffff700 1 -- 172.21.15.118:0/3413339261 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737187621 0 0) 0x7fa9480c0b60 con 0x7fa9480ca6c0 2023-09-28T04:23:20.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.597+0000 7fa93ffff700 1 -- 172.21.15.118:0/3413339261 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9480c73e0 con 0x7fa9480ca6c0 2023-09-28T04:23:20.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.597+0000 7fa94df9c700 1 -- 172.21.15.118:0/3413339261 >> v1:172.21.15.174:6789/0 conn(0x7fa9480ca6c0 legacy=0x7fa94814f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:20.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.597+0000 7fa94df9c700 1 -- 172.21.15.118:0/3413339261 >> v1:172.21.15.118:6789/0 conn(0x7fa9480c5e30 legacy=0x7fa9480c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:20.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.597+0000 7fa94df9c700 1 -- 172.21.15.118:0/3413339261 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9480c6ab0 con 0x7fa9480c4ab0 2023-09-28T04:23:20.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.597+0000 7fa94df9c700 1 --2- 172.21.15.118:0/3413339261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480c4ab0 0x7fa948156570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa940009e60 tx=0x7fa940009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=484a88b58981b5b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:20.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.597+0000 7fa93ffff700 1 -- 172.21.15.118:0/3413339261 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000e070 con 0x7fa9480c4ab0 2023-09-28T04:23:20.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.597+0000 7fa93ffff700 1 -- 172.21.15.118:0/3413339261 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94000bb40 con 0x7fa9480c4ab0 2023-09-28T04:23:20.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.597+0000 7fa93ffff700 1 -- 172.21.15.118:0/3413339261 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940012430 con 0x7fa9480c4ab0 2023-09-28T04:23:20.601 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.598+0000 7fa94f9ff700 1 -- 172.21.15.118:0/3413339261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480c4ab0 msgr2=0x7fa948156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:20.601 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.598+0000 7fa94f9ff700 1 --2- 172.21.15.118:0/3413339261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480c4ab0 0x7fa948156570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa940009e60 tx=0x7fa940009780 comp rx=0 tx=0).stop 2023-09-28T04:23:20.601 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.598+0000 7fa94f9ff700 1 -- 172.21.15.118:0/3413339261 shutdown_connections 2023-09-28T04:23:20.601 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.598+0000 7fa94f9ff700 1 --2- 172.21.15.118:0/3413339261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480c4ab0 0x7fa948156570 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:20.601 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.598+0000 7fa94f9ff700 1 -- 172.21.15.118:0/3413339261 >> 172.21.15.118:0/3413339261 conn(0x7fa948063230 msgr2=0x7fa948063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:20.601 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.598+0000 7fa94f9ff700 1 -- 172.21.15.118:0/3413339261 shutdown_connections 2023-09-28T04:23:20.601 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.598+0000 7fa94f9ff700 1 -- 172.21.15.118:0/3413339261 wait complete. 2023-09-28T04:23:20.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.600+0000 7fa94f9ff700 1 Processor -- start 2023-09-28T04:23:20.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.600+0000 7fa94f9ff700 1 -- start start 2023-09-28T04:23:20.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.601+0000 7fa94f9ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480c4ab0 0x7fa948151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:20.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.601+0000 7fa94f9ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480c5e30 0x7fa9481517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:20.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.601+0000 7fa94f9ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9480ca6c0 0x7fa948154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:20.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.601+0000 7fa94f9ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9481507a0 con 0x7fa9480ca6c0 2023-09-28T04:23:20.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.601+0000 7fa94f9ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa948150d60 con 0x7fa9480c4ab0 2023-09-28T04:23:20.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.601+0000 7fa94f9ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa948155560 con 0x7fa9480c5e30 2023-09-28T04:23:20.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.602+0000 7fa94df9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9480ca6c0 0x7fa948154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:20.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.602+0000 7fa94d79b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480c4ab0 0x7fa948151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:20.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.602+0000 7fa94df9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9480ca6c0 0x7fa948154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45286/0 (socket says 172.21.15.118:45286) 2023-09-28T04:23:20.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.602+0000 7fa94df9c700 1 -- 172.21.15.118:0/2796874746 learned_addr learned my addr 172.21.15.118:0/2796874746 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:20.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.602+0000 7fa94cf9a700 1 --2- 172.21.15.118:0/2796874746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480c5e30 0x7fa9481517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:20.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.602+0000 7fa94df9c700 1 -- 172.21.15.118:0/2796874746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480c5e30 msgr2=0x7fa9481517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:20.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.602+0000 7fa94df9c700 1 --2- 172.21.15.118:0/2796874746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480c5e30 0x7fa9481517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:20.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.602+0000 7fa94df9c700 1 -- 172.21.15.118:0/2796874746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480c4ab0 msgr2=0x7fa948151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:20.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.602+0000 7fa94df9c700 1 --2- 172.21.15.118:0/2796874746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480c4ab0 0x7fa948151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:20.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.602+0000 7fa94df9c700 1 -- 172.21.15.118:0/2796874746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa940009a20 con 0x7fa9480ca6c0 2023-09-28T04:23:20.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.602+0000 7fa94df9c700 1 --2- 172.21.15.118:0/2796874746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9480ca6c0 0x7fa948154650 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa94000b610 tx=0x7fa940019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:20.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.603+0000 7fa93d7fa700 1 -- 172.21.15.118:0/2796874746 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940026480 con 0x7fa9480ca6c0 2023-09-28T04:23:20.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.603+0000 7fa93d7fa700 1 -- 172.21.15.118:0/2796874746 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa940026600 con 0x7fa9480ca6c0 2023-09-28T04:23:20.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.603+0000 7fa93d7fa700 1 -- 172.21.15.118:0/2796874746 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9400269c0 con 0x7fa9480ca6c0 2023-09-28T04:23:20.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.603+0000 7fa94f9ff700 1 -- 172.21.15.118:0/2796874746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa948155df0 con 0x7fa9480ca6c0 2023-09-28T04:23:20.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.603+0000 7fa94f9ff700 1 -- 172.21.15.118:0/2796874746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9481579b0 con 0x7fa9480ca6c0 2023-09-28T04:23:20.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.604+0000 7fa94f9ff700 1 -- 172.21.15.118:0/2796874746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9481544a0 con 0x7fa9480ca6c0 2023-09-28T04:23:20.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.605+0000 7fa93d7fa700 1 -- 172.21.15.118:0/2796874746 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa94001c400 con 0x7fa9480ca6c0 2023-09-28T04:23:20.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.606+0000 7fa93d7fa700 1 --2- 172.21.15.118:0/2796874746 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fa92c067400 0x7fa92c0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:20.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.606+0000 7fa93d7fa700 1 -- 172.21.15.118:0/2796874746 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa940086ea0 con 0x7fa9480ca6c0 2023-09-28T04:23:20.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.606+0000 7fa94d79b700 1 --2- 172.21.15.118:0/2796874746 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fa92c067400 0x7fa92c0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:20.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.607+0000 7fa94d79b700 1 --2- 172.21.15.118:0/2796874746 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fa92c067400 0x7fa92c0698b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa944001360 tx=0x7fa944009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:20.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.610+0000 7fa93d7fa700 1 -- 172.21.15.118:0/2796874746 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa940053d80 con 0x7fa9480ca6c0 2023-09-28T04:23:20.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:20.844+0000 7fa94f9ff700 1 -- 172.21.15.118:0/2796874746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fa9480713a0 con 0x7fa9480ca6c0 2023-09-28T04:23:21.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.385+0000 7fa93d7fa700 1 -- 172.21.15.118:0/2796874746 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fa94001ae60 con 0x7fa9480ca6c0 2023-09-28T04:23:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.388+0000 7fa94f9ff700 1 -- 172.21.15.118:0/2796874746 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fa92c067400 msgr2=0x7fa92c0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.388+0000 7fa94f9ff700 1 --2- 172.21.15.118:0/2796874746 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fa92c067400 0x7fa92c0698b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa944001360 tx=0x7fa944009040 comp rx=0 tx=0).stop 2023-09-28T04:23:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.388+0000 7fa94f9ff700 1 -- 172.21.15.118:0/2796874746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9480ca6c0 msgr2=0x7fa948154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:21.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.388+0000 7fa94f9ff700 1 --2- 172.21.15.118:0/2796874746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9480ca6c0 0x7fa948154650 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa94000b610 tx=0x7fa940019000 comp rx=0 tx=0).stop 2023-09-28T04:23:21.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.388+0000 7fa94f9ff700 1 -- 172.21.15.118:0/2796874746 shutdown_connections 2023-09-28T04:23:21.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.388+0000 7fa94f9ff700 1 --2- 172.21.15.118:0/2796874746 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fa92c067400 0x7fa92c0698b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:21.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.388+0000 7fa94f9ff700 1 --2- 172.21.15.118:0/2796874746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9480ca6c0 0x7fa948154650 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:21.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.388+0000 7fa94f9ff700 1 --2- 172.21.15.118:0/2796874746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9480c4ab0 0x7fa948151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:21.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.388+0000 7fa94f9ff700 1 --2- 172.21.15.118:0/2796874746 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9480c5e30 0x7fa9481517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:21.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.388+0000 7fa94f9ff700 1 -- 172.21.15.118:0/2796874746 >> 172.21.15.118:0/2796874746 conn(0x7fa948063230 msgr2=0x7fa948063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:21.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.388+0000 7fa94f9ff700 1 -- 172.21.15.118:0/2796874746 shutdown_connections 2023-09-28T04:23:21.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.388+0000 7fa94f9ff700 1 -- 172.21.15.118:0/2796874746 wait complete. 2023-09-28T04:23:21.407 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-28T04:23:21.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.599+0000 7f3a8cdff700 1 Processor -- start 2023-09-28T04:23:21.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.599+0000 7f3a8cdff700 1 -- start start 2023-09-28T04:23:21.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.600+0000 7f3a8cdff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a880adf10 0x7f3a881562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:21.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.600+0000 7f3a8cdff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3a88089830 0x7f3a8814f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:21.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.600+0000 7f3a8cdff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a880c7980 con 0x7f3a880ae2e0 2023-09-28T04:23:21.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.600+0000 7f3a8cdff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a880cce60 con 0x7f3a88089830 2023-09-28T04:23:21.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.600+0000 7f3a8cdff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880c75e0 con 0x7f3a880adf10 2023-09-28T04:23:21.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.601+0000 7f3a85d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3a88089830 0x7f3a8814f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:21.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.601+0000 7f3a85d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3a88089830 0x7f3a8814f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45290/0 (socket says 172.21.15.118:45290) 2023-09-28T04:23:21.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.601+0000 7f3a85d9b700 1 -- 172.21.15.118:0/850102197 learned_addr learned my addr 172.21.15.118:0/850102197 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:21.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.601+0000 7f3a8659c700 1 --2- 172.21.15.118:0/850102197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a880adf10 0x7f3a881562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:21.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.601+0000 7f3a85d9b700 1 -- 172.21.15.118:0/850102197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a880adf10 msgr2=0x7f3a881562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:21.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.601+0000 7f3a85d9b700 1 --2- 172.21.15.118:0/850102197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a880adf10 0x7f3a881562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:21.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.601+0000 7f3a85d9b700 1 -- 172.21.15.118:0/850102197 >> v1:172.21.15.174:6789/0 conn(0x7f3a880ae2e0 legacy=0x7f3a880c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:21.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.601+0000 7f3a85d9b700 1 -- 172.21.15.118:0/850102197 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a880ccbc0 con 0x7f3a88089830 2023-09-28T04:23:21.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.601+0000 7f3a8559a700 1 -- 172.21.15.118:0/850102197 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233425603 0 0) 0x7f3a880c7980 con 0x7f3a880ae2e0 2023-09-28T04:23:21.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.601+0000 7f3a85d9b700 1 --2- 172.21.15.118:0/850102197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a88089830 0x7f3a8814f2e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0099b0 tx=0x7f3a7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d022979bddcbdb server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:21.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.602+0000 7f3a8559a700 1 -- 172.21.15.118:0/850102197 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c009ea0 con 0x7f3a88089830 2023-09-28T04:23:21.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.602+0000 7f3a8559a700 1 -- 172.21.15.118:0/850102197 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c00b860 con 0x7f3a88089830 2023-09-28T04:23:21.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.602+0000 7f3a8559a700 1 -- 172.21.15.118:0/850102197 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00bc00 con 0x7f3a88089830 2023-09-28T04:23:21.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.602+0000 7f3a8cdff700 1 -- 172.21.15.118:0/850102197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a88089830 msgr2=0x7f3a8814f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:21.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.602+0000 7f3a8cdff700 1 --2- 172.21.15.118:0/850102197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a88089830 0x7f3a8814f2e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0099b0 tx=0x7f3a7c009250 comp rx=0 tx=0).stop 2023-09-28T04:23:21.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.602+0000 7f3a8cdff700 1 -- 172.21.15.118:0/850102197 shutdown_connections 2023-09-28T04:23:21.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.602+0000 7f3a8cdff700 1 --2- 172.21.15.118:0/850102197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a880adf10 0x7f3a881562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:21.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.602+0000 7f3a8cdff700 1 --2- 172.21.15.118:0/850102197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a88089830 0x7f3a8814f2e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:21.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.602+0000 7f3a8cdff700 1 -- 172.21.15.118:0/850102197 >> 172.21.15.118:0/850102197 conn(0x7f3a88063cc0 msgr2=0x7f3a880cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:21.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.602+0000 7f3a8cdff700 1 -- 172.21.15.118:0/850102197 shutdown_connections 2023-09-28T04:23:21.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.602+0000 7f3a8cdff700 1 -- 172.21.15.118:0/850102197 wait complete. 2023-09-28T04:23:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.604+0000 7f3a8cdff700 1 Processor -- start 2023-09-28T04:23:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.605+0000 7f3a8cdff700 1 -- start start 2023-09-28T04:23:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a8cdff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a88089830 0x7f3a88151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a8cdff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a880adf10 0x7f3a8815b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a8cdff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a880ae2e0 0x7f3a881500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a8cdff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8814ad20 con 0x7f3a880ae2e0 2023-09-28T04:23:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a8cdff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a88152bb0 con 0x7f3a88089830 2023-09-28T04:23:21.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a8cdff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a88152e50 con 0x7f3a880adf10 2023-09-28T04:23:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a86d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a880ae2e0 0x7f3a881500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a8659c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a88089830 0x7f3a88151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a85d9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a880adf10 0x7f3a8815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a8659c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a88089830 0x7f3a88151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42154/0 (socket says 172.21.15.118:42154) 2023-09-28T04:23:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a86d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a880ae2e0 0x7f3a881500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45302/0 (socket says 172.21.15.118:45302) 2023-09-28T04:23:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a8659c700 1 -- 172.21.15.118:0/2036182093 learned_addr learned my addr 172.21.15.118:0/2036182093 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a86d9d700 1 -- 172.21.15.118:0/2036182093 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a880adf10 msgr2=0x7f3a8815b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a86d9d700 1 --2- 172.21.15.118:0/2036182093 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a880adf10 0x7f3a8815b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a86d9d700 1 -- 172.21.15.118:0/2036182093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a88089830 msgr2=0x7f3a88151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:21.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a86d9d700 1 --2- 172.21.15.118:0/2036182093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a88089830 0x7f3a88151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:21.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a86d9d700 1 -- 172.21.15.118:0/2036182093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c0094f0 con 0x7f3a880ae2e0 2023-09-28T04:23:21.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.606+0000 7f3a8659c700 1 --2- 172.21.15.118:0/2036182093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a88089830 0x7f3a88151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:21.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.607+0000 7f3a86d9d700 1 --2- 172.21.15.118:0/2036182093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a880ae2e0 0x7f3a881500f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a80001560 tx=0x7f3a800016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:21.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.607+0000 7f3a767fc700 1 -- 172.21.15.118:0/2036182093 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80012630 con 0x7f3a880ae2e0 2023-09-28T04:23:21.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.607+0000 7f3a767fc700 1 -- 172.21.15.118:0/2036182093 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a80012790 con 0x7f3a880ae2e0 2023-09-28T04:23:21.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.607+0000 7f3a8cdff700 1 -- 172.21.15.118:0/2036182093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a88153110 con 0x7f3a880ae2e0 2023-09-28T04:23:21.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.607+0000 7f3a767fc700 1 -- 172.21.15.118:0/2036182093 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80012b50 con 0x7f3a880ae2e0 2023-09-28T04:23:21.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.607+0000 7f3a8cdff700 1 -- 172.21.15.118:0/2036182093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a880c4f80 con 0x7f3a880ae2e0 2023-09-28T04:23:21.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.608+0000 7f3a8cdff700 1 -- 172.21.15.118:0/2036182093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a880c54a0 con 0x7f3a880ae2e0 2023-09-28T04:23:21.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.609+0000 7f3a767fc700 1 -- 172.21.15.118:0/2036182093 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3a80003030 con 0x7f3a880ae2e0 2023-09-28T04:23:21.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.610+0000 7f3a767fc700 1 --2- 172.21.15.118:0/2036182093 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3a68067330 0x7f3a680697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:21.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.610+0000 7f3a767fc700 1 -- 172.21.15.118:0/2036182093 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3a80084a00 con 0x7f3a880ae2e0 2023-09-28T04:23:21.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.610+0000 7f3a8659c700 1 --2- 172.21.15.118:0/2036182093 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3a68067330 0x7f3a680697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:21.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.611+0000 7f3a8659c700 1 --2- 172.21.15.118:0/2036182093 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3a68067330 0x7f3a680697e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009fd0 tx=0x7f3a780091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:21.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.614+0000 7f3a767fc700 1 -- 172.21.15.118:0/2036182093 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3a880c54a0 con 0x7f3a880ae2e0 2023-09-28T04:23:21.694 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T04:23:21.702 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T04:23:21.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:21.863+0000 7f3a8cdff700 1 -- 172.21.15.118:0/2036182093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3a880c54a0 con 0x7f3a880ae2e0 2023-09-28T04:23:22.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.386+0000 7f3a767fc700 1 -- 172.21.15.118:0/2036182093 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3a880c54a0 con 0x7f3a880ae2e0 2023-09-28T04:23:22.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.389+0000 7f3a8cdff700 1 -- 172.21.15.118:0/2036182093 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3a68067330 msgr2=0x7f3a680697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:22.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.389+0000 7f3a8cdff700 1 --2- 172.21.15.118:0/2036182093 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3a68067330 0x7f3a680697e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009fd0 tx=0x7f3a780091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:22.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.389+0000 7f3a8cdff700 1 -- 172.21.15.118:0/2036182093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a880ae2e0 msgr2=0x7f3a881500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:22.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.389+0000 7f3a8cdff700 1 --2- 172.21.15.118:0/2036182093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a880ae2e0 0x7f3a881500f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a80001560 tx=0x7f3a800016c0 comp rx=0 tx=0).stop 2023-09-28T04:23:22.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.389+0000 7f3a8cdff700 1 -- 172.21.15.118:0/2036182093 shutdown_connections 2023-09-28T04:23:22.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.389+0000 7f3a8cdff700 1 --2- 172.21.15.118:0/2036182093 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3a68067330 0x7f3a680697e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:22.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.389+0000 7f3a8cdff700 1 --2- 172.21.15.118:0/2036182093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a880ae2e0 0x7f3a881500f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:22.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.389+0000 7f3a8cdff700 1 --2- 172.21.15.118:0/2036182093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a88089830 0x7f3a88151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:22.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.389+0000 7f3a8cdff700 1 --2- 172.21.15.118:0/2036182093 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a880adf10 0x7f3a8815b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:22.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.389+0000 7f3a8cdff700 1 -- 172.21.15.118:0/2036182093 >> 172.21.15.118:0/2036182093 conn(0x7f3a88063cc0 msgr2=0x7f3a8814c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:22.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.389+0000 7f3a8cdff700 1 -- 172.21.15.118:0/2036182093 shutdown_connections 2023-09-28T04:23:22.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.389+0000 7f3a8cdff700 1 -- 172.21.15.118:0/2036182093 wait complete. 2023-09-28T04:23:22.408 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-09-28T04:23:22.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.599+0000 7f79a8dff700 1 Processor -- start 2023-09-28T04:23:22.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.599+0000 7f79a8dff700 1 -- start start 2023-09-28T04:23:22.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.600+0000 7f79a8dff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f79a40ca6c0 0x7f79a4156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:22.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.600+0000 7f79a8dff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f79a40c4ab0 0x7f79a414f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:22.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.600+0000 7f79a8dff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a40c73e0 con 0x7f79a40c5e30 2023-09-28T04:23:22.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.600+0000 7f79a8dff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a40c0b60 con 0x7f79a40c4ab0 2023-09-28T04:23:22.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.600+0000 7f79a8dff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a40c67d0 con 0x7f79a40ca6c0 2023-09-28T04:23:22.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.601+0000 7f79a2d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f79a40c4ab0 0x7f79a414f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:22.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.601+0000 7f79a259c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f79a40c5e30 0x7f79a40c9fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46068/0 (socket says 172.21.15.118:46068) 2023-09-28T04:23:22.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.601+0000 7f79a2d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f79a40c4ab0 0x7f79a414f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45306/0 (socket says 172.21.15.118:45306) 2023-09-28T04:23:22.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.601+0000 7f79a259c700 1 -- 172.21.15.118:0/3896126361 learned_addr learned my addr 172.21.15.118:0/3896126361 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:22.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.601+0000 7f79a1d9b700 1 --2- 172.21.15.118:0/3896126361 >> v2:172.21.15.174:3300/0 conn(0x7f79a40ca6c0 0x7f79a4156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:22.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.601+0000 7f79a2d9d700 1 -- 172.21.15.118:0/3896126361 >> v2:172.21.15.174:3300/0 conn(0x7f79a40ca6c0 msgr2=0x7f79a4156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:22.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.601+0000 7f79a2d9d700 1 --2- 172.21.15.118:0/3896126361 >> v2:172.21.15.174:3300/0 conn(0x7f79a40ca6c0 0x7f79a4156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:22.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.601+0000 7f79a2d9d700 1 -- 172.21.15.118:0/3896126361 >> v1:172.21.15.118:6789/0 conn(0x7f79a40c5e30 legacy=0x7f79a40c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:22.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.601+0000 7f79a2d9d700 1 -- 172.21.15.118:0/3896126361 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a40c6ab0 con 0x7f79a40c4ab0 2023-09-28T04:23:22.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.601+0000 7f79a159a700 1 -- 172.21.15.118:0/3896126361 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108485668 0 0) 0x7f79a40c73e0 con 0x7f79a40c5e30 2023-09-28T04:23:22.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.601+0000 7f79a2d9d700 1 --2- 172.21.15.118:0/3896126361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40c4ab0 0x7f79a414f440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f79a406f420 tx=0x7f799c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4588fd4d34c562 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:22.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.602+0000 7f79a159a700 1 -- 172.21.15.118:0/3896126361 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c00e070 con 0x7f79a40c4ab0 2023-09-28T04:23:22.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.602+0000 7f79a159a700 1 -- 172.21.15.118:0/3896126361 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c00bbf0 con 0x7f79a40c4ab0 2023-09-28T04:23:22.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.602+0000 7f79a159a700 1 -- 172.21.15.118:0/3896126361 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c012430 con 0x7f79a40c4ab0 2023-09-28T04:23:22.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.602+0000 7f79a8dff700 1 -- 172.21.15.118:0/3896126361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40c4ab0 msgr2=0x7f79a414f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:22.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.602+0000 7f79a8dff700 1 --2- 172.21.15.118:0/3896126361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40c4ab0 0x7f79a414f440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f79a406f420 tx=0x7f799c009780 comp rx=0 tx=0).stop 2023-09-28T04:23:22.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.602+0000 7f79a8dff700 1 -- 172.21.15.118:0/3896126361 shutdown_connections 2023-09-28T04:23:22.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.602+0000 7f79a8dff700 1 --2- 172.21.15.118:0/3896126361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40c4ab0 0x7f79a414f440 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:22.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.602+0000 7f79a8dff700 1 --2- 172.21.15.118:0/3896126361 >> v2:172.21.15.174:3300/0 conn(0x7f79a40ca6c0 0x7f79a4156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:22.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.602+0000 7f79a8dff700 1 -- 172.21.15.118:0/3896126361 >> 172.21.15.118:0/3896126361 conn(0x7f79a4063230 msgr2=0x7f79a4063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:22.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.602+0000 7f79a8dff700 1 -- 172.21.15.118:0/3896126361 shutdown_connections 2023-09-28T04:23:22.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.602+0000 7f79a8dff700 1 -- 172.21.15.118:0/3896126361 wait complete. 2023-09-28T04:23:22.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.604+0000 7f79a8dff700 1 Processor -- start 2023-09-28T04:23:22.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.604+0000 7f79a8dff700 1 -- start start 2023-09-28T04:23:22.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.604+0000 7f79a8dff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79a40c4ab0 0x7f79a4166160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:22.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a8dff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79a40c5e30 0x7f79a4168c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:22.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a8dff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40ca6c0 0x7f79a40c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:22.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a8dff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a4159610 con 0x7f79a40ca6c0 2023-09-28T04:23:22.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a8dff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a4149770 con 0x7f79a40c4ab0 2023-09-28T04:23:22.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a8dff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a4168260 con 0x7f79a40c5e30 2023-09-28T04:23:22.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a2d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40ca6c0 0x7f79a40c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:22.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a2d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40ca6c0 0x7f79a40c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45318/0 (socket says 172.21.15.118:45318) 2023-09-28T04:23:22.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a2d9d700 1 -- 172.21.15.118:0/534086652 learned_addr learned my addr 172.21.15.118:0/534086652 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:22.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a259c700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79a40c4ab0 0x7f79a4166160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:22.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a1d9b700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79a40c5e30 0x7f79a4168c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:22.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a2d9d700 1 -- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79a40c5e30 msgr2=0x7f79a4168c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:22.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a2d9d700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79a40c5e30 0x7f79a4168c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:22.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a2d9d700 1 -- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79a40c4ab0 msgr2=0x7f79a4166160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:22.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a2d9d700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79a40c4ab0 0x7f79a4166160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:22.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a2d9d700 1 -- 172.21.15.118:0/534086652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c009a20 con 0x7f79a40ca6c0 2023-09-28T04:23:22.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.605+0000 7f79a2d9d700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40ca6c0 0x7f79a40c8c10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f799c009fd0 tx=0x7f799c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:22.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.606+0000 7f79927fc700 1 -- 172.21.15.118:0/534086652 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c027470 con 0x7f79a40ca6c0 2023-09-28T04:23:22.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.606+0000 7f79927fc700 1 -- 172.21.15.118:0/534086652 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c0275d0 con 0x7f79a40ca6c0 2023-09-28T04:23:22.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.606+0000 7f79a8dff700 1 -- 172.21.15.118:0/534086652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a41687e0 con 0x7f79a40ca6c0 2023-09-28T04:23:22.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.606+0000 7f79927fc700 1 -- 172.21.15.118:0/534086652 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c027990 con 0x7f79a40ca6c0 2023-09-28T04:23:22.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.606+0000 7f79a8dff700 1 -- 172.21.15.118:0/534086652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a40c9650 con 0x7f79a40ca6c0 2023-09-28T04:23:22.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.607+0000 7f79a8dff700 1 -- 172.21.15.118:0/534086652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a40713a0 con 0x7f79a40ca6c0 2023-09-28T04:23:22.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.608+0000 7f79927fc700 1 -- 172.21.15.118:0/534086652 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f799c024070 con 0x7f79a40ca6c0 2023-09-28T04:23:22.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.609+0000 7f79927fc700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7984067360 0x7f7984069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:22.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.610+0000 7f79927fc700 1 -- 172.21.15.118:0/534086652 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f799c086dc0 con 0x7f79a40ca6c0 2023-09-28T04:23:22.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.610+0000 7f79a259c700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7984067360 0x7f7984069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:22.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.610+0000 7f79a259c700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7984067360 0x7f7984069810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7994001360 tx=0x7f7994009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:22.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.614+0000 7f79927fc700 1 -- 172.21.15.118:0/534086652 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f799c0576b0 con 0x7f79a40ca6c0 2023-09-28T04:23:22.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:22.847+0000 7f79a8dff700 1 -- 172.21.15.118:0/534086652 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f79a4168970 con 0x7f79a40ca6c0 2023-09-28T04:23:23.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.397+0000 7f79927fc700 1 -- 172.21.15.118:0/534086652 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) v1 ==== 115+0+0 (secure 0 0 0) 0x7f799c009880 con 0x7f79a40ca6c0 2023-09-28T04:23:23.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.400+0000 7f79a8dff700 1 -- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7984067360 msgr2=0x7f7984069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:23.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.400+0000 7f79a8dff700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7984067360 0x7f7984069810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7994001360 tx=0x7f7994009040 comp rx=0 tx=0).stop 2023-09-28T04:23:23.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.400+0000 7f79a8dff700 1 -- 172.21.15.118:0/534086652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40ca6c0 msgr2=0x7f79a40c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:23.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.401+0000 7f79a8dff700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40ca6c0 0x7f79a40c8c10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f799c009fd0 tx=0x7f799c019000 comp rx=0 tx=0).stop 2023-09-28T04:23:23.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.401+0000 7f79a8dff700 1 -- 172.21.15.118:0/534086652 shutdown_connections 2023-09-28T04:23:23.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.401+0000 7f79a8dff700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7984067360 0x7f7984069810 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.401+0000 7f79a8dff700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40ca6c0 0x7f79a40c8c10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.401+0000 7f79a8dff700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79a40c4ab0 0x7f79a4166160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.401+0000 7f79a8dff700 1 --2- 172.21.15.118:0/534086652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79a40c5e30 0x7f79a4168c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.401+0000 7f79a8dff700 1 -- 172.21.15.118:0/534086652 >> 172.21.15.118:0/534086652 conn(0x7f79a4063230 msgr2=0x7f79a40c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:23.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.401+0000 7f79a8dff700 1 -- 172.21.15.118:0/534086652 shutdown_connections 2023-09-28T04:23:23.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.401+0000 7f79a8dff700 1 -- 172.21.15.118:0/534086652 wait complete. 2023-09-28T04:23:23.419 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-28T04:23:23.419 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T04:23:23.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.608+0000 7f86c2fff700 1 Processor -- start 2023-09-28T04:23:23.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.608+0000 7f86c2fff700 1 -- start start 2023-09-28T04:23:23.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.609+0000 7f86c2fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86bc0adf10 0x7f86bc1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:23.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.609+0000 7f86c2fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f86bc14f9f0 0x7f86bc0c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:23.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.609+0000 7f86c2fff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86bc0c7980 con 0x7f86bc089830 2023-09-28T04:23:23.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.609+0000 7f86c2fff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86bc0cce60 con 0x7f86bc14f9f0 2023-09-28T04:23:23.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.609+0000 7f86c2fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc0c75e0 con 0x7f86bc0adf10 2023-09-28T04:23:23.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.609+0000 7f86c0d9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86bc0adf10 0x7f86bc1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:23.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.609+0000 7f86c159c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f86bc14f9f0 0x7f86bc0c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:23.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.609+0000 7f86bbfff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f86bc089830 0x7f86bc14f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46246/0 (socket says 172.21.15.118:46246) 2023-09-28T04:23:23.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.609+0000 7f86bbfff700 1 -- 172.21.15.118:0/2608552169 learned_addr learned my addr 172.21.15.118:0/2608552169 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:23.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.610+0000 7f86c159c700 1 -- 172.21.15.118:0/2608552169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86bc0adf10 msgr2=0x7f86bc1562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:23.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.610+0000 7f86c159c700 1 --2- 172.21.15.118:0/2608552169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86bc0adf10 0x7f86bc1562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.610+0000 7f86c159c700 1 -- 172.21.15.118:0/2608552169 >> v1:172.21.15.174:6789/0 conn(0x7f86bc089830 legacy=0x7f86bc14f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:23.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.610+0000 7f86c159c700 1 -- 172.21.15.118:0/2608552169 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc0ccbc0 con 0x7f86bc14f9f0 2023-09-28T04:23:23.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.610+0000 7f86c0d9b700 1 --2- 172.21.15.118:0/2608552169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86bc0adf10 0x7f86bc1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:23.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.610+0000 7f86bb7fe700 1 -- 172.21.15.118:0/2608552169 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679021515 0 0) 0x7f86bc0c7980 con 0x7f86bc089830 2023-09-28T04:23:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.610+0000 7f86c159c700 1 --2- 172.21.15.118:0/2608552169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc14f9f0 0x7f86bc0c7e10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009e90 tx=0x7f86b4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bed94d725d9b848 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.610+0000 7f86bb7fe700 1 -- 172.21.15.118:0/2608552169 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b400e070 con 0x7f86bc14f9f0 2023-09-28T04:23:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.610+0000 7f86bb7fe700 1 -- 172.21.15.118:0/2608552169 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b400bbf0 con 0x7f86bc14f9f0 2023-09-28T04:23:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.610+0000 7f86bb7fe700 1 -- 172.21.15.118:0/2608552169 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4012430 con 0x7f86bc14f9f0 2023-09-28T04:23:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.611+0000 7f86c2fff700 1 -- 172.21.15.118:0/2608552169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc14f9f0 msgr2=0x7f86bc0c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.611+0000 7f86c2fff700 1 --2- 172.21.15.118:0/2608552169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc14f9f0 0x7f86bc0c7e10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009e90 tx=0x7f86b4009780 comp rx=0 tx=0).stop 2023-09-28T04:23:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.611+0000 7f86c2fff700 1 -- 172.21.15.118:0/2608552169 shutdown_connections 2023-09-28T04:23:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.611+0000 7f86c2fff700 1 --2- 172.21.15.118:0/2608552169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc14f9f0 0x7f86bc0c7e10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.611+0000 7f86c2fff700 1 --2- 172.21.15.118:0/2608552169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86bc0adf10 0x7f86bc1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.611+0000 7f86c2fff700 1 -- 172.21.15.118:0/2608552169 >> 172.21.15.118:0/2608552169 conn(0x7f86bc063cc0 msgr2=0x7f86bc0cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:23.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.611+0000 7f86c2fff700 1 -- 172.21.15.118:0/2608552169 shutdown_connections 2023-09-28T04:23:23.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.611+0000 7f86c2fff700 1 -- 172.21.15.118:0/2608552169 wait complete. 2023-09-28T04:23:23.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.612+0000 7f86c2fff700 1 Processor -- start 2023-09-28T04:23:23.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.612+0000 7f86c2fff700 1 -- start start 2023-09-28T04:23:23.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.613+0000 7f86c2fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86bc089830 0x7f86bc14c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:23.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.613+0000 7f86c2fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86bc0adf10 0x7f86bc165d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:23.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.613+0000 7f86c2fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc14f9f0 0x7f86bc168bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:23.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.613+0000 7f86c2fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc165640 con 0x7f86bc089830 2023-09-28T04:23:23.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.613+0000 7f86c2fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc1658e0 con 0x7f86bc14f9f0 2023-09-28T04:23:23.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.613+0000 7f86c2fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc157be0 con 0x7f86bc0adf10 2023-09-28T04:23:23.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.614+0000 7f86c0d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86bc089830 0x7f86bc14c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:23.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.614+0000 7f86bbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86bc0adf10 0x7f86bc165d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:23.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.614+0000 7f86bbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86bc0adf10 0x7f86bc165d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:58986/0 (socket says 172.21.15.118:58986) 2023-09-28T04:23:23.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.614+0000 7f86c0d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86bc089830 0x7f86bc14c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45334/0 (socket says 172.21.15.118:45334) 2023-09-28T04:23:23.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.614+0000 7f86bbfff700 1 -- 172.21.15.118:0/1210632204 learned_addr learned my addr 172.21.15.118:0/1210632204 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:23.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.614+0000 7f86c159c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc14f9f0 0x7f86bc168bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:23.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.614+0000 7f86bbfff700 1 -- 172.21.15.118:0/1210632204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc14f9f0 msgr2=0x7f86bc168bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:23.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.614+0000 7f86bbfff700 1 --2- 172.21.15.118:0/1210632204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc14f9f0 0x7f86bc168bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.614+0000 7f86bbfff700 1 -- 172.21.15.118:0/1210632204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86bc089830 msgr2=0x7f86bc14c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:23.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.614+0000 7f86bbfff700 1 --2- 172.21.15.118:0/1210632204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86bc089830 0x7f86bc14c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.614+0000 7f86bbfff700 1 -- 172.21.15.118:0/1210632204 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b0009420 con 0x7f86bc0adf10 2023-09-28T04:23:23.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.614+0000 7f86bbfff700 1 --2- 172.21.15.118:0/1210632204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86bc0adf10 0x7f86bc165d70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86a800c5b0 tx=0x7f86a8001070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:23.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.615+0000 7f86b8ff9700 1 -- 172.21.15.118:0/1210632204 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8005c00 con 0x7f86bc0adf10 2023-09-28T04:23:23.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.615+0000 7f86b8ff9700 1 -- 172.21.15.118:0/1210632204 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a8005d60 con 0x7f86bc0adf10 2023-09-28T04:23:23.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.615+0000 7f86b8ff9700 1 -- 172.21.15.118:0/1210632204 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8007300 con 0x7f86bc0adf10 2023-09-28T04:23:23.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.615+0000 7f86c2fff700 1 -- 172.21.15.118:0/1210632204 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b4009a20 con 0x7f86bc0adf10 2023-09-28T04:23:23.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.615+0000 7f86c2fff700 1 -- 172.21.15.118:0/1210632204 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86bc0c32e0 con 0x7f86bc0adf10 2023-09-28T04:23:23.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.616+0000 7f86c2fff700 1 -- 172.21.15.118:0/1210632204 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86bc165a90 con 0x7f86bc0adf10 2023-09-28T04:23:23.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.617+0000 7f86b8ff9700 1 -- 172.21.15.118:0/1210632204 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f86a80076b0 con 0x7f86bc0adf10 2023-09-28T04:23:23.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.617+0000 7f86b8ff9700 1 --2- 172.21.15.118:0/1210632204 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f86a0067360 0x7f86a0069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:23.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.618+0000 7f86b8ff9700 1 -- 172.21.15.118:0/1210632204 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f86a8084140 con 0x7f86bc0adf10 2023-09-28T04:23:23.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.618+0000 7f86c0d9b700 1 --2- 172.21.15.118:0/1210632204 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f86a0067360 0x7f86a0069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:23.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.618+0000 7f86c0d9b700 1 --2- 172.21.15.118:0/1210632204 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f86a0067360 0x7f86a0069810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009f40 tx=0x7f86b00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:23.622 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.622+0000 7f86b8ff9700 1 -- 172.21.15.118:0/1210632204 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f86bc165a90 con 0x7f86bc0adf10 2023-09-28T04:23:23.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.856+0000 7f86c2fff700 1 -- 172.21.15.118:0/1210632204 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86bc165a90 con 0x7f86bc0adf10 2023-09-28T04:23:23.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.860+0000 7f86b8ff9700 1 -- 172.21.15.118:0/1210632204 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6132 (secure 0 0 0) 0x7f86bc165a90 con 0x7f86bc0adf10 2023-09-28T04:23:23.860 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:23.860 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3635601230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3635601230},{"type":"v1","addr":"172.21.15.174:6837","nonce":3635601230}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2662305504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2662305504},{"type":"v1","addr":"172.21.15.174:6839","nonce":2662305504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/524044984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":524044984},{"type":"v1","addr":"172.21.15.118:6833","nonce":524044984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/1739320088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1739320088},{"type":"v1","addr":"172.21.15.174:6836","nonce":1739320088}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T04:23:18.370081+0000","modified":"2023-09-28T04:23:23.398630+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4303,"mds_1":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.118:6835/2977056141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2977056141},{"type":"v1","addr":"172.21.15.118:6835","nonce":2977056141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4303":{"gid":4303,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6837/233759601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":233759601},{"type":"v1","addr":"172.21.15.118:6837","nonce":233759601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T04:23:23.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.862+0000 7f86c2fff700 1 -- 172.21.15.118:0/1210632204 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f86a0067360 msgr2=0x7f86a0069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:23.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.862+0000 7f86c2fff700 1 --2- 172.21.15.118:0/1210632204 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f86a0067360 0x7f86a0069810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009f40 tx=0x7f86b00091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.862+0000 7f86c2fff700 1 -- 172.21.15.118:0/1210632204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86bc0adf10 msgr2=0x7f86bc165d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:23.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.862+0000 7f86c2fff700 1 --2- 172.21.15.118:0/1210632204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86bc0adf10 0x7f86bc165d70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86a800c5b0 tx=0x7f86a8001070 comp rx=0 tx=0).stop 2023-09-28T04:23:23.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.862+0000 7f86c2fff700 1 -- 172.21.15.118:0/1210632204 shutdown_connections 2023-09-28T04:23:23.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.862+0000 7f86c2fff700 1 --2- 172.21.15.118:0/1210632204 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f86a0067360 0x7f86a0069810 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.862+0000 7f86c2fff700 1 --2- 172.21.15.118:0/1210632204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc14f9f0 0x7f86bc168bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.862+0000 7f86c2fff700 1 --2- 172.21.15.118:0/1210632204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86bc089830 0x7f86bc14c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.862+0000 7f86c2fff700 1 --2- 172.21.15.118:0/1210632204 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86bc0adf10 0x7f86bc165d70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:23.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.862+0000 7f86c2fff700 1 -- 172.21.15.118:0/1210632204 >> 172.21.15.118:0/1210632204 conn(0x7f86bc063cc0 msgr2=0x7f86bc0cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:23.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.862+0000 7f86c2fff700 1 -- 172.21.15.118:0/1210632204 shutdown_connections 2023-09-28T04:23:23.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:23.862+0000 7f86c2fff700 1 -- 172.21.15.118:0/1210632204 wait complete. 2023-09-28T04:23:23.864 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 9 2023-09-28T04:23:23.880 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.068+0000 7f14957ff700 1 Processor -- start 2023-09-28T04:23:24.069 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.068+0000 7f14957ff700 1 -- start start 2023-09-28T04:23:24.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.069+0000 7f14957ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14900adf10 0x7f14901562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.069+0000 7f14957ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14900c7980 con 0x7f1490089830 2023-09-28T04:23:24.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.069+0000 7f14957ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14900ccbc0 con 0x7f149014f9f0 2023-09-28T04:23:24.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.069+0000 7f14957ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14900cce60 con 0x7f14900adf10 2023-09-28T04:23:24.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.070+0000 7f148e7fc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1490089830 0x7f149014f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46070/0 (socket says 172.21.15.118:46070) 2023-09-28T04:23:24.071 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.070+0000 7f148e7fc700 1 -- 172.21.15.118:0/3412475092 learned_addr learned my addr 172.21.15.118:0/3412475092 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:24.071 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.070+0000 7f148effd700 1 --2- 172.21.15.118:0/3412475092 >> v2:172.21.15.174:3300/0 conn(0x7f14900adf10 0x7f14901562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.070+0000 7f148dffb700 1 -- 172.21.15.118:0/3412475092 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94067866 0 0) 0x7f14900c7980 con 0x7f1490089830 2023-09-28T04:23:24.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.070+0000 7f148dffb700 1 -- 172.21.15.118:0/3412475092 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1478003570 con 0x7f1490089830 2023-09-28T04:23:24.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.070+0000 7f148dffb700 1 -- 172.21.15.118:0/3412475092 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418759045 0 0) 0x7f14900ccbc0 con 0x7f149014f9f0 2023-09-28T04:23:24.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.070+0000 7f148dffb700 1 -- 172.21.15.118:0/3412475092 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14900c7980 con 0x7f149014f9f0 2023-09-28T04:23:24.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.070+0000 7f148effd700 1 -- 172.21.15.118:0/3412475092 >> v1:172.21.15.174:6789/0 conn(0x7f149014f9f0 legacy=0x7f14900c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.070+0000 7f148effd700 1 -- 172.21.15.118:0/3412475092 >> v1:172.21.15.118:6789/0 conn(0x7f1490089830 legacy=0x7f149014f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.070+0000 7f148effd700 1 -- 172.21.15.118:0/3412475092 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14900c7020 con 0x7f14900adf10 2023-09-28T04:23:24.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.070+0000 7f148effd700 1 --2- 172.21.15.118:0/3412475092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14900adf10 0x7f14901562b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14800098e0 tx=0x7f14800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f0f91de5236c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:24.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.071+0000 7f148dffb700 1 -- 172.21.15.118:0/3412475092 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480011630 con 0x7f14900adf10 2023-09-28T04:23:24.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.071+0000 7f148dffb700 1 -- 172.21.15.118:0/3412475092 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1480011790 con 0x7f14900adf10 2023-09-28T04:23:24.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.071+0000 7f148dffb700 1 -- 172.21.15.118:0/3412475092 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480011b30 con 0x7f14900adf10 2023-09-28T04:23:24.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.071+0000 7f14957ff700 1 -- 172.21.15.118:0/3412475092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14900adf10 msgr2=0x7f14901562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.071+0000 7f14957ff700 1 --2- 172.21.15.118:0/3412475092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14900adf10 0x7f14901562b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14800098e0 tx=0x7f14800091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.071+0000 7f14957ff700 1 -- 172.21.15.118:0/3412475092 shutdown_connections 2023-09-28T04:23:24.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.071+0000 7f14957ff700 1 --2- 172.21.15.118:0/3412475092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14900adf10 0x7f14901562b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.071+0000 7f14957ff700 1 -- 172.21.15.118:0/3412475092 >> 172.21.15.118:0/3412475092 conn(0x7f1490063cc0 msgr2=0x7f14900cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:24.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.071+0000 7f14957ff700 1 -- 172.21.15.118:0/3412475092 shutdown_connections 2023-09-28T04:23:24.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.071+0000 7f14957ff700 1 -- 172.21.15.118:0/3412475092 wait complete. 2023-09-28T04:23:24.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.073+0000 7f14957ff700 1 Processor -- start 2023-09-28T04:23:24.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.073+0000 7f14957ff700 1 -- start start 2023-09-28T04:23:24.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f14957ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1490089830 0x7f149014bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f14957ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14900adf10 0x7f14900c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f14957ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f149014f9f0 0x7f1490169610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f14957ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14900c75e0 con 0x7f1490089830 2023-09-28T04:23:24.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f14957ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14900cc830 con 0x7f14900adf10 2023-09-28T04:23:24.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f14957ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14900b1640 con 0x7f149014f9f0 2023-09-28T04:23:24.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f148effd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1490089830 0x7f149014bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f148effd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1490089830 0x7f149014bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45338/0 (socket says 172.21.15.118:45338) 2023-09-28T04:23:24.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f148effd700 1 -- 172.21.15.118:0/656962042 learned_addr learned my addr 172.21.15.118:0/656962042 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:24.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f148e7fc700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14900adf10 0x7f14900c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f148f7fe700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f149014f9f0 0x7f1490169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f148effd700 1 -- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f149014f9f0 msgr2=0x7f1490169610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f148effd700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f149014f9f0 0x7f1490169610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f148effd700 1 -- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14900adf10 msgr2=0x7f14900c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f148effd700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14900adf10 0x7f14900c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f148effd700 1 -- 172.21.15.118:0/656962042 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1480009420 con 0x7f1490089830 2023-09-28T04:23:24.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.074+0000 7f148f7fe700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f149014f9f0 0x7f1490169610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:24.078 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.075+0000 7f148effd700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1490089830 0x7f149014bac0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1480009ed0 tx=0x7f1480017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:24.078 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.075+0000 7f1476ffd700 1 -- 172.21.15.118:0/656962042 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148001f070 con 0x7f1490089830 2023-09-28T04:23:24.078 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.075+0000 7f1476ffd700 1 -- 172.21.15.118:0/656962042 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1480011900 con 0x7f1490089830 2023-09-28T04:23:24.078 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.075+0000 7f14957ff700 1 -- 172.21.15.118:0/656962042 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14900b1bc0 con 0x7f1490089830 2023-09-28T04:23:24.078 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.075+0000 7f1476ffd700 1 -- 172.21.15.118:0/656962042 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14800233f0 con 0x7f1490089830 2023-09-28T04:23:24.078 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.075+0000 7f14957ff700 1 -- 172.21.15.118:0/656962042 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14900b18e0 con 0x7f1490089830 2023-09-28T04:23:24.079 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.076+0000 7f14957ff700 1 -- 172.21.15.118:0/656962042 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14900682b0 con 0x7f1490089830 2023-09-28T04:23:24.079 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.077+0000 7f1476ffd700 1 -- 172.21.15.118:0/656962042 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f148002c3b0 con 0x7f1490089830 2023-09-28T04:23:24.079 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.077+0000 7f1476ffd700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f147c067330 0x7f147c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.079 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.078+0000 7f1476ffd700 1 -- 172.21.15.118:0/656962042 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1480085fc0 con 0x7f1490089830 2023-09-28T04:23:24.079 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.078+0000 7f148e7fc700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f147c067330 0x7f147c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.079 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.078+0000 7f148e7fc700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f147c067330 0x7f147c0697e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1490147030 tx=0x7f1484009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:24.082 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.082+0000 7f1476ffd700 1 -- 172.21.15.118:0/656962042 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1480052e20 con 0x7f1490089830 2023-09-28T04:23:24.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.275+0000 7f14957ff700 1 -- 172.21.15.118:0/656962042 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f149014ff20 con 0x7f1490089830 2023-09-28T04:23:24.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.276+0000 7f1476ffd700 1 -- 172.21.15.118:0/656962042 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f1480028090 con 0x7f1490089830 2023-09-28T04:23:24.277 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:24.277 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:19.371938+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T04:23:10.586895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T04:23:10.697802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T04:23:16.491417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T04:23:17.349188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:07.142219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.951857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.911133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.882482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.688096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.764671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.767264+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.763816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:24.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.279+0000 7f14957ff700 1 -- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f147c067330 msgr2=0x7f147c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.279+0000 7f14957ff700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f147c067330 0x7f147c0697e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1490147030 tx=0x7f1484009040 comp rx=0 tx=0).stop 2023-09-28T04:23:24.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.279+0000 7f14957ff700 1 -- 172.21.15.118:0/656962042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1490089830 msgr2=0x7f149014bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.279+0000 7f14957ff700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1490089830 0x7f149014bac0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1480009ed0 tx=0x7f1480017000 comp rx=0 tx=0).stop 2023-09-28T04:23:24.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.279+0000 7f14957ff700 1 -- 172.21.15.118:0/656962042 shutdown_connections 2023-09-28T04:23:24.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.279+0000 7f14957ff700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f147c067330 0x7f147c0697e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.279+0000 7f14957ff700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f149014f9f0 0x7f1490169610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.279+0000 7f14957ff700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1490089830 0x7f149014bac0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.279+0000 7f14957ff700 1 --2- 172.21.15.118:0/656962042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14900adf10 0x7f14900c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.279+0000 7f14957ff700 1 -- 172.21.15.118:0/656962042 >> 172.21.15.118:0/656962042 conn(0x7f1490063cc0 msgr2=0x7f149014cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:24.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.279+0000 7f14957ff700 1 -- 172.21.15.118:0/656962042 shutdown_connections 2023-09-28T04:23:24.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.279+0000 7f14957ff700 1 -- 172.21.15.118:0/656962042 wait complete. 2023-09-28T04:23:24.297 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-28T04:23:24.297 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T04:23:24.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.486+0000 7f1b3bfff700 1 Processor -- start 2023-09-28T04:23:24.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.486+0000 7f1b3bfff700 1 -- start start 2023-09-28T04:23:24.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.487+0000 7f1b3bfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1b340c5e30 0x7f1b34156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.487+0000 7f1b3bfff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b340c73e0 con 0x7f1b340ca6c0 2023-09-28T04:23:24.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.487+0000 7f1b3bfff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b340c0b60 con 0x7f1b340c4ab0 2023-09-28T04:23:24.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.487+0000 7f1b3bfff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b340c67d0 con 0x7f1b340c5e30 2023-09-28T04:23:24.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.488+0000 7f1b39d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1b340c5e30 0x7f1b34156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.488+0000 7f1b39d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1b340c5e30 0x7f1b34156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45340/0 (socket says 172.21.15.118:45340) 2023-09-28T04:23:24.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.488+0000 7f1b3a59c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1b340ca6c0 0x7f1b3414f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46086/0 (socket says 172.21.15.118:46086) 2023-09-28T04:23:24.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.488+0000 7f1b39d9b700 1 -- 172.21.15.118:0/2933017597 learned_addr learned my addr 172.21.15.118:0/2933017597 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:24.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.488+0000 7f1b39d9b700 1 -- 172.21.15.118:0/2933017597 >> v1:172.21.15.174:6789/0 conn(0x7f1b340c4ab0 legacy=0x7f1b340c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.488+0000 7f1b39d9b700 1 -- 172.21.15.118:0/2933017597 >> v1:172.21.15.118:6789/0 conn(0x7f1b340ca6c0 legacy=0x7f1b3414f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.488+0000 7f1b39d9b700 1 -- 172.21.15.118:0/2933017597 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b340c6ab0 con 0x7f1b340c5e30 2023-09-28T04:23:24.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.488+0000 7f1b39d9b700 1 --2- 172.21.15.118:0/2933017597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340c5e30 0x7f1b34156570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009990 tx=0x7f1b30009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f65a7629828b00 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:24.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.488+0000 7f1b38d99700 1 -- 172.21.15.118:0/2933017597 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30005c10 con 0x7f1b340c5e30 2023-09-28T04:23:24.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.489+0000 7f1b38d99700 1 -- 172.21.15.118:0/2933017597 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30005d70 con 0x7f1b340c5e30 2023-09-28T04:23:24.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.489+0000 7f1b38d99700 1 -- 172.21.15.118:0/2933017597 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3000b8f0 con 0x7f1b340c5e30 2023-09-28T04:23:24.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.489+0000 7f1b3bfff700 1 -- 172.21.15.118:0/2933017597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340c5e30 msgr2=0x7f1b34156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.489+0000 7f1b3bfff700 1 --2- 172.21.15.118:0/2933017597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340c5e30 0x7f1b34156570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009990 tx=0x7f1b30009220 comp rx=0 tx=0).stop 2023-09-28T04:23:24.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.489+0000 7f1b3bfff700 1 -- 172.21.15.118:0/2933017597 shutdown_connections 2023-09-28T04:23:24.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.489+0000 7f1b3bfff700 1 --2- 172.21.15.118:0/2933017597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340c5e30 0x7f1b34156570 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.489+0000 7f1b3bfff700 1 -- 172.21.15.118:0/2933017597 >> 172.21.15.118:0/2933017597 conn(0x7f1b34063230 msgr2=0x7f1b34063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:24.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.489+0000 7f1b3bfff700 1 -- 172.21.15.118:0/2933017597 shutdown_connections 2023-09-28T04:23:24.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.489+0000 7f1b3bfff700 1 -- 172.21.15.118:0/2933017597 wait complete. 2023-09-28T04:23:24.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.491+0000 7f1b3bfff700 1 Processor -- start 2023-09-28T04:23:24.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.491+0000 7f1b3bfff700 1 -- start start 2023-09-28T04:23:24.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.491+0000 7f1b3bfff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b340c4ab0 0x7f1b341521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b340c5e30 0x7f1b3406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340ca6c0 0x7f1b3406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3bfff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b34155160 con 0x7f1b340ca6c0 2023-09-28T04:23:24.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3bfff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b34168b90 con 0x7f1b340c4ab0 2023-09-28T04:23:24.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3bfff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b34169710 con 0x7f1b340c5e30 2023-09-28T04:23:24.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340ca6c0 0x7f1b3406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b39d9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b340c4ab0 0x7f1b341521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b39d9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b340c4ab0 0x7f1b341521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42214/0 (socket says 172.21.15.118:42214) 2023-09-28T04:23:24.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340ca6c0 0x7f1b3406e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45344/0 (socket says 172.21.15.118:45344) 2023-09-28T04:23:24.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b39d9b700 1 -- 172.21.15.118:0/4103182550 learned_addr learned my addr 172.21.15.118:0/4103182550 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:24.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3959a700 1 --2- 172.21.15.118:0/4103182550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b340c5e30 0x7f1b3406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3a59c700 1 -- 172.21.15.118:0/4103182550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b340c5e30 msgr2=0x7f1b3406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3a59c700 1 --2- 172.21.15.118:0/4103182550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b340c5e30 0x7f1b3406dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3a59c700 1 -- 172.21.15.118:0/4103182550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b340c4ab0 msgr2=0x7f1b341521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3a59c700 1 --2- 172.21.15.118:0/4103182550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b340c4ab0 0x7f1b341521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3a59c700 1 -- 172.21.15.118:0/4103182550 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b30009480 con 0x7f1b340ca6c0 2023-09-28T04:23:24.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.492+0000 7f1b3a59c700 1 --2- 172.21.15.118:0/4103182550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340ca6c0 0x7f1b3406e1a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00cba0 tx=0x7f1b2c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:24.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.493+0000 7f1b29ffb700 1 -- 172.21.15.118:0/4103182550 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c005df0 con 0x7f1b340ca6c0 2023-09-28T04:23:24.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.493+0000 7f1b29ffb700 1 -- 172.21.15.118:0/4103182550 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c00a590 con 0x7f1b340ca6c0 2023-09-28T04:23:24.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.493+0000 7f1b3bfff700 1 -- 172.21.15.118:0/4103182550 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b34150660 con 0x7f1b340ca6c0 2023-09-28T04:23:24.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.493+0000 7f1b29ffb700 1 -- 172.21.15.118:0/4103182550 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00a910 con 0x7f1b340ca6c0 2023-09-28T04:23:24.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.493+0000 7f1b3bfff700 1 -- 172.21.15.118:0/4103182550 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b340c8400 con 0x7f1b340ca6c0 2023-09-28T04:23:24.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.494+0000 7f1b3bfff700 1 -- 172.21.15.118:0/4103182550 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b340713a0 con 0x7f1b340ca6c0 2023-09-28T04:23:24.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.495+0000 7f1b29ffb700 1 -- 172.21.15.118:0/4103182550 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1b2c00ac80 con 0x7f1b340ca6c0 2023-09-28T04:23:24.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.495+0000 7f1b29ffb700 1 --2- 172.21.15.118:0/4103182550 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1b18067330 0x7f1b180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.496+0000 7f1b29ffb700 1 -- 172.21.15.118:0/4103182550 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1b2c0848c0 con 0x7f1b340ca6c0 2023-09-28T04:23:24.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.496+0000 7f1b39d9b700 1 --2- 172.21.15.118:0/4103182550 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1b18067330 0x7f1b180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.496+0000 7f1b39d9b700 1 --2- 172.21.15.118:0/4103182550 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1b18067330 0x7f1b180697e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b30006dc0 tx=0x7f1b30016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:24.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.499+0000 7f1b29ffb700 1 -- 172.21.15.118:0/4103182550 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1b2c051850 con 0x7f1b340ca6c0 2023-09-28T04:23:24.685 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.685+0000 7f1b3bfff700 1 -- 172.21.15.118:0/4103182550 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b340c8400 con 0x7f1b18067330 2023-09-28T04:23:24.695 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.694+0000 7f1b29ffb700 1 -- 172.21.15.118:0/4103182550 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284766 (secure 0 0 0) 0x7f1b340c8400 con 0x7f1b18067330 2023-09-28T04:23:24.699 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:24.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.698+0000 7f1b3bfff700 1 -- 172.21.15.118:0/4103182550 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1b18067330 msgr2=0x7f1b180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.698+0000 7f1b3bfff700 1 --2- 172.21.15.118:0/4103182550 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1b18067330 0x7f1b180697e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b30006dc0 tx=0x7f1b30016000 comp rx=0 tx=0).stop 2023-09-28T04:23:24.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.698+0000 7f1b3bfff700 1 -- 172.21.15.118:0/4103182550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340ca6c0 msgr2=0x7f1b3406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.698+0000 7f1b3bfff700 1 --2- 172.21.15.118:0/4103182550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340ca6c0 0x7f1b3406e1a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00cba0 tx=0x7f1b2c0019b0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.698+0000 7f1b3bfff700 1 -- 172.21.15.118:0/4103182550 shutdown_connections 2023-09-28T04:23:24.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.698+0000 7f1b3bfff700 1 --2- 172.21.15.118:0/4103182550 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1b18067330 0x7f1b180697e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.698+0000 7f1b3bfff700 1 --2- 172.21.15.118:0/4103182550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b340ca6c0 0x7f1b3406e1a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.698+0000 7f1b3bfff700 1 --2- 172.21.15.118:0/4103182550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b340c4ab0 0x7f1b341521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.698+0000 7f1b3bfff700 1 --2- 172.21.15.118:0/4103182550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1b340c5e30 0x7f1b3406dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.698+0000 7f1b3bfff700 1 -- 172.21.15.118:0/4103182550 >> 172.21.15.118:0/4103182550 conn(0x7f1b34063230 msgr2=0x7f1b340693d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:24.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.698+0000 7f1b3bfff700 1 -- 172.21.15.118:0/4103182550 shutdown_connections 2023-09-28T04:23:24.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.699+0000 7f1b3bfff700 1 -- 172.21.15.118:0/4103182550 wait complete. 2023-09-28T04:23:24.702 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-09-28T04:23:24.716 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-09-28T04:23:24.525876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67904,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":66112,"kb_avail":754906816,"statfs":{"total":773094113280,"available":773024579584,"internally_reserved":0,"allocated":1769472,"data_stored":1761440,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":67698688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.635689"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400475+0000","last_change":"2023-09-28T04:23:18.400475+0000","last_active":"2023-09-28T04:23:18.400475+0000","last_peered":"2023-09-28T04:23:18.400475+0000","last_clean":"2023-09-28T04:23:18.400475+0000","last_became_active":"2023-09-28T04:23:18.400107+0000","last_became_peered":"2023-09-28T04:23:18.400107+0000","last_unstale":"2023-09-28T04:23:18.400475+0000","last_undegraded":"2023-09-28T04:23:18.400475+0000","last_fullsized":"2023-09-28T04:23:18.400475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:44.340279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391569+0000","last_change":"2023-09-28T04:23:18.385136+0000","last_active":"2023-09-28T04:23:18.391569+0000","last_peered":"2023-09-28T04:23:18.391569+0000","last_clean":"2023-09-28T04:23:18.391569+0000","last_became_active":"2023-09-28T04:23:18.384789+0000","last_became_peered":"2023-09-28T04:23:18.384789+0000","last_unstale":"2023-09-28T04:23:18.391569+0000","last_undegraded":"2023-09-28T04:23:18.391569+0000","last_fullsized":"2023-09-28T04:23:18.391569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397939+0000","last_change":"2023-09-28T04:23:18.393700+0000","last_active":"2023-09-28T04:23:18.397939+0000","last_peered":"2023-09-28T04:23:18.397939+0000","last_clean":"2023-09-28T04:23:18.397939+0000","last_became_active":"2023-09-28T04:23:18.390599+0000","last_became_peered":"2023-09-28T04:23:18.390599+0000","last_unstale":"2023-09-28T04:23:18.397939+0000","last_undegraded":"2023-09-28T04:23:18.397939+0000","last_fullsized":"2023-09-28T04:23:18.397939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:43:19.782618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390865+0000","last_change":"2023-09-28T04:23:18.390865+0000","last_active":"2023-09-28T04:23:18.390865+0000","last_peered":"2023-09-28T04:23:18.390865+0000","last_clean":"2023-09-28T04:23:18.390865+0000","last_became_active":"2023-09-28T04:23:18.390607+0000","last_became_peered":"2023-09-28T04:23:18.390607+0000","last_unstale":"2023-09-28T04:23:18.390865+0000","last_undegraded":"2023-09-28T04:23:18.390865+0000","last_fullsized":"2023-09-28T04:23:18.390865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404215+0000","last_change":"2023-09-28T04:23:18.404215+0000","last_active":"2023-09-28T04:23:18.404215+0000","last_peered":"2023-09-28T04:23:18.404215+0000","last_clean":"2023-09-28T04:23:18.404215+0000","last_became_active":"2023-09-28T04:23:18.403960+0000","last_became_peered":"2023-09-28T04:23:18.403960+0000","last_unstale":"2023-09-28T04:23:18.404215+0000","last_undegraded":"2023-09-28T04:23:18.404215+0000","last_fullsized":"2023-09-28T04:23:18.404215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397969+0000","last_change":"2023-09-28T04:23:18.393987+0000","last_active":"2023-09-28T04:23:18.397969+0000","last_peered":"2023-09-28T04:23:18.397969+0000","last_clean":"2023-09-28T04:23:18.397969+0000","last_became_active":"2023-09-28T04:23:18.390575+0000","last_became_peered":"2023-09-28T04:23:18.390575+0000","last_unstale":"2023-09-28T04:23:18.397969+0000","last_undegraded":"2023-09-28T04:23:18.397969+0000","last_fullsized":"2023-09-28T04:23:18.397969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:24:51.659204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.396733+0000","last_change":"2023-09-28T04:23:18.396733+0000","last_active":"2023-09-28T04:23:18.396733+0000","last_peered":"2023-09-28T04:23:18.396733+0000","last_clean":"2023-09-28T04:23:18.396733+0000","last_became_active":"2023-09-28T04:23:18.396038+0000","last_became_peered":"2023-09-28T04:23:18.396038+0000","last_unstale":"2023-09-28T04:23:18.396733+0000","last_undegraded":"2023-09-28T04:23:18.396733+0000","last_fullsized":"2023-09-28T04:23:18.396733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391542+0000","last_change":"2023-09-28T04:23:18.388208+0000","last_active":"2023-09-28T04:23:18.391542+0000","last_peered":"2023-09-28T04:23:18.391542+0000","last_clean":"2023-09-28T04:23:18.391542+0000","last_became_active":"2023-09-28T04:23:18.387260+0000","last_became_peered":"2023-09-28T04:23:18.387260+0000","last_unstale":"2023-09-28T04:23:18.391542+0000","last_undegraded":"2023-09-28T04:23:18.391542+0000","last_fullsized":"2023-09-28T04:23:18.391542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.403803+0000","last_change":"2023-09-28T04:23:18.403803+0000","last_active":"2023-09-28T04:23:18.403803+0000","last_peered":"2023-09-28T04:23:18.403803+0000","last_clean":"2023-09-28T04:23:18.403803+0000","last_became_active":"2023-09-28T04:23:18.403565+0000","last_became_peered":"2023-09-28T04:23:18.403565+0000","last_unstale":"2023-09-28T04:23:18.403803+0000","last_undegraded":"2023-09-28T04:23:18.403803+0000","last_fullsized":"2023-09-28T04:23:18.403803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397774+0000","last_change":"2023-09-28T04:23:18.392418+0000","last_active":"2023-09-28T04:23:18.397774+0000","last_peered":"2023-09-28T04:23:18.397774+0000","last_clean":"2023-09-28T04:23:18.397774+0000","last_became_active":"2023-09-28T04:23:18.390911+0000","last_became_peered":"2023-09-28T04:23:18.390911+0000","last_unstale":"2023-09-28T04:23:18.397774+0000","last_undegraded":"2023-09-28T04:23:18.397774+0000","last_fullsized":"2023-09-28T04:23:18.397774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397957+0000","last_change":"2023-09-28T04:23:18.393845+0000","last_active":"2023-09-28T04:23:18.397957+0000","last_peered":"2023-09-28T04:23:18.397957+0000","last_clean":"2023-09-28T04:23:18.397957+0000","last_became_active":"2023-09-28T04:23:18.393524+0000","last_became_peered":"2023-09-28T04:23:18.393524+0000","last_unstale":"2023-09-28T04:23:18.397957+0000","last_undegraded":"2023-09-28T04:23:18.397957+0000","last_fullsized":"2023-09-28T04:23:18.397957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:27:39.596054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.385250+0000","last_change":"2023-09-28T04:23:18.385250+0000","last_active":"2023-09-28T04:23:18.385250+0000","last_peered":"2023-09-28T04:23:18.385250+0000","last_clean":"2023-09-28T04:23:18.385250+0000","last_became_active":"2023-09-28T04:23:18.384986+0000","last_became_peered":"2023-09-28T04:23:18.384986+0000","last_unstale":"2023-09-28T04:23:18.385250+0000","last_undegraded":"2023-09-28T04:23:18.385250+0000","last_fullsized":"2023-09-28T04:23:18.385250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:15.500469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402417+0000","last_change":"2023-09-28T04:23:18.402417+0000","last_active":"2023-09-28T04:23:18.402417+0000","last_peered":"2023-09-28T04:23:18.402417+0000","last_clean":"2023-09-28T04:23:18.402417+0000","last_became_active":"2023-09-28T04:23:18.402161+0000","last_became_peered":"2023-09-28T04:23:18.402161+0000","last_unstale":"2023-09-28T04:23:18.402417+0000","last_undegraded":"2023-09-28T04:23:18.402417+0000","last_fullsized":"2023-09-28T04:23:18.402417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:50.909915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391345+0000","last_change":"2023-09-28T04:23:18.387808+0000","last_active":"2023-09-28T04:23:18.391345+0000","last_peered":"2023-09-28T04:23:18.391345+0000","last_clean":"2023-09-28T04:23:18.391345+0000","last_became_active":"2023-09-28T04:23:18.387471+0000","last_became_peered":"2023-09-28T04:23:18.387471+0000","last_unstale":"2023-09-28T04:23:18.391345+0000","last_undegraded":"2023-09-28T04:23:18.391345+0000","last_fullsized":"2023-09-28T04:23:18.391345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.396945+0000","last_change":"2023-09-28T04:23:18.396945+0000","last_active":"2023-09-28T04:23:18.396945+0000","last_peered":"2023-09-28T04:23:18.396945+0000","last_clean":"2023-09-28T04:23:18.396945+0000","last_became_active":"2023-09-28T04:23:18.396395+0000","last_became_peered":"2023-09-28T04:23:18.396395+0000","last_unstale":"2023-09-28T04:23:18.396945+0000","last_undegraded":"2023-09-28T04:23:18.396945+0000","last_fullsized":"2023-09-28T04:23:18.396945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397971+0000","last_change":"2023-09-28T04:23:18.393975+0000","last_active":"2023-09-28T04:23:18.397971+0000","last_peered":"2023-09-28T04:23:18.397971+0000","last_clean":"2023-09-28T04:23:18.397971+0000","last_became_active":"2023-09-28T04:23:18.393683+0000","last_became_peered":"2023-09-28T04:23:18.393683+0000","last_unstale":"2023-09-28T04:23:18.397971+0000","last_undegraded":"2023-09-28T04:23:18.397971+0000","last_fullsized":"2023-09-28T04:23:18.397971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:06:40.927453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402518+0000","last_change":"2023-09-28T04:23:18.402518+0000","last_active":"2023-09-28T04:23:18.402518+0000","last_peered":"2023-09-28T04:23:18.402518+0000","last_clean":"2023-09-28T04:23:18.402518+0000","last_became_active":"2023-09-28T04:23:18.402275+0000","last_became_peered":"2023-09-28T04:23:18.402275+0000","last_unstale":"2023-09-28T04:23:18.402518+0000","last_undegraded":"2023-09-28T04:23:18.402518+0000","last_fullsized":"2023-09-28T04:23:18.402518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400750+0000","last_change":"2023-09-28T04:23:18.395032+0000","last_active":"2023-09-28T04:23:18.400750+0000","last_peered":"2023-09-28T04:23:18.400750+0000","last_clean":"2023-09-28T04:23:18.400750+0000","last_became_active":"2023-09-28T04:23:18.390678+0000","last_became_peered":"2023-09-28T04:23:18.390678+0000","last_unstale":"2023-09-28T04:23:18.400750+0000","last_undegraded":"2023-09-28T04:23:18.400750+0000","last_fullsized":"2023-09-28T04:23:18.400750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.385209+0000","last_change":"2023-09-28T04:23:18.385209+0000","last_active":"2023-09-28T04:23:18.385209+0000","last_peered":"2023-09-28T04:23:18.385209+0000","last_clean":"2023-09-28T04:23:18.385209+0000","last_became_active":"2023-09-28T04:23:18.384916+0000","last_became_peered":"2023-09-28T04:23:18.384916+0000","last_unstale":"2023-09-28T04:23:18.385209+0000","last_undegraded":"2023-09-28T04:23:18.385209+0000","last_fullsized":"2023-09-28T04:23:18.385209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:06.937552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397758+0000","last_change":"2023-09-28T04:23:18.386692+0000","last_active":"2023-09-28T04:23:18.397758+0000","last_peered":"2023-09-28T04:23:18.397758+0000","last_clean":"2023-09-28T04:23:18.397758+0000","last_became_active":"2023-09-28T04:23:18.385805+0000","last_became_peered":"2023-09-28T04:23:18.385805+0000","last_unstale":"2023-09-28T04:23:18.397758+0000","last_undegraded":"2023-09-28T04:23:18.397758+0000","last_fullsized":"2023-09-28T04:23:18.397758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:52:07.899487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400497+0000","last_change":"2023-09-28T04:23:18.400497+0000","last_active":"2023-09-28T04:23:18.400497+0000","last_peered":"2023-09-28T04:23:18.400497+0000","last_clean":"2023-09-28T04:23:18.400497+0000","last_became_active":"2023-09-28T04:23:18.400230+0000","last_became_peered":"2023-09-28T04:23:18.400230+0000","last_unstale":"2023-09-28T04:23:18.400497+0000","last_undegraded":"2023-09-28T04:23:18.400497+0000","last_fullsized":"2023-09-28T04:23:18.400497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391683+0000","last_change":"2023-09-28T04:23:18.391683+0000","last_active":"2023-09-28T04:23:18.391683+0000","last_peered":"2023-09-28T04:23:18.391683+0000","last_clean":"2023-09-28T04:23:18.391683+0000","last_became_active":"2023-09-28T04:23:18.391373+0000","last_became_peered":"2023-09-28T04:23:18.391373+0000","last_unstale":"2023-09-28T04:23:18.391683+0000","last_undegraded":"2023-09-28T04:23:18.391683+0000","last_fullsized":"2023-09-28T04:23:18.391683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402238+0000","last_change":"2023-09-28T04:23:18.393381+0000","last_active":"2023-09-28T04:23:18.402238+0000","last_peered":"2023-09-28T04:23:18.402238+0000","last_clean":"2023-09-28T04:23:18.402238+0000","last_became_active":"2023-09-28T04:23:18.392723+0000","last_became_peered":"2023-09-28T04:23:18.392723+0000","last_unstale":"2023-09-28T04:23:18.402238+0000","last_undegraded":"2023-09-28T04:23:18.402238+0000","last_fullsized":"2023-09-28T04:23:18.402238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402467+0000","last_change":"2023-09-28T04:23:18.402467+0000","last_active":"2023-09-28T04:23:18.402467+0000","last_peered":"2023-09-28T04:23:18.402467+0000","last_clean":"2023-09-28T04:23:18.402467+0000","last_became_active":"2023-09-28T04:23:18.402197+0000","last_became_peered":"2023-09-28T04:23:18.402197+0000","last_unstale":"2023-09-28T04:23:18.402467+0000","last_undegraded":"2023-09-28T04:23:18.402467+0000","last_fullsized":"2023-09-28T04:23:18.402467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.396757+0000","last_change":"2023-09-28T04:23:18.389242+0000","last_active":"2023-09-28T04:23:18.396757+0000","last_peered":"2023-09-28T04:23:18.396757+0000","last_clean":"2023-09-28T04:23:18.396757+0000","last_became_active":"2023-09-28T04:23:18.388936+0000","last_became_peered":"2023-09-28T04:23:18.388936+0000","last_unstale":"2023-09-28T04:23:18.396757+0000","last_undegraded":"2023-09-28T04:23:18.396757+0000","last_fullsized":"2023-09-28T04:23:18.396757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:19.108476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395209+0000","last_change":"2023-09-28T04:23:18.388941+0000","last_active":"2023-09-28T04:23:18.395209+0000","last_peered":"2023-09-28T04:23:18.395209+0000","last_clean":"2023-09-28T04:23:18.395209+0000","last_became_active":"2023-09-28T04:23:18.388682+0000","last_became_peered":"2023-09-28T04:23:18.388682+0000","last_unstale":"2023-09-28T04:23:18.395209+0000","last_undegraded":"2023-09-28T04:23:18.395209+0000","last_fullsized":"2023-09-28T04:23:18.395209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395293+0000","last_change":"2023-09-28T04:23:18.391753+0000","last_active":"2023-09-28T04:23:18.395293+0000","last_peered":"2023-09-28T04:23:18.395293+0000","last_clean":"2023-09-28T04:23:18.395293+0000","last_became_active":"2023-09-28T04:23:18.391031+0000","last_became_peered":"2023-09-28T04:23:18.391031+0000","last_unstale":"2023-09-28T04:23:18.395293+0000","last_undegraded":"2023-09-28T04:23:18.395293+0000","last_fullsized":"2023-09-28T04:23:18.395293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.382219+0000","last_change":"2023-09-28T04:23:17.914158+0000","last_active":"2023-09-28T04:23:18.382219+0000","last_peered":"2023-09-28T04:23:18.382219+0000","last_clean":"2023-09-28T04:23:18.382219+0000","last_became_active":"2023-09-28T04:23:17.913941+0000","last_became_peered":"2023-09-28T04:23:17.913941+0000","last_unstale":"2023-09-28T04:23:18.382219+0000","last_undegraded":"2023-09-28T04:23:18.382219+0000","last_fullsized":"2023-09-28T04:23:18.382219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401811+0000","last_change":"2023-09-28T04:23:18.390288+0000","last_active":"2023-09-28T04:23:18.401811+0000","last_peered":"2023-09-28T04:23:18.401811+0000","last_clean":"2023-09-28T04:23:18.401811+0000","last_became_active":"2023-09-28T04:23:18.390030+0000","last_became_peered":"2023-09-28T04:23:18.390030+0000","last_unstale":"2023-09-28T04:23:18.401811+0000","last_undegraded":"2023-09-28T04:23:18.401811+0000","last_fullsized":"2023-09-28T04:23:18.401811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377746+0000","last_change":"2023-09-28T04:23:17.914311+0000","last_active":"2023-09-28T04:23:18.377746+0000","last_peered":"2023-09-28T04:23:18.377746+0000","last_clean":"2023-09-28T04:23:18.377746+0000","last_became_active":"2023-09-28T04:23:17.913950+0000","last_became_peered":"2023-09-28T04:23:17.913950+0000","last_unstale":"2023-09-28T04:23:18.377746+0000","last_undegraded":"2023-09-28T04:23:18.377746+0000","last_fullsized":"2023-09-28T04:23:18.377746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.393402+0000","last_change":"2023-09-28T04:23:18.393402+0000","last_active":"2023-09-28T04:23:18.393402+0000","last_peered":"2023-09-28T04:23:18.393402+0000","last_clean":"2023-09-28T04:23:18.393402+0000","last_became_active":"2023-09-28T04:23:18.393106+0000","last_became_peered":"2023-09-28T04:23:18.393106+0000","last_unstale":"2023-09-28T04:23:18.393402+0000","last_undegraded":"2023-09-28T04:23:18.393402+0000","last_fullsized":"2023-09-28T04:23:18.393402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.376291+0000","last_change":"2023-09-28T04:23:17.911104+0000","last_active":"2023-09-28T04:23:18.376291+0000","last_peered":"2023-09-28T04:23:18.376291+0000","last_clean":"2023-09-28T04:23:18.376291+0000","last_became_active":"2023-09-28T04:23:17.910766+0000","last_became_peered":"2023-09-28T04:23:17.910766+0000","last_unstale":"2023-09-28T04:23:18.376291+0000","last_undegraded":"2023-09-28T04:23:18.376291+0000","last_fullsized":"2023-09-28T04:23:18.376291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388098+0000","last_change":"2023-09-28T04:23:18.388098+0000","last_active":"2023-09-28T04:23:18.388098+0000","last_peered":"2023-09-28T04:23:18.388098+0000","last_clean":"2023-09-28T04:23:18.388098+0000","last_became_active":"2023-09-28T04:23:18.387581+0000","last_became_peered":"2023-09-28T04:23:18.387581+0000","last_unstale":"2023-09-28T04:23:18.388098+0000","last_undegraded":"2023-09-28T04:23:18.388098+0000","last_fullsized":"2023-09-28T04:23:18.388098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:11.090984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.919091+0000","last_change":"2023-09-28T04:23:17.917921+0000","last_active":"2023-09-28T04:23:17.919091+0000","last_peered":"2023-09-28T04:23:17.919091+0000","last_clean":"2023-09-28T04:23:17.919091+0000","last_became_active":"2023-09-28T04:23:17.917596+0000","last_became_peered":"2023-09-28T04:23:17.917596+0000","last_unstale":"2023-09-28T04:23:17.919091+0000","last_undegraded":"2023-09-28T04:23:17.919091+0000","last_fullsized":"2023-09-28T04:23:17.919091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402470+0000","last_change":"2023-09-28T04:23:18.394460+0000","last_active":"2023-09-28T04:23:18.402470+0000","last_peered":"2023-09-28T04:23:18.402470+0000","last_clean":"2023-09-28T04:23:18.402470+0000","last_became_active":"2023-09-28T04:23:18.391773+0000","last_became_peered":"2023-09-28T04:23:18.391773+0000","last_unstale":"2023-09-28T04:23:18.402470+0000","last_undegraded":"2023-09-28T04:23:18.402470+0000","last_fullsized":"2023-09-28T04:23:18.402470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379691+0000","last_change":"2023-09-28T04:23:17.908875+0000","last_active":"2023-09-28T04:23:18.379691+0000","last_peered":"2023-09-28T04:23:18.379691+0000","last_clean":"2023-09-28T04:23:18.379691+0000","last_became_active":"2023-09-28T04:23:17.908599+0000","last_became_peered":"2023-09-28T04:23:17.908599+0000","last_unstale":"2023-09-28T04:23:18.379691+0000","last_undegraded":"2023-09-28T04:23:18.379691+0000","last_fullsized":"2023-09-28T04:23:18.379691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402255+0000","last_change":"2023-09-28T04:23:18.393856+0000","last_active":"2023-09-28T04:23:18.402255+0000","last_peered":"2023-09-28T04:23:18.402255+0000","last_clean":"2023-09-28T04:23:18.402255+0000","last_became_active":"2023-09-28T04:23:18.393631+0000","last_became_peered":"2023-09-28T04:23:18.393631+0000","last_unstale":"2023-09-28T04:23:18.402255+0000","last_undegraded":"2023-09-28T04:23:18.402255+0000","last_fullsized":"2023-09-28T04:23:18.402255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.914702+0000","last_change":"2023-09-28T04:23:17.911594+0000","last_active":"2023-09-28T04:23:17.914702+0000","last_peered":"2023-09-28T04:23:17.914702+0000","last_clean":"2023-09-28T04:23:17.914702+0000","last_became_active":"2023-09-28T04:23:17.911361+0000","last_became_peered":"2023-09-28T04:23:17.911361+0000","last_unstale":"2023-09-28T04:23:17.914702+0000","last_undegraded":"2023-09-28T04:23:17.914702+0000","last_fullsized":"2023-09-28T04:23:17.914702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.394029+0000","last_change":"2023-09-28T04:23:18.387908+0000","last_active":"2023-09-28T04:23:18.394029+0000","last_peered":"2023-09-28T04:23:18.394029+0000","last_clean":"2023-09-28T04:23:18.394029+0000","last_became_active":"2023-09-28T04:23:18.387672+0000","last_became_peered":"2023-09-28T04:23:18.387672+0000","last_unstale":"2023-09-28T04:23:18.394029+0000","last_undegraded":"2023-09-28T04:23:18.394029+0000","last_fullsized":"2023-09-28T04:23:18.394029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.381660+0000","last_change":"2023-09-28T04:23:17.904974+0000","last_active":"2023-09-28T04:23:18.381660+0000","last_peered":"2023-09-28T04:23:18.381660+0000","last_clean":"2023-09-28T04:23:18.381660+0000","last_became_active":"2023-09-28T04:23:17.904734+0000","last_became_peered":"2023-09-28T04:23:17.904734+0000","last_unstale":"2023-09-28T04:23:18.381660+0000","last_undegraded":"2023-09-28T04:23:18.381660+0000","last_fullsized":"2023-09-28T04:23:18.381660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397872+0000","last_change":"2023-09-28T04:23:18.389128+0000","last_active":"2023-09-28T04:23:18.397872+0000","last_peered":"2023-09-28T04:23:18.397872+0000","last_clean":"2023-09-28T04:23:18.397872+0000","last_became_active":"2023-09-28T04:23:18.388871+0000","last_became_peered":"2023-09-28T04:23:18.388871+0000","last_unstale":"2023-09-28T04:23:18.397872+0000","last_undegraded":"2023-09-28T04:23:18.397872+0000","last_fullsized":"2023-09-28T04:23:18.397872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:33:50.957431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.914658+0000","last_change":"2023-09-28T04:23:17.910343+0000","last_active":"2023-09-28T04:23:17.914658+0000","last_peered":"2023-09-28T04:23:17.914658+0000","last_clean":"2023-09-28T04:23:17.914658+0000","last_became_active":"2023-09-28T04:23:17.909981+0000","last_became_peered":"2023-09-28T04:23:17.909981+0000","last_unstale":"2023-09-28T04:23:17.914658+0000","last_undegraded":"2023-09-28T04:23:17.914658+0000","last_fullsized":"2023-09-28T04:23:17.914658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:11.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402619+0000","last_change":"2023-09-28T04:23:18.391696+0000","last_active":"2023-09-28T04:23:18.402619+0000","last_peered":"2023-09-28T04:23:18.402619+0000","last_clean":"2023-09-28T04:23:18.402619+0000","last_became_active":"2023-09-28T04:23:18.391441+0000","last_became_peered":"2023-09-28T04:23:18.391441+0000","last_unstale":"2023-09-28T04:23:18.402619+0000","last_undegraded":"2023-09-28T04:23:18.402619+0000","last_fullsized":"2023-09-28T04:23:18.402619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.918197+0000","last_change":"2023-09-28T04:23:17.916730+0000","last_active":"2023-09-28T04:23:17.918197+0000","last_peered":"2023-09-28T04:23:17.918197+0000","last_clean":"2023-09-28T04:23:17.918197+0000","last_became_active":"2023-09-28T04:23:17.916424+0000","last_became_peered":"2023-09-28T04:23:17.916424+0000","last_unstale":"2023-09-28T04:23:17.918197+0000","last_undegraded":"2023-09-28T04:23:17.918197+0000","last_fullsized":"2023-09-28T04:23:17.918197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392344+0000","last_change":"2023-09-28T04:23:18.391510+0000","last_active":"2023-09-28T04:23:18.392344+0000","last_peered":"2023-09-28T04:23:18.392344+0000","last_clean":"2023-09-28T04:23:18.392344+0000","last_became_active":"2023-09-28T04:23:18.390613+0000","last_became_peered":"2023-09-28T04:23:18.390613+0000","last_unstale":"2023-09-28T04:23:18.392344+0000","last_undegraded":"2023-09-28T04:23:18.392344+0000","last_fullsized":"2023-09-28T04:23:18.392344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.914696+0000","last_change":"2023-09-28T04:23:17.910760+0000","last_active":"2023-09-28T04:23:17.914696+0000","last_peered":"2023-09-28T04:23:17.914696+0000","last_clean":"2023-09-28T04:23:17.914696+0000","last_became_active":"2023-09-28T04:23:17.910457+0000","last_became_peered":"2023-09-28T04:23:17.910457+0000","last_unstale":"2023-09-28T04:23:17.914696+0000","last_undegraded":"2023-09-28T04:23:17.914696+0000","last_fullsized":"2023-09-28T04:23:17.914696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:10.087083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402823+0000","last_change":"2023-09-28T04:23:18.402823+0000","last_active":"2023-09-28T04:23:18.402823+0000","last_peered":"2023-09-28T04:23:18.402823+0000","last_clean":"2023-09-28T04:23:18.402823+0000","last_became_active":"2023-09-28T04:23:18.402559+0000","last_became_peered":"2023-09-28T04:23:18.402559+0000","last_unstale":"2023-09-28T04:23:18.402823+0000","last_undegraded":"2023-09-28T04:23:18.402823+0000","last_fullsized":"2023-09-28T04:23:18.402823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.912229+0000","last_change":"2023-09-28T04:23:17.910972+0000","last_active":"2023-09-28T04:23:17.912229+0000","last_peered":"2023-09-28T04:23:17.912229+0000","last_clean":"2023-09-28T04:23:17.912229+0000","last_became_active":"2023-09-28T04:23:17.910650+0000","last_became_peered":"2023-09-28T04:23:17.910650+0000","last_unstale":"2023-09-28T04:23:17.912229+0000","last_undegraded":"2023-09-28T04:23:17.912229+0000","last_fullsized":"2023-09-28T04:23:17.912229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:03:36.553513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402556+0000","last_change":"2023-09-28T04:23:18.395424+0000","last_active":"2023-09-28T04:23:18.402556+0000","last_peered":"2023-09-28T04:23:18.402556+0000","last_clean":"2023-09-28T04:23:18.402556+0000","last_became_active":"2023-09-28T04:23:18.394721+0000","last_became_peered":"2023-09-28T04:23:18.394721+0000","last_unstale":"2023-09-28T04:23:18.402556+0000","last_undegraded":"2023-09-28T04:23:18.402556+0000","last_fullsized":"2023-09-28T04:23:18.402556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.911983+0000","last_change":"2023-09-28T04:23:17.907642+0000","last_active":"2023-09-28T04:23:17.911983+0000","last_peered":"2023-09-28T04:23:17.911983+0000","last_clean":"2023-09-28T04:23:17.911983+0000","last_became_active":"2023-09-28T04:23:17.907331+0000","last_became_peered":"2023-09-28T04:23:17.907331+0000","last_unstale":"2023-09-28T04:23:17.911983+0000","last_undegraded":"2023-09-28T04:23:17.911983+0000","last_fullsized":"2023-09-28T04:23:17.911983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.393277+0000","last_change":"2023-09-28T04:23:18.390910+0000","last_active":"2023-09-28T04:23:18.393277+0000","last_peered":"2023-09-28T04:23:18.393277+0000","last_clean":"2023-09-28T04:23:18.393277+0000","last_became_active":"2023-09-28T04:23:18.390633+0000","last_became_peered":"2023-09-28T04:23:18.390633+0000","last_unstale":"2023-09-28T04:23:18.393277+0000","last_undegraded":"2023-09-28T04:23:18.393277+0000","last_fullsized":"2023-09-28T04:23:18.393277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.911935+0000","last_change":"2023-09-28T04:23:17.906320+0000","last_active":"2023-09-28T04:23:17.911935+0000","last_peered":"2023-09-28T04:23:17.911935+0000","last_clean":"2023-09-28T04:23:17.911935+0000","last_became_active":"2023-09-28T04:23:17.906036+0000","last_became_peered":"2023-09-28T04:23:17.906036+0000","last_unstale":"2023-09-28T04:23:17.911935+0000","last_undegraded":"2023-09-28T04:23:17.911935+0000","last_fullsized":"2023-09-28T04:23:17.911935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397773+0000","last_change":"2023-09-28T04:23:18.386196+0000","last_active":"2023-09-28T04:23:18.397773+0000","last_peered":"2023-09-28T04:23:18.397773+0000","last_clean":"2023-09-28T04:23:18.397773+0000","last_became_active":"2023-09-28T04:23:18.385693+0000","last_became_peered":"2023-09-28T04:23:18.385693+0000","last_unstale":"2023-09-28T04:23:18.397773+0000","last_undegraded":"2023-09-28T04:23:18.397773+0000","last_fullsized":"2023-09-28T04:23:18.397773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.912035+0000","last_change":"2023-09-28T04:23:17.908768+0000","last_active":"2023-09-28T04:23:17.912035+0000","last_peered":"2023-09-28T04:23:17.912035+0000","last_clean":"2023-09-28T04:23:17.912035+0000","last_became_active":"2023-09-28T04:23:17.908493+0000","last_became_peered":"2023-09-28T04:23:17.908493+0000","last_unstale":"2023-09-28T04:23:17.912035+0000","last_undegraded":"2023-09-28T04:23:17.912035+0000","last_fullsized":"2023-09-28T04:23:17.912035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.385404+0000","last_change":"2023-09-28T04:23:18.385404+0000","last_active":"2023-09-28T04:23:18.385404+0000","last_peered":"2023-09-28T04:23:18.385404+0000","last_clean":"2023-09-28T04:23:18.385404+0000","last_became_active":"2023-09-28T04:23:18.385112+0000","last_became_peered":"2023-09-28T04:23:18.385112+0000","last_unstale":"2023-09-28T04:23:18.385404+0000","last_undegraded":"2023-09-28T04:23:18.385404+0000","last_fullsized":"2023-09-28T04:23:18.385404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:06.331056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378811+0000","last_change":"2023-09-28T04:23:17.898518+0000","last_active":"2023-09-28T04:23:18.378811+0000","last_peered":"2023-09-28T04:23:18.378811+0000","last_clean":"2023-09-28T04:23:18.378811+0000","last_became_active":"2023-09-28T04:23:17.898232+0000","last_became_peered":"2023-09-28T04:23:17.898232+0000","last_unstale":"2023-09-28T04:23:18.378811+0000","last_undegraded":"2023-09-28T04:23:18.378811+0000","last_fullsized":"2023-09-28T04:23:18.378811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392206+0000","last_change":"2023-09-28T04:23:18.392206+0000","last_active":"2023-09-28T04:23:18.392206+0000","last_peered":"2023-09-28T04:23:18.392206+0000","last_clean":"2023-09-28T04:23:18.392206+0000","last_became_active":"2023-09-28T04:23:18.391963+0000","last_became_peered":"2023-09-28T04:23:18.391963+0000","last_unstale":"2023-09-28T04:23:18.392206+0000","last_undegraded":"2023-09-28T04:23:18.392206+0000","last_fullsized":"2023-09-28T04:23:18.392206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.375609+0000","last_change":"2023-09-28T04:23:17.905390+0000","last_active":"2023-09-28T04:23:18.375609+0000","last_peered":"2023-09-28T04:23:18.375609+0000","last_clean":"2023-09-28T04:23:18.375609+0000","last_became_active":"2023-09-28T04:23:17.905089+0000","last_became_peered":"2023-09-28T04:23:17.905089+0000","last_unstale":"2023-09-28T04:23:18.375609+0000","last_undegraded":"2023-09-28T04:23:18.375609+0000","last_fullsized":"2023-09-28T04:23:18.375609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401474+0000","last_change":"2023-09-28T04:23:18.400110+0000","last_active":"2023-09-28T04:23:18.401474+0000","last_peered":"2023-09-28T04:23:18.401474+0000","last_clean":"2023-09-28T04:23:18.401474+0000","last_became_active":"2023-09-28T04:23:18.399839+0000","last_became_peered":"2023-09-28T04:23:18.399839+0000","last_unstale":"2023-09-28T04:23:18.401474+0000","last_undegraded":"2023-09-28T04:23:18.401474+0000","last_fullsized":"2023-09-28T04:23:18.401474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.915135+0000","last_change":"2023-09-28T04:23:17.912734+0000","last_active":"2023-09-28T04:23:17.915135+0000","last_peered":"2023-09-28T04:23:17.915135+0000","last_clean":"2023-09-28T04:23:17.915135+0000","last_became_active":"2023-09-28T04:23:17.912560+0000","last_became_peered":"2023-09-28T04:23:17.912560+0000","last_unstale":"2023-09-28T04:23:17.915135+0000","last_undegraded":"2023-09-28T04:23:17.915135+0000","last_fullsized":"2023-09-28T04:23:17.915135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397919+0000","last_change":"2023-09-28T04:23:18.393554+0000","last_active":"2023-09-28T04:23:18.397919+0000","last_peered":"2023-09-28T04:23:18.397919+0000","last_clean":"2023-09-28T04:23:18.397919+0000","last_became_active":"2023-09-28T04:23:18.390268+0000","last_became_peered":"2023-09-28T04:23:18.390268+0000","last_unstale":"2023-09-28T04:23:18.397919+0000","last_undegraded":"2023-09-28T04:23:18.397919+0000","last_fullsized":"2023-09-28T04:23:18.397919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.381608+0000","last_change":"2023-09-28T04:23:17.911218+0000","last_active":"2023-09-28T04:23:18.381608+0000","last_peered":"2023-09-28T04:23:18.381608+0000","last_clean":"2023-09-28T04:23:18.381608+0000","last_became_active":"2023-09-28T04:23:17.910887+0000","last_became_peered":"2023-09-28T04:23:17.910887+0000","last_unstale":"2023-09-28T04:23:18.381608+0000","last_undegraded":"2023-09-28T04:23:18.381608+0000","last_fullsized":"2023-09-28T04:23:18.381608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397818+0000","last_change":"2023-09-28T04:23:18.387932+0000","last_active":"2023-09-28T04:23:18.397818+0000","last_peered":"2023-09-28T04:23:18.397818+0000","last_clean":"2023-09-28T04:23:18.397818+0000","last_became_active":"2023-09-28T04:23:18.387667+0000","last_became_peered":"2023-09-28T04:23:18.387667+0000","last_unstale":"2023-09-28T04:23:18.397818+0000","last_undegraded":"2023-09-28T04:23:18.397818+0000","last_fullsized":"2023-09-28T04:23:18.397818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:46:23.383130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.376247+0000","last_change":"2023-09-28T04:23:17.911764+0000","last_active":"2023-09-28T04:23:18.376247+0000","last_peered":"2023-09-28T04:23:18.376247+0000","last_clean":"2023-09-28T04:23:18.376247+0000","last_became_active":"2023-09-28T04:23:17.911458+0000","last_became_peered":"2023-09-28T04:23:17.911458+0000","last_unstale":"2023-09-28T04:23:18.376247+0000","last_undegraded":"2023-09-28T04:23:18.376247+0000","last_fullsized":"2023-09-28T04:23:18.376247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402635+0000","last_change":"2023-09-28T04:23:18.400278+0000","last_active":"2023-09-28T04:23:18.402635+0000","last_peered":"2023-09-28T04:23:18.402635+0000","last_clean":"2023-09-28T04:23:18.402635+0000","last_became_active":"2023-09-28T04:23:18.399957+0000","last_became_peered":"2023-09-28T04:23:18.399957+0000","last_unstale":"2023-09-28T04:23:18.402635+0000","last_undegraded":"2023-09-28T04:23:18.402635+0000","last_fullsized":"2023-09-28T04:23:18.402635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:01:52.295558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377068+0000","last_change":"2023-09-28T04:23:13.017727+0000","last_active":"2023-09-28T04:23:18.377068+0000","last_peered":"2023-09-28T04:23:18.377068+0000","last_clean":"2023-09-28T04:23:18.377068+0000","last_became_active":"2023-09-28T04:23:13.017362+0000","last_became_peered":"2023-09-28T04:23:13.017362+0000","last_unstale":"2023-09-28T04:23:18.377068+0000","last_undegraded":"2023-09-28T04:23:18.377068+0000","last_fullsized":"2023-09-28T04:23:18.377068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.382209+0000","last_change":"2023-09-28T04:23:17.899128+0000","last_active":"2023-09-28T04:23:18.382209+0000","last_peered":"2023-09-28T04:23:18.382209+0000","last_clean":"2023-09-28T04:23:18.382209+0000","last_became_active":"2023-09-28T04:23:17.898878+0000","last_became_peered":"2023-09-28T04:23:17.898878+0000","last_unstale":"2023-09-28T04:23:18.382209+0000","last_undegraded":"2023-09-28T04:23:18.382209+0000","last_fullsized":"2023-09-28T04:23:18.382209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388439+0000","last_change":"2023-09-28T04:23:18.384565+0000","last_active":"2023-09-28T04:23:18.388439+0000","last_peered":"2023-09-28T04:23:18.388439+0000","last_clean":"2023-09-28T04:23:18.388439+0000","last_became_active":"2023-09-28T04:23:18.383969+0000","last_became_peered":"2023-09-28T04:23:18.383969+0000","last_unstale":"2023-09-28T04:23:18.388439+0000","last_undegraded":"2023-09-28T04:23:18.388439+0000","last_fullsized":"2023-09-28T04:23:18.388439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379488+0000","last_change":"2023-09-28T04:23:12.604091+0000","last_active":"2023-09-28T04:23:18.379488+0000","last_peered":"2023-09-28T04:23:18.379488+0000","last_clean":"2023-09-28T04:23:18.379488+0000","last_became_active":"2023-09-28T04:23:12.603804+0000","last_became_peered":"2023-09-28T04:23:12.603804+0000","last_unstale":"2023-09-28T04:23:18.379488+0000","last_undegraded":"2023-09-28T04:23:18.379488+0000","last_fullsized":"2023-09-28T04:23:18.379488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.382008+0000","last_change":"2023-09-28T04:23:17.918999+0000","last_active":"2023-09-28T04:23:18.382008+0000","last_peered":"2023-09-28T04:23:18.382008+0000","last_clean":"2023-09-28T04:23:18.382008+0000","last_became_active":"2023-09-28T04:23:17.918740+0000","last_became_peered":"2023-09-28T04:23:17.918740+0000","last_unstale":"2023-09-28T04:23:18.382008+0000","last_undegraded":"2023-09-28T04:23:18.382008+0000","last_fullsized":"2023-09-28T04:23:18.382008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395808+0000","last_change":"2023-09-28T04:23:18.389350+0000","last_active":"2023-09-28T04:23:18.395808+0000","last_peered":"2023-09-28T04:23:18.395808+0000","last_clean":"2023-09-28T04:23:18.395808+0000","last_became_active":"2023-09-28T04:23:18.389059+0000","last_became_peered":"2023-09-28T04:23:18.389059+0000","last_unstale":"2023-09-28T04:23:18.395808+0000","last_undegraded":"2023-09-28T04:23:18.395808+0000","last_fullsized":"2023-09-28T04:23:18.395808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.898334+0000","last_change":"2023-09-28T04:23:12.602100+0000","last_active":"2023-09-28T04:23:17.898334+0000","last_peered":"2023-09-28T04:23:17.898334+0000","last_clean":"2023-09-28T04:23:17.898334+0000","last_became_active":"2023-09-28T04:23:12.601652+0000","last_became_peered":"2023-09-28T04:23:12.601652+0000","last_unstale":"2023-09-28T04:23:17.898334+0000","last_undegraded":"2023-09-28T04:23:17.898334+0000","last_fullsized":"2023-09-28T04:23:17.898334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:37:16.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.376176+0000","last_change":"2023-09-28T04:23:17.911566+0000","last_active":"2023-09-28T04:23:18.376176+0000","last_peered":"2023-09-28T04:23:18.376176+0000","last_clean":"2023-09-28T04:23:18.376176+0000","last_became_active":"2023-09-28T04:23:17.911308+0000","last_became_peered":"2023-09-28T04:23:17.911308+0000","last_unstale":"2023-09-28T04:23:18.376176+0000","last_undegraded":"2023-09-28T04:23:18.376176+0000","last_fullsized":"2023-09-28T04:23:18.376176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395489+0000","last_change":"2023-09-28T04:23:18.388204+0000","last_active":"2023-09-28T04:23:18.395489+0000","last_peered":"2023-09-28T04:23:18.395489+0000","last_clean":"2023-09-28T04:23:18.395489+0000","last_became_active":"2023-09-28T04:23:18.387945+0000","last_became_peered":"2023-09-28T04:23:18.387945+0000","last_unstale":"2023-09-28T04:23:18.395489+0000","last_undegraded":"2023-09-28T04:23:18.395489+0000","last_fullsized":"2023-09-28T04:23:18.395489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378668+0000","last_change":"2023-09-28T04:23:12.604212+0000","last_active":"2023-09-28T04:23:18.378668+0000","last_peered":"2023-09-28T04:23:18.378668+0000","last_clean":"2023-09-28T04:23:18.378668+0000","last_became_active":"2023-09-28T04:23:12.603930+0000","last_became_peered":"2023-09-28T04:23:12.603930+0000","last_unstale":"2023-09-28T04:23:18.378668+0000","last_undegraded":"2023-09-28T04:23:18.378668+0000","last_fullsized":"2023-09-28T04:23:18.378668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.900147+0000","last_change":"2023-09-28T04:23:11.608534+0000","last_active":"2023-09-28T04:23:17.900147+0000","last_peered":"2023-09-28T04:23:17.900147+0000","last_clean":"2023-09-28T04:23:17.900147+0000","last_became_active":"2023-09-28T04:23:11.608249+0000","last_became_peered":"2023-09-28T04:23:11.608249+0000","last_unstale":"2023-09-28T04:23:17.900147+0000","last_undegraded":"2023-09-28T04:23:17.900147+0000","last_fullsized":"2023-09-28T04:23:17.900147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_clean_scrub_stamp":"2023-09-28T04:23:10.587579+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:10.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.375491+0000","last_change":"2023-09-28T04:23:17.902709+0000","last_active":"2023-09-28T04:23:18.375491+0000","last_peered":"2023-09-28T04:23:18.375491+0000","last_clean":"2023-09-28T04:23:18.375491+0000","last_became_active":"2023-09-28T04:23:17.902341+0000","last_became_peered":"2023-09-28T04:23:17.902341+0000","last_unstale":"2023-09-28T04:23:18.375491+0000","last_undegraded":"2023-09-28T04:23:18.375491+0000","last_fullsized":"2023-09-28T04:23:18.375491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.389982+0000","last_change":"2023-09-28T04:23:18.389982+0000","last_active":"2023-09-28T04:23:18.389982+0000","last_peered":"2023-09-28T04:23:18.389982+0000","last_clean":"2023-09-28T04:23:18.389982+0000","last_became_active":"2023-09-28T04:23:18.389692+0000","last_became_peered":"2023-09-28T04:23:18.389692+0000","last_unstale":"2023-09-28T04:23:18.389982+0000","last_undegraded":"2023-09-28T04:23:18.389982+0000","last_fullsized":"2023-09-28T04:23:18.389982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.900240+0000","last_change":"2023-09-28T04:23:12.605908+0000","last_active":"2023-09-28T04:23:17.900240+0000","last_peered":"2023-09-28T04:23:17.900240+0000","last_clean":"2023-09-28T04:23:17.900240+0000","last_became_active":"2023-09-28T04:23:12.605668+0000","last_became_peered":"2023-09-28T04:23:12.605668+0000","last_unstale":"2023-09-28T04:23:17.900240+0000","last_undegraded":"2023-09-28T04:23:17.900240+0000","last_fullsized":"2023-09-28T04:23:17.900240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.919292+0000","last_change":"2023-09-28T04:23:17.918410+0000","last_active":"2023-09-28T04:23:17.919292+0000","last_peered":"2023-09-28T04:23:17.919292+0000","last_clean":"2023-09-28T04:23:17.919292+0000","last_became_active":"2023-09-28T04:23:17.918130+0000","last_became_peered":"2023-09-28T04:23:17.918130+0000","last_unstale":"2023-09-28T04:23:17.919292+0000","last_undegraded":"2023-09-28T04:23:17.919292+0000","last_fullsized":"2023-09-28T04:23:17.919292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391987+0000","last_change":"2023-09-28T04:23:18.391987+0000","last_active":"2023-09-28T04:23:18.391987+0000","last_peered":"2023-09-28T04:23:18.391987+0000","last_clean":"2023-09-28T04:23:18.391987+0000","last_became_active":"2023-09-28T04:23:18.391709+0000","last_became_peered":"2023-09-28T04:23:18.391709+0000","last_unstale":"2023-09-28T04:23:18.391987+0000","last_undegraded":"2023-09-28T04:23:18.391987+0000","last_fullsized":"2023-09-28T04:23:18.391987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.902188+0000","last_change":"2023-09-28T04:23:13.017715+0000","last_active":"2023-09-28T04:23:17.902188+0000","last_peered":"2023-09-28T04:23:17.902188+0000","last_clean":"2023-09-28T04:23:17.902188+0000","last_became_active":"2023-09-28T04:23:13.017398+0000","last_became_peered":"2023-09-28T04:23:13.017398+0000","last_unstale":"2023-09-28T04:23:17.902188+0000","last_undegraded":"2023-09-28T04:23:17.902188+0000","last_fullsized":"2023-09-28T04:23:17.902188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:37:41.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377174+0000","last_change":"2023-09-28T04:23:17.912291+0000","last_active":"2023-09-28T04:23:18.377174+0000","last_peered":"2023-09-28T04:23:18.377174+0000","last_clean":"2023-09-28T04:23:18.377174+0000","last_became_active":"2023-09-28T04:23:17.912023+0000","last_became_peered":"2023-09-28T04:23:17.912023+0000","last_unstale":"2023-09-28T04:23:18.377174+0000","last_undegraded":"2023-09-28T04:23:18.377174+0000","last_fullsized":"2023-09-28T04:23:18.377174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.396451+0000","last_change":"2023-09-28T04:23:18.396451+0000","last_active":"2023-09-28T04:23:18.396451+0000","last_peered":"2023-09-28T04:23:18.396451+0000","last_clean":"2023-09-28T04:23:18.396451+0000","last_became_active":"2023-09-28T04:23:18.396190+0000","last_became_peered":"2023-09-28T04:23:18.396190+0000","last_unstale":"2023-09-28T04:23:18.396451+0000","last_undegraded":"2023-09-28T04:23:18.396451+0000","last_fullsized":"2023-09-28T04:23:18.396451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.376475+0000","last_change":"2023-09-28T04:23:17.904739+0000","last_active":"2023-09-28T04:23:18.376475+0000","last_peered":"2023-09-28T04:23:18.376475+0000","last_clean":"2023-09-28T04:23:18.376475+0000","last_became_active":"2023-09-28T04:23:17.903844+0000","last_became_peered":"2023-09-28T04:23:17.903844+0000","last_unstale":"2023-09-28T04:23:18.376475+0000","last_undegraded":"2023-09-28T04:23:18.376475+0000","last_fullsized":"2023-09-28T04:23:18.376475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377634+0000","last_change":"2023-09-28T04:23:12.606496+0000","last_active":"2023-09-28T04:23:18.377634+0000","last_peered":"2023-09-28T04:23:18.377634+0000","last_clean":"2023-09-28T04:23:18.377634+0000","last_became_active":"2023-09-28T04:23:12.606143+0000","last_became_peered":"2023-09-28T04:23:12.606143+0000","last_unstale":"2023-09-28T04:23:18.377634+0000","last_undegraded":"2023-09-28T04:23:18.377634+0000","last_fullsized":"2023-09-28T04:23:18.377634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402487+0000","last_change":"2023-09-28T04:23:18.396153+0000","last_active":"2023-09-28T04:23:18.402487+0000","last_peered":"2023-09-28T04:23:18.402487+0000","last_clean":"2023-09-28T04:23:18.402487+0000","last_became_active":"2023-09-28T04:23:18.392092+0000","last_became_peered":"2023-09-28T04:23:18.392092+0000","last_unstale":"2023-09-28T04:23:18.402487+0000","last_undegraded":"2023-09-28T04:23:18.402487+0000","last_fullsized":"2023-09-28T04:23:18.402487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.901011+0000","last_change":"2023-09-28T04:23:12.606390+0000","last_active":"2023-09-28T04:23:17.901011+0000","last_peered":"2023-09-28T04:23:17.901011+0000","last_clean":"2023-09-28T04:23:17.901011+0000","last_became_active":"2023-09-28T04:23:12.605965+0000","last_became_peered":"2023-09-28T04:23:12.605965+0000","last_unstale":"2023-09-28T04:23:17.901011+0000","last_undegraded":"2023-09-28T04:23:17.901011+0000","last_fullsized":"2023-09-28T04:23:17.901011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:11.833839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.917737+0000","last_change":"2023-09-28T04:23:17.915114+0000","last_active":"2023-09-28T04:23:17.917737+0000","last_peered":"2023-09-28T04:23:17.917737+0000","last_clean":"2023-09-28T04:23:17.917737+0000","last_became_active":"2023-09-28T04:23:17.914697+0000","last_became_peered":"2023-09-28T04:23:17.914697+0000","last_unstale":"2023-09-28T04:23:17.917737+0000","last_undegraded":"2023-09-28T04:23:17.917737+0000","last_fullsized":"2023-09-28T04:23:17.917737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397753+0000","last_change":"2023-09-28T04:23:18.386681+0000","last_active":"2023-09-28T04:23:18.397753+0000","last_peered":"2023-09-28T04:23:18.397753+0000","last_clean":"2023-09-28T04:23:18.397753+0000","last_became_active":"2023-09-28T04:23:18.386380+0000","last_became_peered":"2023-09-28T04:23:18.386380+0000","last_unstale":"2023-09-28T04:23:18.397753+0000","last_undegraded":"2023-09-28T04:23:18.397753+0000","last_fullsized":"2023-09-28T04:23:18.397753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.919196+0000","last_change":"2023-09-28T04:23:17.918404+0000","last_active":"2023-09-28T04:23:17.919196+0000","last_peered":"2023-09-28T04:23:17.919196+0000","last_clean":"2023-09-28T04:23:17.919196+0000","last_became_active":"2023-09-28T04:23:17.918116+0000","last_became_peered":"2023-09-28T04:23:17.918116+0000","last_unstale":"2023-09-28T04:23:17.919196+0000","last_undegraded":"2023-09-28T04:23:17.919196+0000","last_fullsized":"2023-09-28T04:23:17.919196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.385213+0000","last_change":"2023-09-28T04:23:18.385213+0000","last_active":"2023-09-28T04:23:18.385213+0000","last_peered":"2023-09-28T04:23:18.385213+0000","last_clean":"2023-09-28T04:23:18.385213+0000","last_became_active":"2023-09-28T04:23:18.384930+0000","last_became_peered":"2023-09-28T04:23:18.384930+0000","last_unstale":"2023-09-28T04:23:18.385213+0000","last_undegraded":"2023-09-28T04:23:18.385213+0000","last_fullsized":"2023-09-28T04:23:18.385213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:06.681805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378748+0000","last_change":"2023-09-28T04:23:17.905986+0000","last_active":"2023-09-28T04:23:18.378748+0000","last_peered":"2023-09-28T04:23:18.378748+0000","last_clean":"2023-09-28T04:23:18.378748+0000","last_became_active":"2023-09-28T04:23:17.905667+0000","last_became_peered":"2023-09-28T04:23:17.905667+0000","last_unstale":"2023-09-28T04:23:18.378748+0000","last_undegraded":"2023-09-28T04:23:18.378748+0000","last_fullsized":"2023-09-28T04:23:18.378748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402551+0000","last_change":"2023-09-28T04:23:18.400970+0000","last_active":"2023-09-28T04:23:18.402551+0000","last_peered":"2023-09-28T04:23:18.402551+0000","last_clean":"2023-09-28T04:23:18.402551+0000","last_became_active":"2023-09-28T04:23:18.400683+0000","last_became_peered":"2023-09-28T04:23:18.400683+0000","last_unstale":"2023-09-28T04:23:18.402551+0000","last_undegraded":"2023-09-28T04:23:18.402551+0000","last_fullsized":"2023-09-28T04:23:18.402551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:59:30.982762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379144+0000","last_change":"2023-09-28T04:23:17.905162+0000","last_active":"2023-09-28T04:23:18.379144+0000","last_peered":"2023-09-28T04:23:18.379144+0000","last_clean":"2023-09-28T04:23:18.379144+0000","last_became_active":"2023-09-28T04:23:17.904895+0000","last_became_peered":"2023-09-28T04:23:17.904895+0000","last_unstale":"2023-09-28T04:23:18.379144+0000","last_undegraded":"2023-09-28T04:23:18.379144+0000","last_fullsized":"2023-09-28T04:23:18.379144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402543+0000","last_change":"2023-09-28T04:23:18.400714+0000","last_active":"2023-09-28T04:23:18.402543+0000","last_peered":"2023-09-28T04:23:18.402543+0000","last_clean":"2023-09-28T04:23:18.402543+0000","last_became_active":"2023-09-28T04:23:18.400410+0000","last_became_peered":"2023-09-28T04:23:18.400410+0000","last_unstale":"2023-09-28T04:23:18.402543+0000","last_undegraded":"2023-09-28T04:23:18.402543+0000","last_fullsized":"2023-09-28T04:23:18.402543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:43:02.603601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.375466+0000","last_change":"2023-09-28T04:23:17.905493+0000","last_active":"2023-09-28T04:23:18.375466+0000","last_peered":"2023-09-28T04:23:18.375466+0000","last_clean":"2023-09-28T04:23:18.375466+0000","last_became_active":"2023-09-28T04:23:17.905198+0000","last_became_peered":"2023-09-28T04:23:17.905198+0000","last_unstale":"2023-09-28T04:23:18.375466+0000","last_undegraded":"2023-09-28T04:23:18.375466+0000","last_fullsized":"2023-09-28T04:23:18.375466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402220+0000","last_change":"2023-09-28T04:23:18.393194+0000","last_active":"2023-09-28T04:23:18.402220+0000","last_peered":"2023-09-28T04:23:18.402220+0000","last_clean":"2023-09-28T04:23:18.402220+0000","last_became_active":"2023-09-28T04:23:18.392400+0000","last_became_peered":"2023-09-28T04:23:18.392400+0000","last_unstale":"2023-09-28T04:23:18.402220+0000","last_undegraded":"2023-09-28T04:23:18.402220+0000","last_fullsized":"2023-09-28T04:23:18.402220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.918760+0000","last_change":"2023-09-28T04:23:17.917604+0000","last_active":"2023-09-28T04:23:17.918760+0000","last_peered":"2023-09-28T04:23:17.918760+0000","last_clean":"2023-09-28T04:23:17.918760+0000","last_became_active":"2023-09-28T04:23:17.917266+0000","last_became_peered":"2023-09-28T04:23:17.917266+0000","last_unstale":"2023-09-28T04:23:17.918760+0000","last_undegraded":"2023-09-28T04:23:17.918760+0000","last_fullsized":"2023-09-28T04:23:17.918760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395284+0000","last_change":"2023-09-28T04:23:18.386391+0000","last_active":"2023-09-28T04:23:18.395284+0000","last_peered":"2023-09-28T04:23:18.395284+0000","last_clean":"2023-09-28T04:23:18.395284+0000","last_became_active":"2023-09-28T04:23:18.386051+0000","last_became_peered":"2023-09-28T04:23:18.386051+0000","last_unstale":"2023-09-28T04:23:18.395284+0000","last_undegraded":"2023-09-28T04:23:18.395284+0000","last_fullsized":"2023-09-28T04:23:18.395284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.389600+0000","last_change":"2023-09-28T04:23:18.389600+0000","last_active":"2023-09-28T04:23:18.389600+0000","last_peered":"2023-09-28T04:23:18.389600+0000","last_clean":"2023-09-28T04:23:18.389600+0000","last_became_active":"2023-09-28T04:23:18.389280+0000","last_became_peered":"2023-09-28T04:23:18.389280+0000","last_unstale":"2023-09-28T04:23:18.389600+0000","last_undegraded":"2023-09-28T04:23:18.389600+0000","last_fullsized":"2023-09-28T04:23:18.389600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:47.697305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402201+0000","last_change":"2023-09-28T04:23:18.392980+0000","last_active":"2023-09-28T04:23:18.402201+0000","last_peered":"2023-09-28T04:23:18.402201+0000","last_clean":"2023-09-28T04:23:18.402201+0000","last_became_active":"2023-09-28T04:23:18.390929+0000","last_became_peered":"2023-09-28T04:23:18.390929+0000","last_unstale":"2023-09-28T04:23:18.402201+0000","last_undegraded":"2023-09-28T04:23:18.402201+0000","last_fullsized":"2023-09-28T04:23:18.402201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397834+0000","last_change":"2023-09-28T04:23:18.387348+0000","last_active":"2023-09-28T04:23:18.397834+0000","last_peered":"2023-09-28T04:23:18.397834+0000","last_clean":"2023-09-28T04:23:18.397834+0000","last_became_active":"2023-09-28T04:23:18.385870+0000","last_became_peered":"2023-09-28T04:23:18.385870+0000","last_unstale":"2023-09-28T04:23:18.397834+0000","last_undegraded":"2023-09-28T04:23:18.397834+0000","last_fullsized":"2023-09-28T04:23:18.397834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:29:04.985060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402660+0000","last_change":"2023-09-28T04:23:18.392534+0000","last_active":"2023-09-28T04:23:18.402660+0000","last_peered":"2023-09-28T04:23:18.402660+0000","last_clean":"2023-09-28T04:23:18.402660+0000","last_became_active":"2023-09-28T04:23:18.392245+0000","last_became_peered":"2023-09-28T04:23:18.392245+0000","last_unstale":"2023-09-28T04:23:18.402660+0000","last_undegraded":"2023-09-28T04:23:18.402660+0000","last_fullsized":"2023-09-28T04:23:18.402660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395827+0000","last_change":"2023-09-28T04:23:18.391490+0000","last_active":"2023-09-28T04:23:18.395827+0000","last_peered":"2023-09-28T04:23:18.395827+0000","last_clean":"2023-09-28T04:23:18.395827+0000","last_became_active":"2023-09-28T04:23:18.391256+0000","last_became_peered":"2023-09-28T04:23:18.391256+0000","last_unstale":"2023-09-28T04:23:18.395827+0000","last_undegraded":"2023-09-28T04:23:18.395827+0000","last_fullsized":"2023-09-28T04:23:18.395827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:28:43.639301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8912,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362928,"statfs":{"total":96636764160,"available":96627638272,"internally_reserved":0,"allocated":270336,"data_stored":662956,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8336,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363504,"statfs":{"total":96636764160,"available":96628228096,"internally_reserved":0,"allocated":204800,"data_stored":72588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.524}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.8940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8400,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363440,"statfs":{"total":96636764160,"available":96628162560,"internally_reserved":0,"allocated":204800,"data_stored":72588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8912,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362928,"statfs":{"total":96636764160,"available":96627638272,"internally_reserved":0,"allocated":270336,"data_stored":662956,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8272,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363568,"statfs":{"total":96636764160,"available":96628293632,"internally_reserved":0,"allocated":204800,"data_stored":72588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8336,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363504,"statfs":{"total":96636764160,"available":96628228096,"internally_reserved":0,"allocated":204800,"data_stored":72588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8400,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363440,"statfs":{"total":96636764160,"available":96628162560,"internally_reserved":0,"allocated":204800,"data_stored":72588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8336,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363504,"statfs":{"total":96636764160,"available":96628228096,"internally_reserved":0,"allocated":204800,"data_stored":72588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T04:23:24.723 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T04:23:24.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.946+0000 7fb8245ff700 1 Processor -- start 2023-09-28T04:23:24.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.946+0000 7fb8245ff700 1 -- start start 2023-09-28T04:23:24.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.947+0000 7fb8245ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb81c14fa90 0x7fb81c156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.947+0000 7fb8245ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb81c14fe60 0x7fb81c068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.947+0000 7fb8245ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb81c0c84c0 0x7fb81c0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.947+0000 7fb8245ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81c0c8030 con 0x7fb81c14fa90 2023-09-28T04:23:24.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.947+0000 7fb8245ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81c0c7180 con 0x7fb81c14fe60 2023-09-28T04:23:24.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.947+0000 7fb8245ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c0c7420 con 0x7fb81c0c84c0 2023-09-28T04:23:24.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.947+0000 7fb82239b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb81c14fa90 0x7fb81c156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.947+0000 7fb82239b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb81c14fa90 0x7fb81c156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45352/0 (socket says 172.21.15.118:45352) 2023-09-28T04:23:24.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.947+0000 7fb82239b700 1 -- 172.21.15.118:0/290542110 learned_addr learned my addr 172.21.15.118:0/290542110 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:24.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.947+0000 7fb822b9c700 1 --2- 172.21.15.118:0/290542110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb81c0c84c0 0x7fb81c0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.947+0000 7fb821b9a700 1 --2- 172.21.15.118:0/290542110 >> v2:172.21.15.174:3300/0 conn(0x7fb81c14fe60 0x7fb81c068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.948+0000 7fb82239b700 1 -- 172.21.15.118:0/290542110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb81c0c84c0 msgr2=0x7fb81c0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:24.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.948+0000 7fb82239b700 1 --2- 172.21.15.118:0/290542110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb81c0c84c0 0x7fb81c0cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.948+0000 7fb82239b700 1 -- 172.21.15.118:0/290542110 >> v2:172.21.15.174:3300/0 conn(0x7fb81c14fe60 msgr2=0x7fb81c068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:24.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.948+0000 7fb82239b700 1 --2- 172.21.15.118:0/290542110 >> v2:172.21.15.174:3300/0 conn(0x7fb81c14fe60 0x7fb81c068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.948+0000 7fb82239b700 1 -- 172.21.15.118:0/290542110 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c0c7700 con 0x7fb81c14fa90 2023-09-28T04:23:24.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.948+0000 7fb82239b700 1 --2- 172.21.15.118:0/290542110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb81c14fa90 0x7fb81c156430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb81c070fb0 tx=0x7fb818009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d846c6b6bc28843c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:24.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.948+0000 7fb821399700 1 -- 172.21.15.118:0/290542110 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81800b860 con 0x7fb81c14fa90 2023-09-28T04:23:24.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.948+0000 7fb821399700 1 -- 172.21.15.118:0/290542110 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81800b9c0 con 0x7fb81c14fa90 2023-09-28T04:23:24.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.948+0000 7fb821399700 1 -- 172.21.15.118:0/290542110 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81800bd60 con 0x7fb81c14fa90 2023-09-28T04:23:24.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.949+0000 7fb8245ff700 1 -- 172.21.15.118:0/290542110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb81c14fa90 msgr2=0x7fb81c156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.949+0000 7fb8245ff700 1 --2- 172.21.15.118:0/290542110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb81c14fa90 0x7fb81c156430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb81c070fb0 tx=0x7fb818009250 comp rx=0 tx=0).stop 2023-09-28T04:23:24.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.949+0000 7fb8245ff700 1 -- 172.21.15.118:0/290542110 shutdown_connections 2023-09-28T04:23:24.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.949+0000 7fb8245ff700 1 --2- 172.21.15.118:0/290542110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb81c0c84c0 0x7fb81c0cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.949+0000 7fb8245ff700 1 --2- 172.21.15.118:0/290542110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb81c14fa90 0x7fb81c156430 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.949+0000 7fb8245ff700 1 --2- 172.21.15.118:0/290542110 >> v2:172.21.15.174:3300/0 conn(0x7fb81c14fe60 0x7fb81c068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.949+0000 7fb8245ff700 1 -- 172.21.15.118:0/290542110 >> 172.21.15.118:0/290542110 conn(0x7fb81c063cd0 msgr2=0x7fb81c0cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:24.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.949+0000 7fb8245ff700 1 -- 172.21.15.118:0/290542110 shutdown_connections 2023-09-28T04:23:24.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.949+0000 7fb8245ff700 1 -- 172.21.15.118:0/290542110 wait complete. 2023-09-28T04:23:24.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.950+0000 7fb8245ff700 1 Processor -- start 2023-09-28T04:23:24.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.950+0000 7fb8245ff700 1 -- start start 2023-09-28T04:23:24.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.951+0000 7fb8245ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb81c0c84c0 0x7fb81c165dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.951+0000 7fb8245ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb81c14fa90 0x7fb81c169d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.951+0000 7fb8245ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb81c14fe60 0x7fb81c14e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.951+0000 7fb8245ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c0c4a00 con 0x7fb81c14fe60 2023-09-28T04:23:24.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.951+0000 7fb8245ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c0c5a50 con 0x7fb81c14fa90 2023-09-28T04:23:24.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.951+0000 7fb8245ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c16a280 con 0x7fb81c0c84c0 2023-09-28T04:23:24.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.951+0000 7fb822b9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb81c14fe60 0x7fb81c14e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.951+0000 7fb822b9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb81c14fe60 0x7fb81c14e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45366/0 (socket says 172.21.15.118:45366) 2023-09-28T04:23:24.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.952+0000 7fb822b9c700 1 -- 172.21.15.118:0/2419278072 learned_addr learned my addr 172.21.15.118:0/2419278072 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:24.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.952+0000 7fb821b9a700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb81c14fa90 0x7fb81c169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.952+0000 7fb82239b700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb81c0c84c0 0x7fb81c165dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.952+0000 7fb822b9c700 1 -- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb81c0c84c0 msgr2=0x7fb81c165dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.952+0000 7fb822b9c700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb81c0c84c0 0x7fb81c165dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.952+0000 7fb822b9c700 1 -- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb81c14fa90 msgr2=0x7fb81c169d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:24.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.952+0000 7fb822b9c700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb81c14fa90 0x7fb81c169d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:24.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.952+0000 7fb822b9c700 1 -- 172.21.15.118:0/2419278072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8180094f0 con 0x7fb81c14fe60 2023-09-28T04:23:24.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.952+0000 7fb822b9c700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb81c14fe60 0x7fb81c14e840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb814007f20 tx=0x7fb814009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:24.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.952+0000 7fb8127fc700 1 -- 172.21.15.118:0/2419278072 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81400eb30 con 0x7fb81c14fe60 2023-09-28T04:23:24.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.952+0000 7fb8127fc700 1 -- 172.21.15.118:0/2419278072 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81400ecb0 con 0x7fb81c14fe60 2023-09-28T04:23:24.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.952+0000 7fb8127fc700 1 -- 172.21.15.118:0/2419278072 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814014670 con 0x7fb81c14fe60 2023-09-28T04:23:24.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.952+0000 7fb8245ff700 1 -- 172.21.15.118:0/2419278072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81c1698b0 con 0x7fb81c14fe60 2023-09-28T04:23:24.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.953+0000 7fb8245ff700 1 -- 172.21.15.118:0/2419278072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81c0c4720 con 0x7fb81c14fe60 2023-09-28T04:23:24.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.953+0000 7fb8245ff700 1 -- 172.21.15.118:0/2419278072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81c169a40 con 0x7fb81c14fe60 2023-09-28T04:23:24.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.954+0000 7fb8127fc700 1 -- 172.21.15.118:0/2419278072 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb8140149e0 con 0x7fb81c14fe60 2023-09-28T04:23:24.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.955+0000 7fb8127fc700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb800067360 0x7fb800069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:24.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.955+0000 7fb8127fc700 1 -- 172.21.15.118:0/2419278072 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb814085130 con 0x7fb81c14fe60 2023-09-28T04:23:24.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.955+0000 7fb82239b700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb800067360 0x7fb800069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:24.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.956+0000 7fb82239b700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb800067360 0x7fb800069810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb81c070fb0 tx=0x7fb818017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:24.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:24.959+0000 7fb8127fc700 1 -- 172.21.15.118:0/2419278072 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb814051f90 con 0x7fb81c14fe60 2023-09-28T04:23:25.145 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.144+0000 7fb8245ff700 1 -- 172.21.15.118:0/2419278072 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb81c071980 con 0x7fb800067360 2023-09-28T04:23:25.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.153+0000 7fb8127fc700 1 -- 172.21.15.118:0/2419278072 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284766 (secure 0 0 0) 0x7fb81c071980 con 0x7fb800067360 2023-09-28T04:23:25.157 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:25.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.157+0000 7fb8245ff700 1 -- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb800067360 msgr2=0x7fb800069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:25.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.157+0000 7fb8245ff700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb800067360 0x7fb800069810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb81c070fb0 tx=0x7fb818017000 comp rx=0 tx=0).stop 2023-09-28T04:23:25.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.157+0000 7fb8245ff700 1 -- 172.21.15.118:0/2419278072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb81c14fe60 msgr2=0x7fb81c14e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:25.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.157+0000 7fb8245ff700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb81c14fe60 0x7fb81c14e840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb814007f20 tx=0x7fb814009860 comp rx=0 tx=0).stop 2023-09-28T04:23:25.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.157+0000 7fb8245ff700 1 -- 172.21.15.118:0/2419278072 shutdown_connections 2023-09-28T04:23:25.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.157+0000 7fb8245ff700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb800067360 0x7fb800069810 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.157+0000 7fb8245ff700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb81c14fe60 0x7fb81c14e840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.157+0000 7fb8245ff700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb81c0c84c0 0x7fb81c165dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.157+0000 7fb8245ff700 1 --2- 172.21.15.118:0/2419278072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb81c14fa90 0x7fb81c169d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.157+0000 7fb8245ff700 1 -- 172.21.15.118:0/2419278072 >> 172.21.15.118:0/2419278072 conn(0x7fb81c063cd0 msgr2=0x7fb81c14dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:25.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.157+0000 7fb8245ff700 1 -- 172.21.15.118:0/2419278072 shutdown_connections 2023-09-28T04:23:25.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.157+0000 7fb8245ff700 1 -- 172.21.15.118:0/2419278072 wait complete. 2023-09-28T04:23:25.160 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-09-28T04:23:25.174 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-09-28T04:23:24.525876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67904,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":66112,"kb_avail":754906816,"statfs":{"total":773094113280,"available":773024579584,"internally_reserved":0,"allocated":1769472,"data_stored":1761440,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":67698688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.635689"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400475+0000","last_change":"2023-09-28T04:23:18.400475+0000","last_active":"2023-09-28T04:23:18.400475+0000","last_peered":"2023-09-28T04:23:18.400475+0000","last_clean":"2023-09-28T04:23:18.400475+0000","last_became_active":"2023-09-28T04:23:18.400107+0000","last_became_peered":"2023-09-28T04:23:18.400107+0000","last_unstale":"2023-09-28T04:23:18.400475+0000","last_undegraded":"2023-09-28T04:23:18.400475+0000","last_fullsized":"2023-09-28T04:23:18.400475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:44.340279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391569+0000","last_change":"2023-09-28T04:23:18.385136+0000","last_active":"2023-09-28T04:23:18.391569+0000","last_peered":"2023-09-28T04:23:18.391569+0000","last_clean":"2023-09-28T04:23:18.391569+0000","last_became_active":"2023-09-28T04:23:18.384789+0000","last_became_peered":"2023-09-28T04:23:18.384789+0000","last_unstale":"2023-09-28T04:23:18.391569+0000","last_undegraded":"2023-09-28T04:23:18.391569+0000","last_fullsized":"2023-09-28T04:23:18.391569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397939+0000","last_change":"2023-09-28T04:23:18.393700+0000","last_active":"2023-09-28T04:23:18.397939+0000","last_peered":"2023-09-28T04:23:18.397939+0000","last_clean":"2023-09-28T04:23:18.397939+0000","last_became_active":"2023-09-28T04:23:18.390599+0000","last_became_peered":"2023-09-28T04:23:18.390599+0000","last_unstale":"2023-09-28T04:23:18.397939+0000","last_undegraded":"2023-09-28T04:23:18.397939+0000","last_fullsized":"2023-09-28T04:23:18.397939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:43:19.782618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390865+0000","last_change":"2023-09-28T04:23:18.390865+0000","last_active":"2023-09-28T04:23:18.390865+0000","last_peered":"2023-09-28T04:23:18.390865+0000","last_clean":"2023-09-28T04:23:18.390865+0000","last_became_active":"2023-09-28T04:23:18.390607+0000","last_became_peered":"2023-09-28T04:23:18.390607+0000","last_unstale":"2023-09-28T04:23:18.390865+0000","last_undegraded":"2023-09-28T04:23:18.390865+0000","last_fullsized":"2023-09-28T04:23:18.390865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404215+0000","last_change":"2023-09-28T04:23:18.404215+0000","last_active":"2023-09-28T04:23:18.404215+0000","last_peered":"2023-09-28T04:23:18.404215+0000","last_clean":"2023-09-28T04:23:18.404215+0000","last_became_active":"2023-09-28T04:23:18.403960+0000","last_became_peered":"2023-09-28T04:23:18.403960+0000","last_unstale":"2023-09-28T04:23:18.404215+0000","last_undegraded":"2023-09-28T04:23:18.404215+0000","last_fullsized":"2023-09-28T04:23:18.404215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397969+0000","last_change":"2023-09-28T04:23:18.393987+0000","last_active":"2023-09-28T04:23:18.397969+0000","last_peered":"2023-09-28T04:23:18.397969+0000","last_clean":"2023-09-28T04:23:18.397969+0000","last_became_active":"2023-09-28T04:23:18.390575+0000","last_became_peered":"2023-09-28T04:23:18.390575+0000","last_unstale":"2023-09-28T04:23:18.397969+0000","last_undegraded":"2023-09-28T04:23:18.397969+0000","last_fullsized":"2023-09-28T04:23:18.397969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:24:51.659204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.396733+0000","last_change":"2023-09-28T04:23:18.396733+0000","last_active":"2023-09-28T04:23:18.396733+0000","last_peered":"2023-09-28T04:23:18.396733+0000","last_clean":"2023-09-28T04:23:18.396733+0000","last_became_active":"2023-09-28T04:23:18.396038+0000","last_became_peered":"2023-09-28T04:23:18.396038+0000","last_unstale":"2023-09-28T04:23:18.396733+0000","last_undegraded":"2023-09-28T04:23:18.396733+0000","last_fullsized":"2023-09-28T04:23:18.396733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391542+0000","last_change":"2023-09-28T04:23:18.388208+0000","last_active":"2023-09-28T04:23:18.391542+0000","last_peered":"2023-09-28T04:23:18.391542+0000","last_clean":"2023-09-28T04:23:18.391542+0000","last_became_active":"2023-09-28T04:23:18.387260+0000","last_became_peered":"2023-09-28T04:23:18.387260+0000","last_unstale":"2023-09-28T04:23:18.391542+0000","last_undegraded":"2023-09-28T04:23:18.391542+0000","last_fullsized":"2023-09-28T04:23:18.391542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.403803+0000","last_change":"2023-09-28T04:23:18.403803+0000","last_active":"2023-09-28T04:23:18.403803+0000","last_peered":"2023-09-28T04:23:18.403803+0000","last_clean":"2023-09-28T04:23:18.403803+0000","last_became_active":"2023-09-28T04:23:18.403565+0000","last_became_peered":"2023-09-28T04:23:18.403565+0000","last_unstale":"2023-09-28T04:23:18.403803+0000","last_undegraded":"2023-09-28T04:23:18.403803+0000","last_fullsized":"2023-09-28T04:23:18.403803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397774+0000","last_change":"2023-09-28T04:23:18.392418+0000","last_active":"2023-09-28T04:23:18.397774+0000","last_peered":"2023-09-28T04:23:18.397774+0000","last_clean":"2023-09-28T04:23:18.397774+0000","last_became_active":"2023-09-28T04:23:18.390911+0000","last_became_peered":"2023-09-28T04:23:18.390911+0000","last_unstale":"2023-09-28T04:23:18.397774+0000","last_undegraded":"2023-09-28T04:23:18.397774+0000","last_fullsized":"2023-09-28T04:23:18.397774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397957+0000","last_change":"2023-09-28T04:23:18.393845+0000","last_active":"2023-09-28T04:23:18.397957+0000","last_peered":"2023-09-28T04:23:18.397957+0000","last_clean":"2023-09-28T04:23:18.397957+0000","last_became_active":"2023-09-28T04:23:18.393524+0000","last_became_peered":"2023-09-28T04:23:18.393524+0000","last_unstale":"2023-09-28T04:23:18.397957+0000","last_undegraded":"2023-09-28T04:23:18.397957+0000","last_fullsized":"2023-09-28T04:23:18.397957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:27:39.596054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.385250+0000","last_change":"2023-09-28T04:23:18.385250+0000","last_active":"2023-09-28T04:23:18.385250+0000","last_peered":"2023-09-28T04:23:18.385250+0000","last_clean":"2023-09-28T04:23:18.385250+0000","last_became_active":"2023-09-28T04:23:18.384986+0000","last_became_peered":"2023-09-28T04:23:18.384986+0000","last_unstale":"2023-09-28T04:23:18.385250+0000","last_undegraded":"2023-09-28T04:23:18.385250+0000","last_fullsized":"2023-09-28T04:23:18.385250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:15.500469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402417+0000","last_change":"2023-09-28T04:23:18.402417+0000","last_active":"2023-09-28T04:23:18.402417+0000","last_peered":"2023-09-28T04:23:18.402417+0000","last_clean":"2023-09-28T04:23:18.402417+0000","last_became_active":"2023-09-28T04:23:18.402161+0000","last_became_peered":"2023-09-28T04:23:18.402161+0000","last_unstale":"2023-09-28T04:23:18.402417+0000","last_undegraded":"2023-09-28T04:23:18.402417+0000","last_fullsized":"2023-09-28T04:23:18.402417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:50.909915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391345+0000","last_change":"2023-09-28T04:23:18.387808+0000","last_active":"2023-09-28T04:23:18.391345+0000","last_peered":"2023-09-28T04:23:18.391345+0000","last_clean":"2023-09-28T04:23:18.391345+0000","last_became_active":"2023-09-28T04:23:18.387471+0000","last_became_peered":"2023-09-28T04:23:18.387471+0000","last_unstale":"2023-09-28T04:23:18.391345+0000","last_undegraded":"2023-09-28T04:23:18.391345+0000","last_fullsized":"2023-09-28T04:23:18.391345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.396945+0000","last_change":"2023-09-28T04:23:18.396945+0000","last_active":"2023-09-28T04:23:18.396945+0000","last_peered":"2023-09-28T04:23:18.396945+0000","last_clean":"2023-09-28T04:23:18.396945+0000","last_became_active":"2023-09-28T04:23:18.396395+0000","last_became_peered":"2023-09-28T04:23:18.396395+0000","last_unstale":"2023-09-28T04:23:18.396945+0000","last_undegraded":"2023-09-28T04:23:18.396945+0000","last_fullsized":"2023-09-28T04:23:18.396945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397971+0000","last_change":"2023-09-28T04:23:18.393975+0000","last_active":"2023-09-28T04:23:18.397971+0000","last_peered":"2023-09-28T04:23:18.397971+0000","last_clean":"2023-09-28T04:23:18.397971+0000","last_became_active":"2023-09-28T04:23:18.393683+0000","last_became_peered":"2023-09-28T04:23:18.393683+0000","last_unstale":"2023-09-28T04:23:18.397971+0000","last_undegraded":"2023-09-28T04:23:18.397971+0000","last_fullsized":"2023-09-28T04:23:18.397971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:06:40.927453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402518+0000","last_change":"2023-09-28T04:23:18.402518+0000","last_active":"2023-09-28T04:23:18.402518+0000","last_peered":"2023-09-28T04:23:18.402518+0000","last_clean":"2023-09-28T04:23:18.402518+0000","last_became_active":"2023-09-28T04:23:18.402275+0000","last_became_peered":"2023-09-28T04:23:18.402275+0000","last_unstale":"2023-09-28T04:23:18.402518+0000","last_undegraded":"2023-09-28T04:23:18.402518+0000","last_fullsized":"2023-09-28T04:23:18.402518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400750+0000","last_change":"2023-09-28T04:23:18.395032+0000","last_active":"2023-09-28T04:23:18.400750+0000","last_peered":"2023-09-28T04:23:18.400750+0000","last_clean":"2023-09-28T04:23:18.400750+0000","last_became_active":"2023-09-28T04:23:18.390678+0000","last_became_peered":"2023-09-28T04:23:18.390678+0000","last_unstale":"2023-09-28T04:23:18.400750+0000","last_undegraded":"2023-09-28T04:23:18.400750+0000","last_fullsized":"2023-09-28T04:23:18.400750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.385209+0000","last_change":"2023-09-28T04:23:18.385209+0000","last_active":"2023-09-28T04:23:18.385209+0000","last_peered":"2023-09-28T04:23:18.385209+0000","last_clean":"2023-09-28T04:23:18.385209+0000","last_became_active":"2023-09-28T04:23:18.384916+0000","last_became_peered":"2023-09-28T04:23:18.384916+0000","last_unstale":"2023-09-28T04:23:18.385209+0000","last_undegraded":"2023-09-28T04:23:18.385209+0000","last_fullsized":"2023-09-28T04:23:18.385209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:06.937552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397758+0000","last_change":"2023-09-28T04:23:18.386692+0000","last_active":"2023-09-28T04:23:18.397758+0000","last_peered":"2023-09-28T04:23:18.397758+0000","last_clean":"2023-09-28T04:23:18.397758+0000","last_became_active":"2023-09-28T04:23:18.385805+0000","last_became_peered":"2023-09-28T04:23:18.385805+0000","last_unstale":"2023-09-28T04:23:18.397758+0000","last_undegraded":"2023-09-28T04:23:18.397758+0000","last_fullsized":"2023-09-28T04:23:18.397758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:52:07.899487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400497+0000","last_change":"2023-09-28T04:23:18.400497+0000","last_active":"2023-09-28T04:23:18.400497+0000","last_peered":"2023-09-28T04:23:18.400497+0000","last_clean":"2023-09-28T04:23:18.400497+0000","last_became_active":"2023-09-28T04:23:18.400230+0000","last_became_peered":"2023-09-28T04:23:18.400230+0000","last_unstale":"2023-09-28T04:23:18.400497+0000","last_undegraded":"2023-09-28T04:23:18.400497+0000","last_fullsized":"2023-09-28T04:23:18.400497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391683+0000","last_change":"2023-09-28T04:23:18.391683+0000","last_active":"2023-09-28T04:23:18.391683+0000","last_peered":"2023-09-28T04:23:18.391683+0000","last_clean":"2023-09-28T04:23:18.391683+0000","last_became_active":"2023-09-28T04:23:18.391373+0000","last_became_peered":"2023-09-28T04:23:18.391373+0000","last_unstale":"2023-09-28T04:23:18.391683+0000","last_undegraded":"2023-09-28T04:23:18.391683+0000","last_fullsized":"2023-09-28T04:23:18.391683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402238+0000","last_change":"2023-09-28T04:23:18.393381+0000","last_active":"2023-09-28T04:23:18.402238+0000","last_peered":"2023-09-28T04:23:18.402238+0000","last_clean":"2023-09-28T04:23:18.402238+0000","last_became_active":"2023-09-28T04:23:18.392723+0000","last_became_peered":"2023-09-28T04:23:18.392723+0000","last_unstale":"2023-09-28T04:23:18.402238+0000","last_undegraded":"2023-09-28T04:23:18.402238+0000","last_fullsized":"2023-09-28T04:23:18.402238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402467+0000","last_change":"2023-09-28T04:23:18.402467+0000","last_active":"2023-09-28T04:23:18.402467+0000","last_peered":"2023-09-28T04:23:18.402467+0000","last_clean":"2023-09-28T04:23:18.402467+0000","last_became_active":"2023-09-28T04:23:18.402197+0000","last_became_peered":"2023-09-28T04:23:18.402197+0000","last_unstale":"2023-09-28T04:23:18.402467+0000","last_undegraded":"2023-09-28T04:23:18.402467+0000","last_fullsized":"2023-09-28T04:23:18.402467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.396757+0000","last_change":"2023-09-28T04:23:18.389242+0000","last_active":"2023-09-28T04:23:18.396757+0000","last_peered":"2023-09-28T04:23:18.396757+0000","last_clean":"2023-09-28T04:23:18.396757+0000","last_became_active":"2023-09-28T04:23:18.388936+0000","last_became_peered":"2023-09-28T04:23:18.388936+0000","last_unstale":"2023-09-28T04:23:18.396757+0000","last_undegraded":"2023-09-28T04:23:18.396757+0000","last_fullsized":"2023-09-28T04:23:18.396757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:19.108476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395209+0000","last_change":"2023-09-28T04:23:18.388941+0000","last_active":"2023-09-28T04:23:18.395209+0000","last_peered":"2023-09-28T04:23:18.395209+0000","last_clean":"2023-09-28T04:23:18.395209+0000","last_became_active":"2023-09-28T04:23:18.388682+0000","last_became_peered":"2023-09-28T04:23:18.388682+0000","last_unstale":"2023-09-28T04:23:18.395209+0000","last_undegraded":"2023-09-28T04:23:18.395209+0000","last_fullsized":"2023-09-28T04:23:18.395209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395293+0000","last_change":"2023-09-28T04:23:18.391753+0000","last_active":"2023-09-28T04:23:18.395293+0000","last_peered":"2023-09-28T04:23:18.395293+0000","last_clean":"2023-09-28T04:23:18.395293+0000","last_became_active":"2023-09-28T04:23:18.391031+0000","last_became_peered":"2023-09-28T04:23:18.391031+0000","last_unstale":"2023-09-28T04:23:18.395293+0000","last_undegraded":"2023-09-28T04:23:18.395293+0000","last_fullsized":"2023-09-28T04:23:18.395293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.382219+0000","last_change":"2023-09-28T04:23:17.914158+0000","last_active":"2023-09-28T04:23:18.382219+0000","last_peered":"2023-09-28T04:23:18.382219+0000","last_clean":"2023-09-28T04:23:18.382219+0000","last_became_active":"2023-09-28T04:23:17.913941+0000","last_became_peered":"2023-09-28T04:23:17.913941+0000","last_unstale":"2023-09-28T04:23:18.382219+0000","last_undegraded":"2023-09-28T04:23:18.382219+0000","last_fullsized":"2023-09-28T04:23:18.382219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401811+0000","last_change":"2023-09-28T04:23:18.390288+0000","last_active":"2023-09-28T04:23:18.401811+0000","last_peered":"2023-09-28T04:23:18.401811+0000","last_clean":"2023-09-28T04:23:18.401811+0000","last_became_active":"2023-09-28T04:23:18.390030+0000","last_became_peered":"2023-09-28T04:23:18.390030+0000","last_unstale":"2023-09-28T04:23:18.401811+0000","last_undegraded":"2023-09-28T04:23:18.401811+0000","last_fullsized":"2023-09-28T04:23:18.401811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377746+0000","last_change":"2023-09-28T04:23:17.914311+0000","last_active":"2023-09-28T04:23:18.377746+0000","last_peered":"2023-09-28T04:23:18.377746+0000","last_clean":"2023-09-28T04:23:18.377746+0000","last_became_active":"2023-09-28T04:23:17.913950+0000","last_became_peered":"2023-09-28T04:23:17.913950+0000","last_unstale":"2023-09-28T04:23:18.377746+0000","last_undegraded":"2023-09-28T04:23:18.377746+0000","last_fullsized":"2023-09-28T04:23:18.377746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.393402+0000","last_change":"2023-09-28T04:23:18.393402+0000","last_active":"2023-09-28T04:23:18.393402+0000","last_peered":"2023-09-28T04:23:18.393402+0000","last_clean":"2023-09-28T04:23:18.393402+0000","last_became_active":"2023-09-28T04:23:18.393106+0000","last_became_peered":"2023-09-28T04:23:18.393106+0000","last_unstale":"2023-09-28T04:23:18.393402+0000","last_undegraded":"2023-09-28T04:23:18.393402+0000","last_fullsized":"2023-09-28T04:23:18.393402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.376291+0000","last_change":"2023-09-28T04:23:17.911104+0000","last_active":"2023-09-28T04:23:18.376291+0000","last_peered":"2023-09-28T04:23:18.376291+0000","last_clean":"2023-09-28T04:23:18.376291+0000","last_became_active":"2023-09-28T04:23:17.910766+0000","last_became_peered":"2023-09-28T04:23:17.910766+0000","last_unstale":"2023-09-28T04:23:18.376291+0000","last_undegraded":"2023-09-28T04:23:18.376291+0000","last_fullsized":"2023-09-28T04:23:18.376291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388098+0000","last_change":"2023-09-28T04:23:18.388098+0000","last_active":"2023-09-28T04:23:18.388098+0000","last_peered":"2023-09-28T04:23:18.388098+0000","last_clean":"2023-09-28T04:23:18.388098+0000","last_became_active":"2023-09-28T04:23:18.387581+0000","last_became_peered":"2023-09-28T04:23:18.387581+0000","last_unstale":"2023-09-28T04:23:18.388098+0000","last_undegraded":"2023-09-28T04:23:18.388098+0000","last_fullsized":"2023-09-28T04:23:18.388098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:11.090984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.919091+0000","last_change":"2023-09-28T04:23:17.917921+0000","last_active":"2023-09-28T04:23:17.919091+0000","last_peered":"2023-09-28T04:23:17.919091+0000","last_clean":"2023-09-28T04:23:17.919091+0000","last_became_active":"2023-09-28T04:23:17.917596+0000","last_became_peered":"2023-09-28T04:23:17.917596+0000","last_unstale":"2023-09-28T04:23:17.919091+0000","last_undegraded":"2023-09-28T04:23:17.919091+0000","last_fullsized":"2023-09-28T04:23:17.919091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402470+0000","last_change":"2023-09-28T04:23:18.394460+0000","last_active":"2023-09-28T04:23:18.402470+0000","last_peered":"2023-09-28T04:23:18.402470+0000","last_clean":"2023-09-28T04:23:18.402470+0000","last_became_active":"2023-09-28T04:23:18.391773+0000","last_became_peered":"2023-09-28T04:23:18.391773+0000","last_unstale":"2023-09-28T04:23:18.402470+0000","last_undegraded":"2023-09-28T04:23:18.402470+0000","last_fullsized":"2023-09-28T04:23:18.402470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379691+0000","last_change":"2023-09-28T04:23:17.908875+0000","last_active":"2023-09-28T04:23:18.379691+0000","last_peered":"2023-09-28T04:23:18.379691+0000","last_clean":"2023-09-28T04:23:18.379691+0000","last_became_active":"2023-09-28T04:23:17.908599+0000","last_became_peered":"2023-09-28T04:23:17.908599+0000","last_unstale":"2023-09-28T04:23:18.379691+0000","last_undegraded":"2023-09-28T04:23:18.379691+0000","last_fullsized":"2023-09-28T04:23:18.379691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402255+0000","last_change":"2023-09-28T04:23:18.393856+0000","last_active":"2023-09-28T04:23:18.402255+0000","last_peered":"2023-09-28T04:23:18.402255+0000","last_clean":"2023-09-28T04:23:18.402255+0000","last_became_active":"2023-09-28T04:23:18.393631+0000","last_became_peered":"2023-09-28T04:23:18.393631+0000","last_unstale":"2023-09-28T04:23:18.402255+0000","last_undegraded":"2023-09-28T04:23:18.402255+0000","last_fullsized":"2023-09-28T04:23:18.402255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.914702+0000","last_change":"2023-09-28T04:23:17.911594+0000","last_active":"2023-09-28T04:23:17.914702+0000","last_peered":"2023-09-28T04:23:17.914702+0000","last_clean":"2023-09-28T04:23:17.914702+0000","last_became_active":"2023-09-28T04:23:17.911361+0000","last_became_peered":"2023-09-28T04:23:17.911361+0000","last_unstale":"2023-09-28T04:23:17.914702+0000","last_undegraded":"2023-09-28T04:23:17.914702+0000","last_fullsized":"2023-09-28T04:23:17.914702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.394029+0000","last_change":"2023-09-28T04:23:18.387908+0000","last_active":"2023-09-28T04:23:18.394029+0000","last_peered":"2023-09-28T04:23:18.394029+0000","last_clean":"2023-09-28T04:23:18.394029+0000","last_became_active":"2023-09-28T04:23:18.387672+0000","last_became_peered":"2023-09-28T04:23:18.387672+0000","last_unstale":"2023-09-28T04:23:18.394029+0000","last_undegraded":"2023-09-28T04:23:18.394029+0000","last_fullsized":"2023-09-28T04:23:18.394029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.381660+0000","last_change":"2023-09-28T04:23:17.904974+0000","last_active":"2023-09-28T04:23:18.381660+0000","last_peered":"2023-09-28T04:23:18.381660+0000","last_clean":"2023-09-28T04:23:18.381660+0000","last_became_active":"2023-09-28T04:23:17.904734+0000","last_became_peered":"2023-09-28T04:23:17.904734+0000","last_unstale":"2023-09-28T04:23:18.381660+0000","last_undegraded":"2023-09-28T04:23:18.381660+0000","last_fullsized":"2023-09-28T04:23:18.381660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397872+0000","last_change":"2023-09-28T04:23:18.389128+0000","last_active":"2023-09-28T04:23:18.397872+0000","last_peered":"2023-09-28T04:23:18.397872+0000","last_clean":"2023-09-28T04:23:18.397872+0000","last_became_active":"2023-09-28T04:23:18.388871+0000","last_became_peered":"2023-09-28T04:23:18.388871+0000","last_unstale":"2023-09-28T04:23:18.397872+0000","last_undegraded":"2023-09-28T04:23:18.397872+0000","last_fullsized":"2023-09-28T04:23:18.397872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:33:50.957431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.914658+0000","last_change":"2023-09-28T04:23:17.910343+0000","last_active":"2023-09-28T04:23:17.914658+0000","last_peered":"2023-09-28T04:23:17.914658+0000","last_clean":"2023-09-28T04:23:17.914658+0000","last_became_active":"2023-09-28T04:23:17.909981+0000","last_became_peered":"2023-09-28T04:23:17.909981+0000","last_unstale":"2023-09-28T04:23:17.914658+0000","last_undegraded":"2023-09-28T04:23:17.914658+0000","last_fullsized":"2023-09-28T04:23:17.914658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:11.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402619+0000","last_change":"2023-09-28T04:23:18.391696+0000","last_active":"2023-09-28T04:23:18.402619+0000","last_peered":"2023-09-28T04:23:18.402619+0000","last_clean":"2023-09-28T04:23:18.402619+0000","last_became_active":"2023-09-28T04:23:18.391441+0000","last_became_peered":"2023-09-28T04:23:18.391441+0000","last_unstale":"2023-09-28T04:23:18.402619+0000","last_undegraded":"2023-09-28T04:23:18.402619+0000","last_fullsized":"2023-09-28T04:23:18.402619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.918197+0000","last_change":"2023-09-28T04:23:17.916730+0000","last_active":"2023-09-28T04:23:17.918197+0000","last_peered":"2023-09-28T04:23:17.918197+0000","last_clean":"2023-09-28T04:23:17.918197+0000","last_became_active":"2023-09-28T04:23:17.916424+0000","last_became_peered":"2023-09-28T04:23:17.916424+0000","last_unstale":"2023-09-28T04:23:17.918197+0000","last_undegraded":"2023-09-28T04:23:17.918197+0000","last_fullsized":"2023-09-28T04:23:17.918197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392344+0000","last_change":"2023-09-28T04:23:18.391510+0000","last_active":"2023-09-28T04:23:18.392344+0000","last_peered":"2023-09-28T04:23:18.392344+0000","last_clean":"2023-09-28T04:23:18.392344+0000","last_became_active":"2023-09-28T04:23:18.390613+0000","last_became_peered":"2023-09-28T04:23:18.390613+0000","last_unstale":"2023-09-28T04:23:18.392344+0000","last_undegraded":"2023-09-28T04:23:18.392344+0000","last_fullsized":"2023-09-28T04:23:18.392344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.914696+0000","last_change":"2023-09-28T04:23:17.910760+0000","last_active":"2023-09-28T04:23:17.914696+0000","last_peered":"2023-09-28T04:23:17.914696+0000","last_clean":"2023-09-28T04:23:17.914696+0000","last_became_active":"2023-09-28T04:23:17.910457+0000","last_became_peered":"2023-09-28T04:23:17.910457+0000","last_unstale":"2023-09-28T04:23:17.914696+0000","last_undegraded":"2023-09-28T04:23:17.914696+0000","last_fullsized":"2023-09-28T04:23:17.914696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:10.087083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402823+0000","last_change":"2023-09-28T04:23:18.402823+0000","last_active":"2023-09-28T04:23:18.402823+0000","last_peered":"2023-09-28T04:23:18.402823+0000","last_clean":"2023-09-28T04:23:18.402823+0000","last_became_active":"2023-09-28T04:23:18.402559+0000","last_became_peered":"2023-09-28T04:23:18.402559+0000","last_unstale":"2023-09-28T04:23:18.402823+0000","last_undegraded":"2023-09-28T04:23:18.402823+0000","last_fullsized":"2023-09-28T04:23:18.402823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.912229+0000","last_change":"2023-09-28T04:23:17.910972+0000","last_active":"2023-09-28T04:23:17.912229+0000","last_peered":"2023-09-28T04:23:17.912229+0000","last_clean":"2023-09-28T04:23:17.912229+0000","last_became_active":"2023-09-28T04:23:17.910650+0000","last_became_peered":"2023-09-28T04:23:17.910650+0000","last_unstale":"2023-09-28T04:23:17.912229+0000","last_undegraded":"2023-09-28T04:23:17.912229+0000","last_fullsized":"2023-09-28T04:23:17.912229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:03:36.553513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402556+0000","last_change":"2023-09-28T04:23:18.395424+0000","last_active":"2023-09-28T04:23:18.402556+0000","last_peered":"2023-09-28T04:23:18.402556+0000","last_clean":"2023-09-28T04:23:18.402556+0000","last_became_active":"2023-09-28T04:23:18.394721+0000","last_became_peered":"2023-09-28T04:23:18.394721+0000","last_unstale":"2023-09-28T04:23:18.402556+0000","last_undegraded":"2023-09-28T04:23:18.402556+0000","last_fullsized":"2023-09-28T04:23:18.402556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.911983+0000","last_change":"2023-09-28T04:23:17.907642+0000","last_active":"2023-09-28T04:23:17.911983+0000","last_peered":"2023-09-28T04:23:17.911983+0000","last_clean":"2023-09-28T04:23:17.911983+0000","last_became_active":"2023-09-28T04:23:17.907331+0000","last_became_peered":"2023-09-28T04:23:17.907331+0000","last_unstale":"2023-09-28T04:23:17.911983+0000","last_undegraded":"2023-09-28T04:23:17.911983+0000","last_fullsized":"2023-09-28T04:23:17.911983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.393277+0000","last_change":"2023-09-28T04:23:18.390910+0000","last_active":"2023-09-28T04:23:18.393277+0000","last_peered":"2023-09-28T04:23:18.393277+0000","last_clean":"2023-09-28T04:23:18.393277+0000","last_became_active":"2023-09-28T04:23:18.390633+0000","last_became_peered":"2023-09-28T04:23:18.390633+0000","last_unstale":"2023-09-28T04:23:18.393277+0000","last_undegraded":"2023-09-28T04:23:18.393277+0000","last_fullsized":"2023-09-28T04:23:18.393277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.911935+0000","last_change":"2023-09-28T04:23:17.906320+0000","last_active":"2023-09-28T04:23:17.911935+0000","last_peered":"2023-09-28T04:23:17.911935+0000","last_clean":"2023-09-28T04:23:17.911935+0000","last_became_active":"2023-09-28T04:23:17.906036+0000","last_became_peered":"2023-09-28T04:23:17.906036+0000","last_unstale":"2023-09-28T04:23:17.911935+0000","last_undegraded":"2023-09-28T04:23:17.911935+0000","last_fullsized":"2023-09-28T04:23:17.911935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397773+0000","last_change":"2023-09-28T04:23:18.386196+0000","last_active":"2023-09-28T04:23:18.397773+0000","last_peered":"2023-09-28T04:23:18.397773+0000","last_clean":"2023-09-28T04:23:18.397773+0000","last_became_active":"2023-09-28T04:23:18.385693+0000","last_became_peered":"2023-09-28T04:23:18.385693+0000","last_unstale":"2023-09-28T04:23:18.397773+0000","last_undegraded":"2023-09-28T04:23:18.397773+0000","last_fullsized":"2023-09-28T04:23:18.397773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.912035+0000","last_change":"2023-09-28T04:23:17.908768+0000","last_active":"2023-09-28T04:23:17.912035+0000","last_peered":"2023-09-28T04:23:17.912035+0000","last_clean":"2023-09-28T04:23:17.912035+0000","last_became_active":"2023-09-28T04:23:17.908493+0000","last_became_peered":"2023-09-28T04:23:17.908493+0000","last_unstale":"2023-09-28T04:23:17.912035+0000","last_undegraded":"2023-09-28T04:23:17.912035+0000","last_fullsized":"2023-09-28T04:23:17.912035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.385404+0000","last_change":"2023-09-28T04:23:18.385404+0000","last_active":"2023-09-28T04:23:18.385404+0000","last_peered":"2023-09-28T04:23:18.385404+0000","last_clean":"2023-09-28T04:23:18.385404+0000","last_became_active":"2023-09-28T04:23:18.385112+0000","last_became_peered":"2023-09-28T04:23:18.385112+0000","last_unstale":"2023-09-28T04:23:18.385404+0000","last_undegraded":"2023-09-28T04:23:18.385404+0000","last_fullsized":"2023-09-28T04:23:18.385404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:06.331056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378811+0000","last_change":"2023-09-28T04:23:17.898518+0000","last_active":"2023-09-28T04:23:18.378811+0000","last_peered":"2023-09-28T04:23:18.378811+0000","last_clean":"2023-09-28T04:23:18.378811+0000","last_became_active":"2023-09-28T04:23:17.898232+0000","last_became_peered":"2023-09-28T04:23:17.898232+0000","last_unstale":"2023-09-28T04:23:18.378811+0000","last_undegraded":"2023-09-28T04:23:18.378811+0000","last_fullsized":"2023-09-28T04:23:18.378811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392206+0000","last_change":"2023-09-28T04:23:18.392206+0000","last_active":"2023-09-28T04:23:18.392206+0000","last_peered":"2023-09-28T04:23:18.392206+0000","last_clean":"2023-09-28T04:23:18.392206+0000","last_became_active":"2023-09-28T04:23:18.391963+0000","last_became_peered":"2023-09-28T04:23:18.391963+0000","last_unstale":"2023-09-28T04:23:18.392206+0000","last_undegraded":"2023-09-28T04:23:18.392206+0000","last_fullsized":"2023-09-28T04:23:18.392206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.375609+0000","last_change":"2023-09-28T04:23:17.905390+0000","last_active":"2023-09-28T04:23:18.375609+0000","last_peered":"2023-09-28T04:23:18.375609+0000","last_clean":"2023-09-28T04:23:18.375609+0000","last_became_active":"2023-09-28T04:23:17.905089+0000","last_became_peered":"2023-09-28T04:23:17.905089+0000","last_unstale":"2023-09-28T04:23:18.375609+0000","last_undegraded":"2023-09-28T04:23:18.375609+0000","last_fullsized":"2023-09-28T04:23:18.375609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401474+0000","last_change":"2023-09-28T04:23:18.400110+0000","last_active":"2023-09-28T04:23:18.401474+0000","last_peered":"2023-09-28T04:23:18.401474+0000","last_clean":"2023-09-28T04:23:18.401474+0000","last_became_active":"2023-09-28T04:23:18.399839+0000","last_became_peered":"2023-09-28T04:23:18.399839+0000","last_unstale":"2023-09-28T04:23:18.401474+0000","last_undegraded":"2023-09-28T04:23:18.401474+0000","last_fullsized":"2023-09-28T04:23:18.401474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.915135+0000","last_change":"2023-09-28T04:23:17.912734+0000","last_active":"2023-09-28T04:23:17.915135+0000","last_peered":"2023-09-28T04:23:17.915135+0000","last_clean":"2023-09-28T04:23:17.915135+0000","last_became_active":"2023-09-28T04:23:17.912560+0000","last_became_peered":"2023-09-28T04:23:17.912560+0000","last_unstale":"2023-09-28T04:23:17.915135+0000","last_undegraded":"2023-09-28T04:23:17.915135+0000","last_fullsized":"2023-09-28T04:23:17.915135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397919+0000","last_change":"2023-09-28T04:23:18.393554+0000","last_active":"2023-09-28T04:23:18.397919+0000","last_peered":"2023-09-28T04:23:18.397919+0000","last_clean":"2023-09-28T04:23:18.397919+0000","last_became_active":"2023-09-28T04:23:18.390268+0000","last_became_peered":"2023-09-28T04:23:18.390268+0000","last_unstale":"2023-09-28T04:23:18.397919+0000","last_undegraded":"2023-09-28T04:23:18.397919+0000","last_fullsized":"2023-09-28T04:23:18.397919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.381608+0000","last_change":"2023-09-28T04:23:17.911218+0000","last_active":"2023-09-28T04:23:18.381608+0000","last_peered":"2023-09-28T04:23:18.381608+0000","last_clean":"2023-09-28T04:23:18.381608+0000","last_became_active":"2023-09-28T04:23:17.910887+0000","last_became_peered":"2023-09-28T04:23:17.910887+0000","last_unstale":"2023-09-28T04:23:18.381608+0000","last_undegraded":"2023-09-28T04:23:18.381608+0000","last_fullsized":"2023-09-28T04:23:18.381608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397818+0000","last_change":"2023-09-28T04:23:18.387932+0000","last_active":"2023-09-28T04:23:18.397818+0000","last_peered":"2023-09-28T04:23:18.397818+0000","last_clean":"2023-09-28T04:23:18.397818+0000","last_became_active":"2023-09-28T04:23:18.387667+0000","last_became_peered":"2023-09-28T04:23:18.387667+0000","last_unstale":"2023-09-28T04:23:18.397818+0000","last_undegraded":"2023-09-28T04:23:18.397818+0000","last_fullsized":"2023-09-28T04:23:18.397818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:46:23.383130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.376247+0000","last_change":"2023-09-28T04:23:17.911764+0000","last_active":"2023-09-28T04:23:18.376247+0000","last_peered":"2023-09-28T04:23:18.376247+0000","last_clean":"2023-09-28T04:23:18.376247+0000","last_became_active":"2023-09-28T04:23:17.911458+0000","last_became_peered":"2023-09-28T04:23:17.911458+0000","last_unstale":"2023-09-28T04:23:18.376247+0000","last_undegraded":"2023-09-28T04:23:18.376247+0000","last_fullsized":"2023-09-28T04:23:18.376247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402635+0000","last_change":"2023-09-28T04:23:18.400278+0000","last_active":"2023-09-28T04:23:18.402635+0000","last_peered":"2023-09-28T04:23:18.402635+0000","last_clean":"2023-09-28T04:23:18.402635+0000","last_became_active":"2023-09-28T04:23:18.399957+0000","last_became_peered":"2023-09-28T04:23:18.399957+0000","last_unstale":"2023-09-28T04:23:18.402635+0000","last_undegraded":"2023-09-28T04:23:18.402635+0000","last_fullsized":"2023-09-28T04:23:18.402635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:01:52.295558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377068+0000","last_change":"2023-09-28T04:23:13.017727+0000","last_active":"2023-09-28T04:23:18.377068+0000","last_peered":"2023-09-28T04:23:18.377068+0000","last_clean":"2023-09-28T04:23:18.377068+0000","last_became_active":"2023-09-28T04:23:13.017362+0000","last_became_peered":"2023-09-28T04:23:13.017362+0000","last_unstale":"2023-09-28T04:23:18.377068+0000","last_undegraded":"2023-09-28T04:23:18.377068+0000","last_fullsized":"2023-09-28T04:23:18.377068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.382209+0000","last_change":"2023-09-28T04:23:17.899128+0000","last_active":"2023-09-28T04:23:18.382209+0000","last_peered":"2023-09-28T04:23:18.382209+0000","last_clean":"2023-09-28T04:23:18.382209+0000","last_became_active":"2023-09-28T04:23:17.898878+0000","last_became_peered":"2023-09-28T04:23:17.898878+0000","last_unstale":"2023-09-28T04:23:18.382209+0000","last_undegraded":"2023-09-28T04:23:18.382209+0000","last_fullsized":"2023-09-28T04:23:18.382209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388439+0000","last_change":"2023-09-28T04:23:18.384565+0000","last_active":"2023-09-28T04:23:18.388439+0000","last_peered":"2023-09-28T04:23:18.388439+0000","last_clean":"2023-09-28T04:23:18.388439+0000","last_became_active":"2023-09-28T04:23:18.383969+0000","last_became_peered":"2023-09-28T04:23:18.383969+0000","last_unstale":"2023-09-28T04:23:18.388439+0000","last_undegraded":"2023-09-28T04:23:18.388439+0000","last_fullsized":"2023-09-28T04:23:18.388439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379488+0000","last_change":"2023-09-28T04:23:12.604091+0000","last_active":"2023-09-28T04:23:18.379488+0000","last_peered":"2023-09-28T04:23:18.379488+0000","last_clean":"2023-09-28T04:23:18.379488+0000","last_became_active":"2023-09-28T04:23:12.603804+0000","last_became_peered":"2023-09-28T04:23:12.603804+0000","last_unstale":"2023-09-28T04:23:18.379488+0000","last_undegraded":"2023-09-28T04:23:18.379488+0000","last_fullsized":"2023-09-28T04:23:18.379488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.382008+0000","last_change":"2023-09-28T04:23:17.918999+0000","last_active":"2023-09-28T04:23:18.382008+0000","last_peered":"2023-09-28T04:23:18.382008+0000","last_clean":"2023-09-28T04:23:18.382008+0000","last_became_active":"2023-09-28T04:23:17.918740+0000","last_became_peered":"2023-09-28T04:23:17.918740+0000","last_unstale":"2023-09-28T04:23:18.382008+0000","last_undegraded":"2023-09-28T04:23:18.382008+0000","last_fullsized":"2023-09-28T04:23:18.382008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395808+0000","last_change":"2023-09-28T04:23:18.389350+0000","last_active":"2023-09-28T04:23:18.395808+0000","last_peered":"2023-09-28T04:23:18.395808+0000","last_clean":"2023-09-28T04:23:18.395808+0000","last_became_active":"2023-09-28T04:23:18.389059+0000","last_became_peered":"2023-09-28T04:23:18.389059+0000","last_unstale":"2023-09-28T04:23:18.395808+0000","last_undegraded":"2023-09-28T04:23:18.395808+0000","last_fullsized":"2023-09-28T04:23:18.395808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.898334+0000","last_change":"2023-09-28T04:23:12.602100+0000","last_active":"2023-09-28T04:23:17.898334+0000","last_peered":"2023-09-28T04:23:17.898334+0000","last_clean":"2023-09-28T04:23:17.898334+0000","last_became_active":"2023-09-28T04:23:12.601652+0000","last_became_peered":"2023-09-28T04:23:12.601652+0000","last_unstale":"2023-09-28T04:23:17.898334+0000","last_undegraded":"2023-09-28T04:23:17.898334+0000","last_fullsized":"2023-09-28T04:23:17.898334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:37:16.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.376176+0000","last_change":"2023-09-28T04:23:17.911566+0000","last_active":"2023-09-28T04:23:18.376176+0000","last_peered":"2023-09-28T04:23:18.376176+0000","last_clean":"2023-09-28T04:23:18.376176+0000","last_became_active":"2023-09-28T04:23:17.911308+0000","last_became_peered":"2023-09-28T04:23:17.911308+0000","last_unstale":"2023-09-28T04:23:18.376176+0000","last_undegraded":"2023-09-28T04:23:18.376176+0000","last_fullsized":"2023-09-28T04:23:18.376176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395489+0000","last_change":"2023-09-28T04:23:18.388204+0000","last_active":"2023-09-28T04:23:18.395489+0000","last_peered":"2023-09-28T04:23:18.395489+0000","last_clean":"2023-09-28T04:23:18.395489+0000","last_became_active":"2023-09-28T04:23:18.387945+0000","last_became_peered":"2023-09-28T04:23:18.387945+0000","last_unstale":"2023-09-28T04:23:18.395489+0000","last_undegraded":"2023-09-28T04:23:18.395489+0000","last_fullsized":"2023-09-28T04:23:18.395489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378668+0000","last_change":"2023-09-28T04:23:12.604212+0000","last_active":"2023-09-28T04:23:18.378668+0000","last_peered":"2023-09-28T04:23:18.378668+0000","last_clean":"2023-09-28T04:23:18.378668+0000","last_became_active":"2023-09-28T04:23:12.603930+0000","last_became_peered":"2023-09-28T04:23:12.603930+0000","last_unstale":"2023-09-28T04:23:18.378668+0000","last_undegraded":"2023-09-28T04:23:18.378668+0000","last_fullsized":"2023-09-28T04:23:18.378668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.900147+0000","last_change":"2023-09-28T04:23:11.608534+0000","last_active":"2023-09-28T04:23:17.900147+0000","last_peered":"2023-09-28T04:23:17.900147+0000","last_clean":"2023-09-28T04:23:17.900147+0000","last_became_active":"2023-09-28T04:23:11.608249+0000","last_became_peered":"2023-09-28T04:23:11.608249+0000","last_unstale":"2023-09-28T04:23:17.900147+0000","last_undegraded":"2023-09-28T04:23:17.900147+0000","last_fullsized":"2023-09-28T04:23:17.900147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_clean_scrub_stamp":"2023-09-28T04:23:10.587579+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:10.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.375491+0000","last_change":"2023-09-28T04:23:17.902709+0000","last_active":"2023-09-28T04:23:18.375491+0000","last_peered":"2023-09-28T04:23:18.375491+0000","last_clean":"2023-09-28T04:23:18.375491+0000","last_became_active":"2023-09-28T04:23:17.902341+0000","last_became_peered":"2023-09-28T04:23:17.902341+0000","last_unstale":"2023-09-28T04:23:18.375491+0000","last_undegraded":"2023-09-28T04:23:18.375491+0000","last_fullsized":"2023-09-28T04:23:18.375491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.389982+0000","last_change":"2023-09-28T04:23:18.389982+0000","last_active":"2023-09-28T04:23:18.389982+0000","last_peered":"2023-09-28T04:23:18.389982+0000","last_clean":"2023-09-28T04:23:18.389982+0000","last_became_active":"2023-09-28T04:23:18.389692+0000","last_became_peered":"2023-09-28T04:23:18.389692+0000","last_unstale":"2023-09-28T04:23:18.389982+0000","last_undegraded":"2023-09-28T04:23:18.389982+0000","last_fullsized":"2023-09-28T04:23:18.389982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.900240+0000","last_change":"2023-09-28T04:23:12.605908+0000","last_active":"2023-09-28T04:23:17.900240+0000","last_peered":"2023-09-28T04:23:17.900240+0000","last_clean":"2023-09-28T04:23:17.900240+0000","last_became_active":"2023-09-28T04:23:12.605668+0000","last_became_peered":"2023-09-28T04:23:12.605668+0000","last_unstale":"2023-09-28T04:23:17.900240+0000","last_undegraded":"2023-09-28T04:23:17.900240+0000","last_fullsized":"2023-09-28T04:23:17.900240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.919292+0000","last_change":"2023-09-28T04:23:17.918410+0000","last_active":"2023-09-28T04:23:17.919292+0000","last_peered":"2023-09-28T04:23:17.919292+0000","last_clean":"2023-09-28T04:23:17.919292+0000","last_became_active":"2023-09-28T04:23:17.918130+0000","last_became_peered":"2023-09-28T04:23:17.918130+0000","last_unstale":"2023-09-28T04:23:17.919292+0000","last_undegraded":"2023-09-28T04:23:17.919292+0000","last_fullsized":"2023-09-28T04:23:17.919292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391987+0000","last_change":"2023-09-28T04:23:18.391987+0000","last_active":"2023-09-28T04:23:18.391987+0000","last_peered":"2023-09-28T04:23:18.391987+0000","last_clean":"2023-09-28T04:23:18.391987+0000","last_became_active":"2023-09-28T04:23:18.391709+0000","last_became_peered":"2023-09-28T04:23:18.391709+0000","last_unstale":"2023-09-28T04:23:18.391987+0000","last_undegraded":"2023-09-28T04:23:18.391987+0000","last_fullsized":"2023-09-28T04:23:18.391987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.902188+0000","last_change":"2023-09-28T04:23:13.017715+0000","last_active":"2023-09-28T04:23:17.902188+0000","last_peered":"2023-09-28T04:23:17.902188+0000","last_clean":"2023-09-28T04:23:17.902188+0000","last_became_active":"2023-09-28T04:23:13.017398+0000","last_became_peered":"2023-09-28T04:23:13.017398+0000","last_unstale":"2023-09-28T04:23:17.902188+0000","last_undegraded":"2023-09-28T04:23:17.902188+0000","last_fullsized":"2023-09-28T04:23:17.902188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:37:41.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377174+0000","last_change":"2023-09-28T04:23:17.912291+0000","last_active":"2023-09-28T04:23:18.377174+0000","last_peered":"2023-09-28T04:23:18.377174+0000","last_clean":"2023-09-28T04:23:18.377174+0000","last_became_active":"2023-09-28T04:23:17.912023+0000","last_became_peered":"2023-09-28T04:23:17.912023+0000","last_unstale":"2023-09-28T04:23:18.377174+0000","last_undegraded":"2023-09-28T04:23:18.377174+0000","last_fullsized":"2023-09-28T04:23:18.377174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.396451+0000","last_change":"2023-09-28T04:23:18.396451+0000","last_active":"2023-09-28T04:23:18.396451+0000","last_peered":"2023-09-28T04:23:18.396451+0000","last_clean":"2023-09-28T04:23:18.396451+0000","last_became_active":"2023-09-28T04:23:18.396190+0000","last_became_peered":"2023-09-28T04:23:18.396190+0000","last_unstale":"2023-09-28T04:23:18.396451+0000","last_undegraded":"2023-09-28T04:23:18.396451+0000","last_fullsized":"2023-09-28T04:23:18.396451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.376475+0000","last_change":"2023-09-28T04:23:17.904739+0000","last_active":"2023-09-28T04:23:18.376475+0000","last_peered":"2023-09-28T04:23:18.376475+0000","last_clean":"2023-09-28T04:23:18.376475+0000","last_became_active":"2023-09-28T04:23:17.903844+0000","last_became_peered":"2023-09-28T04:23:17.903844+0000","last_unstale":"2023-09-28T04:23:18.376475+0000","last_undegraded":"2023-09-28T04:23:18.376475+0000","last_fullsized":"2023-09-28T04:23:18.376475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377634+0000","last_change":"2023-09-28T04:23:12.606496+0000","last_active":"2023-09-28T04:23:18.377634+0000","last_peered":"2023-09-28T04:23:18.377634+0000","last_clean":"2023-09-28T04:23:18.377634+0000","last_became_active":"2023-09-28T04:23:12.606143+0000","last_became_peered":"2023-09-28T04:23:12.606143+0000","last_unstale":"2023-09-28T04:23:18.377634+0000","last_undegraded":"2023-09-28T04:23:18.377634+0000","last_fullsized":"2023-09-28T04:23:18.377634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402487+0000","last_change":"2023-09-28T04:23:18.396153+0000","last_active":"2023-09-28T04:23:18.402487+0000","last_peered":"2023-09-28T04:23:18.402487+0000","last_clean":"2023-09-28T04:23:18.402487+0000","last_became_active":"2023-09-28T04:23:18.392092+0000","last_became_peered":"2023-09-28T04:23:18.392092+0000","last_unstale":"2023-09-28T04:23:18.402487+0000","last_undegraded":"2023-09-28T04:23:18.402487+0000","last_fullsized":"2023-09-28T04:23:18.402487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.901011+0000","last_change":"2023-09-28T04:23:12.606390+0000","last_active":"2023-09-28T04:23:17.901011+0000","last_peered":"2023-09-28T04:23:17.901011+0000","last_clean":"2023-09-28T04:23:17.901011+0000","last_became_active":"2023-09-28T04:23:12.605965+0000","last_became_peered":"2023-09-28T04:23:12.605965+0000","last_unstale":"2023-09-28T04:23:17.901011+0000","last_undegraded":"2023-09-28T04:23:17.901011+0000","last_fullsized":"2023-09-28T04:23:17.901011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:11.833839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.917737+0000","last_change":"2023-09-28T04:23:17.915114+0000","last_active":"2023-09-28T04:23:17.917737+0000","last_peered":"2023-09-28T04:23:17.917737+0000","last_clean":"2023-09-28T04:23:17.917737+0000","last_became_active":"2023-09-28T04:23:17.914697+0000","last_became_peered":"2023-09-28T04:23:17.914697+0000","last_unstale":"2023-09-28T04:23:17.917737+0000","last_undegraded":"2023-09-28T04:23:17.917737+0000","last_fullsized":"2023-09-28T04:23:17.917737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397753+0000","last_change":"2023-09-28T04:23:18.386681+0000","last_active":"2023-09-28T04:23:18.397753+0000","last_peered":"2023-09-28T04:23:18.397753+0000","last_clean":"2023-09-28T04:23:18.397753+0000","last_became_active":"2023-09-28T04:23:18.386380+0000","last_became_peered":"2023-09-28T04:23:18.386380+0000","last_unstale":"2023-09-28T04:23:18.397753+0000","last_undegraded":"2023-09-28T04:23:18.397753+0000","last_fullsized":"2023-09-28T04:23:18.397753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.919196+0000","last_change":"2023-09-28T04:23:17.918404+0000","last_active":"2023-09-28T04:23:17.919196+0000","last_peered":"2023-09-28T04:23:17.919196+0000","last_clean":"2023-09-28T04:23:17.919196+0000","last_became_active":"2023-09-28T04:23:17.918116+0000","last_became_peered":"2023-09-28T04:23:17.918116+0000","last_unstale":"2023-09-28T04:23:17.919196+0000","last_undegraded":"2023-09-28T04:23:17.919196+0000","last_fullsized":"2023-09-28T04:23:17.919196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.385213+0000","last_change":"2023-09-28T04:23:18.385213+0000","last_active":"2023-09-28T04:23:18.385213+0000","last_peered":"2023-09-28T04:23:18.385213+0000","last_clean":"2023-09-28T04:23:18.385213+0000","last_became_active":"2023-09-28T04:23:18.384930+0000","last_became_peered":"2023-09-28T04:23:18.384930+0000","last_unstale":"2023-09-28T04:23:18.385213+0000","last_undegraded":"2023-09-28T04:23:18.385213+0000","last_fullsized":"2023-09-28T04:23:18.385213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:06.681805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378748+0000","last_change":"2023-09-28T04:23:17.905986+0000","last_active":"2023-09-28T04:23:18.378748+0000","last_peered":"2023-09-28T04:23:18.378748+0000","last_clean":"2023-09-28T04:23:18.378748+0000","last_became_active":"2023-09-28T04:23:17.905667+0000","last_became_peered":"2023-09-28T04:23:17.905667+0000","last_unstale":"2023-09-28T04:23:18.378748+0000","last_undegraded":"2023-09-28T04:23:18.378748+0000","last_fullsized":"2023-09-28T04:23:18.378748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402551+0000","last_change":"2023-09-28T04:23:18.400970+0000","last_active":"2023-09-28T04:23:18.402551+0000","last_peered":"2023-09-28T04:23:18.402551+0000","last_clean":"2023-09-28T04:23:18.402551+0000","last_became_active":"2023-09-28T04:23:18.400683+0000","last_became_peered":"2023-09-28T04:23:18.400683+0000","last_unstale":"2023-09-28T04:23:18.402551+0000","last_undegraded":"2023-09-28T04:23:18.402551+0000","last_fullsized":"2023-09-28T04:23:18.402551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:59:30.982762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379144+0000","last_change":"2023-09-28T04:23:17.905162+0000","last_active":"2023-09-28T04:23:18.379144+0000","last_peered":"2023-09-28T04:23:18.379144+0000","last_clean":"2023-09-28T04:23:18.379144+0000","last_became_active":"2023-09-28T04:23:17.904895+0000","last_became_peered":"2023-09-28T04:23:17.904895+0000","last_unstale":"2023-09-28T04:23:18.379144+0000","last_undegraded":"2023-09-28T04:23:18.379144+0000","last_fullsized":"2023-09-28T04:23:18.379144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402543+0000","last_change":"2023-09-28T04:23:18.400714+0000","last_active":"2023-09-28T04:23:18.402543+0000","last_peered":"2023-09-28T04:23:18.402543+0000","last_clean":"2023-09-28T04:23:18.402543+0000","last_became_active":"2023-09-28T04:23:18.400410+0000","last_became_peered":"2023-09-28T04:23:18.400410+0000","last_unstale":"2023-09-28T04:23:18.402543+0000","last_undegraded":"2023-09-28T04:23:18.402543+0000","last_fullsized":"2023-09-28T04:23:18.402543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:43:02.603601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.375466+0000","last_change":"2023-09-28T04:23:17.905493+0000","last_active":"2023-09-28T04:23:18.375466+0000","last_peered":"2023-09-28T04:23:18.375466+0000","last_clean":"2023-09-28T04:23:18.375466+0000","last_became_active":"2023-09-28T04:23:17.905198+0000","last_became_peered":"2023-09-28T04:23:17.905198+0000","last_unstale":"2023-09-28T04:23:18.375466+0000","last_undegraded":"2023-09-28T04:23:18.375466+0000","last_fullsized":"2023-09-28T04:23:18.375466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402220+0000","last_change":"2023-09-28T04:23:18.393194+0000","last_active":"2023-09-28T04:23:18.402220+0000","last_peered":"2023-09-28T04:23:18.402220+0000","last_clean":"2023-09-28T04:23:18.402220+0000","last_became_active":"2023-09-28T04:23:18.392400+0000","last_became_peered":"2023-09-28T04:23:18.392400+0000","last_unstale":"2023-09-28T04:23:18.402220+0000","last_undegraded":"2023-09-28T04:23:18.402220+0000","last_fullsized":"2023-09-28T04:23:18.402220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-28T04:23:17.918760+0000","last_change":"2023-09-28T04:23:17.917604+0000","last_active":"2023-09-28T04:23:17.918760+0000","last_peered":"2023-09-28T04:23:17.918760+0000","last_clean":"2023-09-28T04:23:17.918760+0000","last_became_active":"2023-09-28T04:23:17.917266+0000","last_became_peered":"2023-09-28T04:23:17.917266+0000","last_unstale":"2023-09-28T04:23:17.918760+0000","last_undegraded":"2023-09-28T04:23:17.918760+0000","last_fullsized":"2023-09-28T04:23:17.918760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395284+0000","last_change":"2023-09-28T04:23:18.386391+0000","last_active":"2023-09-28T04:23:18.395284+0000","last_peered":"2023-09-28T04:23:18.395284+0000","last_clean":"2023-09-28T04:23:18.395284+0000","last_became_active":"2023-09-28T04:23:18.386051+0000","last_became_peered":"2023-09-28T04:23:18.386051+0000","last_unstale":"2023-09-28T04:23:18.395284+0000","last_undegraded":"2023-09-28T04:23:18.395284+0000","last_fullsized":"2023-09-28T04:23:18.395284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.389600+0000","last_change":"2023-09-28T04:23:18.389600+0000","last_active":"2023-09-28T04:23:18.389600+0000","last_peered":"2023-09-28T04:23:18.389600+0000","last_clean":"2023-09-28T04:23:18.389600+0000","last_became_active":"2023-09-28T04:23:18.389280+0000","last_became_peered":"2023-09-28T04:23:18.389280+0000","last_unstale":"2023-09-28T04:23:18.389600+0000","last_undegraded":"2023-09-28T04:23:18.389600+0000","last_fullsized":"2023-09-28T04:23:18.389600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:47.697305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402201+0000","last_change":"2023-09-28T04:23:18.392980+0000","last_active":"2023-09-28T04:23:18.402201+0000","last_peered":"2023-09-28T04:23:18.402201+0000","last_clean":"2023-09-28T04:23:18.402201+0000","last_became_active":"2023-09-28T04:23:18.390929+0000","last_became_peered":"2023-09-28T04:23:18.390929+0000","last_unstale":"2023-09-28T04:23:18.402201+0000","last_undegraded":"2023-09-28T04:23:18.402201+0000","last_fullsized":"2023-09-28T04:23:18.402201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397834+0000","last_change":"2023-09-28T04:23:18.387348+0000","last_active":"2023-09-28T04:23:18.397834+0000","last_peered":"2023-09-28T04:23:18.397834+0000","last_clean":"2023-09-28T04:23:18.397834+0000","last_became_active":"2023-09-28T04:23:18.385870+0000","last_became_peered":"2023-09-28T04:23:18.385870+0000","last_unstale":"2023-09-28T04:23:18.397834+0000","last_undegraded":"2023-09-28T04:23:18.397834+0000","last_fullsized":"2023-09-28T04:23:18.397834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:29:04.985060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402660+0000","last_change":"2023-09-28T04:23:18.392534+0000","last_active":"2023-09-28T04:23:18.402660+0000","last_peered":"2023-09-28T04:23:18.402660+0000","last_clean":"2023-09-28T04:23:18.402660+0000","last_became_active":"2023-09-28T04:23:18.392245+0000","last_became_peered":"2023-09-28T04:23:18.392245+0000","last_unstale":"2023-09-28T04:23:18.402660+0000","last_undegraded":"2023-09-28T04:23:18.402660+0000","last_fullsized":"2023-09-28T04:23:18.402660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395827+0000","last_change":"2023-09-28T04:23:18.391490+0000","last_active":"2023-09-28T04:23:18.395827+0000","last_peered":"2023-09-28T04:23:18.395827+0000","last_clean":"2023-09-28T04:23:18.395827+0000","last_became_active":"2023-09-28T04:23:18.391256+0000","last_became_peered":"2023-09-28T04:23:18.391256+0000","last_unstale":"2023-09-28T04:23:18.395827+0000","last_undegraded":"2023-09-28T04:23:18.395827+0000","last_fullsized":"2023-09-28T04:23:18.395827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:28:43.639301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8912,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362928,"statfs":{"total":96636764160,"available":96627638272,"internally_reserved":0,"allocated":270336,"data_stored":662956,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8336,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363504,"statfs":{"total":96636764160,"available":96628228096,"internally_reserved":0,"allocated":204800,"data_stored":72588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.524}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.8940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8400,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363440,"statfs":{"total":96636764160,"available":96628162560,"internally_reserved":0,"allocated":204800,"data_stored":72588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8912,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362928,"statfs":{"total":96636764160,"available":96627638272,"internally_reserved":0,"allocated":270336,"data_stored":662956,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8272,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363568,"statfs":{"total":96636764160,"available":96628293632,"internally_reserved":0,"allocated":204800,"data_stored":72588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8336,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363504,"statfs":{"total":96636764160,"available":96628228096,"internally_reserved":0,"allocated":204800,"data_stored":72588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8400,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363440,"statfs":{"total":96636764160,"available":96628162560,"internally_reserved":0,"allocated":204800,"data_stored":72588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8336,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363504,"statfs":{"total":96636764160,"available":96628228096,"internally_reserved":0,"allocated":204800,"data_stored":72588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T04:23:25.180 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-28T04:23:25.180 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-28T04:23:25.180 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-28T04:23:25.181 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-28T04:23:25.181 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-28T04:23:25.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.403+0000 7f0be17ff700 1 Processor -- start 2023-09-28T04:23:25.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.404+0000 7f0be17ff700 1 -- start start 2023-09-28T04:23:25.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.405+0000 7f0be17ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bdc14fe60 0x7f0bdc156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:25.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.405+0000 7f0be17ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc0c8030 con 0x7f0bdc14fa90 2023-09-28T04:23:25.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.405+0000 7f0be17ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc0c7180 con 0x7f0bdc0c84c0 2023-09-28T04:23:25.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.405+0000 7f0be17ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0c7420 con 0x7f0bdc14fe60 2023-09-28T04:23:25.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.405+0000 7f0bdb7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f0bdc0c84c0 0x7f0bdc0adc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46256/0 (socket says 172.21.15.118:46256) 2023-09-28T04:23:25.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.405+0000 7f0bda7fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bdc14fe60 0x7f0bdc156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:25.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.405+0000 7f0bdb7fe700 1 -- 172.21.15.118:0/2139991148 learned_addr learned my addr 172.21.15.118:0/2139991148 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:25.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.405+0000 7f0bd9ffb700 1 -- 172.21.15.118:0/2139991148 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259708835 0 0) 0x7f0bdc0c7180 con 0x7f0bdc0c84c0 2023-09-28T04:23:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.405+0000 7f0bda7fc700 1 -- 172.21.15.118:0/2139991148 >> v1:172.21.15.174:6789/0 conn(0x7f0bdc0c84c0 legacy=0x7f0bdc0adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.405+0000 7f0bda7fc700 1 -- 172.21.15.118:0/2139991148 >> v1:172.21.15.118:6789/0 conn(0x7f0bdc14fa90 legacy=0x7f0bdc0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.405+0000 7f0bda7fc700 1 -- 172.21.15.118:0/2139991148 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0c7700 con 0x7f0bdc14fe60 2023-09-28T04:23:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.406+0000 7f0bda7fc700 1 --2- 172.21.15.118:0/2139991148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bdc14fe60 0x7f0bdc156430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009910 tx=0x7f0bd00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f9306dc5d033347 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.406+0000 7f0bd9ffb700 1 -- 172.21.15.118:0/2139991148 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd000b760 con 0x7f0bdc14fe60 2023-09-28T04:23:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.406+0000 7f0bd9ffb700 1 -- 172.21.15.118:0/2139991148 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd000b8c0 con 0x7f0bdc14fe60 2023-09-28T04:23:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.406+0000 7f0bd9ffb700 1 -- 172.21.15.118:0/2139991148 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd000bc60 con 0x7f0bdc14fe60 2023-09-28T04:23:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.406+0000 7f0be17ff700 1 -- 172.21.15.118:0/2139991148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bdc14fe60 msgr2=0x7f0bdc156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.406+0000 7f0be17ff700 1 --2- 172.21.15.118:0/2139991148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bdc14fe60 0x7f0bdc156430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009910 tx=0x7f0bd00091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.407+0000 7f0be17ff700 1 -- 172.21.15.118:0/2139991148 shutdown_connections 2023-09-28T04:23:25.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.407+0000 7f0be17ff700 1 --2- 172.21.15.118:0/2139991148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bdc14fe60 0x7f0bdc156430 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.407+0000 7f0be17ff700 1 -- 172.21.15.118:0/2139991148 >> 172.21.15.118:0/2139991148 conn(0x7f0bdc063cd0 msgr2=0x7f0bdc0cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:25.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.407+0000 7f0be17ff700 1 -- 172.21.15.118:0/2139991148 shutdown_connections 2023-09-28T04:23:25.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.407+0000 7f0be17ff700 1 -- 172.21.15.118:0/2139991148 wait complete. 2023-09-28T04:23:25.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.409+0000 7f0be17ff700 1 Processor -- start 2023-09-28T04:23:25.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.409+0000 7f0be17ff700 1 -- start start 2023-09-28T04:23:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.410+0000 7f0be17ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bdc0c84c0 0x7f0bdc166840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.410+0000 7f0be17ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bdc14fa90 0x7f0bdc0bfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.410+0000 7f0be17ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bdc14fe60 0x7f0bdc0c1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.410+0000 7f0be17ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0af490 con 0x7f0bdc14fe60 2023-09-28T04:23:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.410+0000 7f0be17ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0b18b0 con 0x7f0bdc0c84c0 2023-09-28T04:23:25.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.410+0000 7f0be17ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0c0540 con 0x7f0bdc14fa90 2023-09-28T04:23:25.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.410+0000 7f0bdb7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bdc14fe60 0x7f0bdc0c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:25.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.410+0000 7f0bdb7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bdc14fe60 0x7f0bdc0c1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45370/0 (socket says 172.21.15.118:45370) 2023-09-28T04:23:25.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.410+0000 7f0bdb7fe700 1 -- 172.21.15.118:0/313569022 learned_addr learned my addr 172.21.15.118:0/313569022 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:25.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.410+0000 7f0bda7fc700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bdc14fa90 0x7f0bdc0bfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:25.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.410+0000 7f0bdaffd700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bdc0c84c0 0x7f0bdc166840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:25.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.411+0000 7f0bdb7fe700 1 -- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bdc14fa90 msgr2=0x7f0bdc0bfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:25.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.411+0000 7f0bdb7fe700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bdc14fa90 0x7f0bdc0bfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.411+0000 7f0bdb7fe700 1 -- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bdc0c84c0 msgr2=0x7f0bdc166840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:25.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.411+0000 7f0bdb7fe700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bdc0c84c0 0x7f0bdc166840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.411+0000 7f0bdb7fe700 1 -- 172.21.15.118:0/313569022 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd0009420 con 0x7f0bdc14fe60 2023-09-28T04:23:25.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.411+0000 7f0bdb7fe700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bdc14fe60 0x7f0bdc0c1460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400cbf0 tx=0x7f0bd40019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.411+0000 7f0bc2ffd700 1 -- 172.21.15.118:0/313569022 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400a8b0 con 0x7f0bdc14fe60 2023-09-28T04:23:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.411+0000 7f0bc2ffd700 1 -- 172.21.15.118:0/313569022 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd400aa10 con 0x7f0bdc14fe60 2023-09-28T04:23:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.411+0000 7f0be17ff700 1 -- 172.21.15.118:0/313569022 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc0c5ab0 con 0x7f0bdc14fe60 2023-09-28T04:23:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.411+0000 7f0bc2ffd700 1 -- 172.21.15.118:0/313569022 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400add0 con 0x7f0bdc14fe60 2023-09-28T04:23:25.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.411+0000 7f0be17ff700 1 -- 172.21.15.118:0/313569022 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc0b1d70 con 0x7f0bdc14fe60 2023-09-28T04:23:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.412+0000 7f0be17ff700 1 -- 172.21.15.118:0/313569022 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc0c0760 con 0x7f0bdc14fe60 2023-09-28T04:23:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.413+0000 7f0bc2ffd700 1 -- 172.21.15.118:0/313569022 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0bd4007300 con 0x7f0bdc14fe60 2023-09-28T04:23:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.414+0000 7f0bc2ffd700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f0bc8067330 0x7f0bc80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.414+0000 7f0bc2ffd700 1 -- 172.21.15.118:0/313569022 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0bd4084e30 con 0x7f0bdc14fe60 2023-09-28T04:23:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.414+0000 7f0bdaffd700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f0bc8067330 0x7f0bc80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:25.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.415+0000 7f0bdaffd700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f0bc8067330 0x7f0bc80697e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc000f60 tx=0x7f0bcc007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:25.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.418+0000 7f0bc2ffd700 1 -- 172.21.15.118:0/313569022 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0bdc0c0760 con 0x7f0bdc14fe60 2023-09-28T04:23:25.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.657+0000 7f0be17ff700 1 -- 172.21.15.118:0/313569022 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0bdc0c0700 con 0x7f0bdc14fe60 2023-09-28T04:23:25.660 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.660+0000 7f0bc2ffd700 1 -- 172.21.15.118:0/313569022 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) v1 ==== 74+0+164228 (secure 0 0 0) 0x7f0bd4051db0 con 0x7f0bdc14fe60 2023-09-28T04:23:25.663 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:25.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.663+0000 7f0be17ff700 1 -- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f0bc8067330 msgr2=0x7f0bc80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:25.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.663+0000 7f0be17ff700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f0bc8067330 0x7f0bc80697e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc000f60 tx=0x7f0bcc007ea0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.663+0000 7f0be17ff700 1 -- 172.21.15.118:0/313569022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bdc14fe60 msgr2=0x7f0bdc0c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:25.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.663+0000 7f0be17ff700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bdc14fe60 0x7f0bdc0c1460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400cbf0 tx=0x7f0bd40019b0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.664+0000 7f0be17ff700 1 -- 172.21.15.118:0/313569022 shutdown_connections 2023-09-28T04:23:25.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.664+0000 7f0be17ff700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f0bc8067330 0x7f0bc80697e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.664+0000 7f0be17ff700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bdc14fe60 0x7f0bdc0c1460 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.664+0000 7f0be17ff700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bdc0c84c0 0x7f0bdc166840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.664+0000 7f0be17ff700 1 --2- 172.21.15.118:0/313569022 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0bdc14fa90 0x7f0bdc0bfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.664+0000 7f0be17ff700 1 -- 172.21.15.118:0/313569022 >> 172.21.15.118:0/313569022 conn(0x7f0bdc063cd0 msgr2=0x7f0bdc1557c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:25.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.664+0000 7f0be17ff700 1 -- 172.21.15.118:0/313569022 shutdown_connections 2023-09-28T04:23:25.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.664+0000 7f0be17ff700 1 -- 172.21.15.118:0/313569022 wait complete. 2023-09-28T04:23:25.682 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":6,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":119178},{"type":"v1","addr":"172.21.15.174:6833","nonce":119178}]},"active_addr":"172.21.15.174:6833/119178","active_change":"2023-09-28T04:23:04.512428+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":588860374}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":4113298708}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":3475211368}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":2248111969}]}]} 2023-09-28T04:23:25.686 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-28T04:23:25.686 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-28T04:23:25.686 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:25.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.874+0000 7fc15d1ff700 1 Processor -- start 2023-09-28T04:23:25.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.874+0000 7fc15d1ff700 1 -- start start 2023-09-28T04:23:25.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.875+0000 7fc15d1ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc15814f8b0 0x7fc1581557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:25.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.875+0000 7fc15d1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15814fc80 0x7fc1580c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:25.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.875+0000 7fc15d1ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1580633d0 con 0x7fc1580676a0 2023-09-28T04:23:25.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.875+0000 7fc15d1ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1580c44b0 con 0x7fc15814f8b0 2023-09-28T04:23:25.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.875+0000 7fc15d1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580bbd50 con 0x7fc15814fc80 2023-09-28T04:23:25.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.875+0000 7fc156d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc15814f8b0 0x7fc1581557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:25.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.875+0000 7fc15759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15814fc80 0x7fc1580c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:25.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.875+0000 7fc156d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc15814f8b0 0x7fc1581557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45384/0 (socket says 172.21.15.118:45384) 2023-09-28T04:23:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.875+0000 7fc156d9d700 1 -- 172.21.15.118:0/3981796742 learned_addr learned my addr 172.21.15.118:0/3981796742 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.875+0000 7fc15659c700 1 --1- 172.21.15.118:0/3981796742 >> v1:172.21.15.174:6789/0 conn(0x7fc1580676a0 0x7fc1580c8350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46266/0 (socket says 172.21.15.118:46266) 2023-09-28T04:23:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.876+0000 7fc15759e700 1 -- 172.21.15.118:0/3981796742 >> v2:172.21.15.118:3300/0 conn(0x7fc15814f8b0 msgr2=0x7fc1581557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.876+0000 7fc15759e700 1 --2- 172.21.15.118:0/3981796742 >> v2:172.21.15.118:3300/0 conn(0x7fc15814f8b0 0x7fc1581557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.876+0000 7fc15759e700 1 -- 172.21.15.118:0/3981796742 >> v1:172.21.15.174:6789/0 conn(0x7fc1580676a0 legacy=0x7fc1580c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.876+0000 7fc155d9b700 1 -- 172.21.15.118:0/3981796742 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151406086 0 0) 0x7fc1580633d0 con 0x7fc1580676a0 2023-09-28T04:23:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.876+0000 7fc15759e700 1 -- 172.21.15.118:0/3981796742 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1580636b0 con 0x7fc15814fc80 2023-09-28T04:23:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.876+0000 7fc15759e700 1 --2- 172.21.15.118:0/3981796742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15814fc80 0x7fc1580c8fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc150009e60 tx=0x7fc150009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b674afa4739ebb65 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.876+0000 7fc155d9b700 1 -- 172.21.15.118:0/3981796742 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15000e070 con 0x7fc15814fc80 2023-09-28T04:23:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.876+0000 7fc155d9b700 1 -- 172.21.15.118:0/3981796742 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15000bb60 con 0x7fc15814fc80 2023-09-28T04:23:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.876+0000 7fc155d9b700 1 -- 172.21.15.118:0/3981796742 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc150012430 con 0x7fc15814fc80 2023-09-28T04:23:25.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.877+0000 7fc15d1ff700 1 -- 172.21.15.118:0/3981796742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15814fc80 msgr2=0x7fc1580c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:25.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.877+0000 7fc15d1ff700 1 --2- 172.21.15.118:0/3981796742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15814fc80 0x7fc1580c8fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc150009e60 tx=0x7fc150009780 comp rx=0 tx=0).stop 2023-09-28T04:23:25.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.877+0000 7fc15d1ff700 1 -- 172.21.15.118:0/3981796742 shutdown_connections 2023-09-28T04:23:25.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.877+0000 7fc15d1ff700 1 --2- 172.21.15.118:0/3981796742 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15814fc80 0x7fc1580c8fa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.877+0000 7fc15d1ff700 1 --2- 172.21.15.118:0/3981796742 >> v2:172.21.15.118:3300/0 conn(0x7fc15814f8b0 0x7fc1581557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.877+0000 7fc15d1ff700 1 -- 172.21.15.118:0/3981796742 >> 172.21.15.118:0/3981796742 conn(0x7fc15806a3b0 msgr2=0x7fc15806a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:25.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.877+0000 7fc15d1ff700 1 -- 172.21.15.118:0/3981796742 shutdown_connections 2023-09-28T04:23:25.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.877+0000 7fc15d1ff700 1 -- 172.21.15.118:0/3981796742 wait complete. 2023-09-28T04:23:25.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.878+0000 7fc15d1ff700 1 Processor -- start 2023-09-28T04:23:25.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.879+0000 7fc15d1ff700 1 -- start start 2023-09-28T04:23:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.879+0000 7fc15d1ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1580676a0 0x7fc15814e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.879+0000 7fc15d1ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc15814f8b0 0x7fc1580c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.879+0000 7fc15d1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15814fc80 0x7fc158152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.879+0000 7fc15d1ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580c6960 con 0x7fc15814f8b0 2023-09-28T04:23:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.879+0000 7fc15d1ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc158159dc0 con 0x7fc1580676a0 2023-09-28T04:23:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.879+0000 7fc15d1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580c63a0 con 0x7fc15814fc80 2023-09-28T04:23:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.880+0000 7fc15659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc15814f8b0 0x7fc1580c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.880+0000 7fc156d9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1580676a0 0x7fc15814e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.880+0000 7fc15759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15814fc80 0x7fc158152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.880+0000 7fc15659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc15814f8b0 0x7fc1580c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45398/0 (socket says 172.21.15.118:45398) 2023-09-28T04:23:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.880+0000 7fc15659c700 1 -- 172.21.15.118:0/1905306825 learned_addr learned my addr 172.21.15.118:0/1905306825 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.880+0000 7fc15659c700 1 -- 172.21.15.118:0/1905306825 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15814fc80 msgr2=0x7fc158152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.880+0000 7fc15659c700 1 --2- 172.21.15.118:0/1905306825 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15814fc80 0x7fc158152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.880+0000 7fc15659c700 1 -- 172.21.15.118:0/1905306825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1580676a0 msgr2=0x7fc15814e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:25.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.880+0000 7fc15659c700 1 --2- 172.21.15.118:0/1905306825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1580676a0 0x7fc15814e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:25.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.880+0000 7fc15659c700 1 -- 172.21.15.118:0/1905306825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc150009a20 con 0x7fc15814f8b0 2023-09-28T04:23:25.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.880+0000 7fc15659c700 1 --2- 172.21.15.118:0/1905306825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc15814f8b0 0x7fc1580c6f10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00c7e0 tx=0x7fc14c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:25.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.881+0000 7fc13effd700 1 -- 172.21.15.118:0/1905306825 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c005b40 con 0x7fc15814f8b0 2023-09-28T04:23:25.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.881+0000 7fc15d1ff700 1 -- 172.21.15.118:0/1905306825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1580c6680 con 0x7fc15814f8b0 2023-09-28T04:23:25.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.881+0000 7fc13effd700 1 -- 172.21.15.118:0/1905306825 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14c005cc0 con 0x7fc15814f8b0 2023-09-28T04:23:25.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.881+0000 7fc13effd700 1 -- 172.21.15.118:0/1905306825 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c007320 con 0x7fc15814f8b0 2023-09-28T04:23:25.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.881+0000 7fc15d1ff700 1 -- 172.21.15.118:0/1905306825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15815bd30 con 0x7fc15814f8b0 2023-09-28T04:23:25.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.882+0000 7fc15d1ff700 1 -- 172.21.15.118:0/1905306825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15815bef0 con 0x7fc15814f8b0 2023-09-28T04:23:25.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.883+0000 7fc13effd700 1 -- 172.21.15.118:0/1905306825 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc14c01b3b0 con 0x7fc15814f8b0 2023-09-28T04:23:25.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.883+0000 7fc13effd700 1 --2- 172.21.15.118:0/1905306825 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc144067330 0x7fc1440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:25.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.883+0000 7fc13effd700 1 -- 172.21.15.118:0/1905306825 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc14c084130 con 0x7fc15814f8b0 2023-09-28T04:23:25.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.884+0000 7fc156d9d700 1 --2- 172.21.15.118:0/1905306825 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc144067330 0x7fc1440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:25.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.884+0000 7fc156d9d700 1 --2- 172.21.15.118:0/1905306825 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc144067330 0x7fc1440697e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc148009da0 tx=0x7fc148009220 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:25.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:25.888+0000 7fc13effd700 1 -- 172.21.15.118:0/1905306825 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc14c050f90 con 0x7fc15814f8b0 2023-09-28T04:23:26.084 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.083+0000 7fc15d1ff700 1 -- 172.21.15.118:0/1905306825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc15815c0a0 con 0x7fc15814f8b0 2023-09-28T04:23:26.084 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.084+0000 7fc13effd700 1 -- 172.21.15.118:0/1905306825 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fc15815c0a0 con 0x7fc15814f8b0 2023-09-28T04:23:26.085 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:26.085 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:19.371938+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T04:23:10.586895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T04:23:10.697802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T04:23:16.491417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T04:23:17.349188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:07.142219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.951857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.911133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.882482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.688096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.764671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.767264+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.763816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:26.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.086+0000 7fc15d1ff700 1 -- 172.21.15.118:0/1905306825 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc144067330 msgr2=0x7fc1440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.086+0000 7fc15d1ff700 1 --2- 172.21.15.118:0/1905306825 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc144067330 0x7fc1440697e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc148009da0 tx=0x7fc148009220 comp rx=0 tx=0).stop 2023-09-28T04:23:26.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.086+0000 7fc15d1ff700 1 -- 172.21.15.118:0/1905306825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc15814f8b0 msgr2=0x7fc1580c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.086+0000 7fc15d1ff700 1 --2- 172.21.15.118:0/1905306825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc15814f8b0 0x7fc1580c6f10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00c7e0 tx=0x7fc14c007de0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.086+0000 7fc15d1ff700 1 -- 172.21.15.118:0/1905306825 shutdown_connections 2023-09-28T04:23:26.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.086+0000 7fc15d1ff700 1 --2- 172.21.15.118:0/1905306825 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc144067330 0x7fc1440697e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.086+0000 7fc15d1ff700 1 --2- 172.21.15.118:0/1905306825 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc15814fc80 0x7fc158152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.086+0000 7fc15d1ff700 1 --2- 172.21.15.118:0/1905306825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1580676a0 0x7fc15814e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.086+0000 7fc15d1ff700 1 --2- 172.21.15.118:0/1905306825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc15814f8b0 0x7fc1580c6f10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.086+0000 7fc15d1ff700 1 -- 172.21.15.118:0/1905306825 >> 172.21.15.118:0/1905306825 conn(0x7fc15806a3b0 msgr2=0x7fc1580c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.086+0000 7fc15d1ff700 1 -- 172.21.15.118:0/1905306825 shutdown_connections 2023-09-28T04:23:26.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.086+0000 7fc15d1ff700 1 -- 172.21.15.118:0/1905306825 wait complete. 2023-09-28T04:23:26.104 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-28T04:23:26.104 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:26.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.292+0000 7f1af19ff700 1 Processor -- start 2023-09-28T04:23:26.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.292+0000 7f1af19ff700 1 -- start start 2023-09-28T04:23:26.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.293+0000 7f1af19ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1aec14fa90 0x7f1aec156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.293+0000 7f1af19ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aec14fe60 0x7f1aec068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.293+0000 7f1af19ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1aec0c84c0 0x7f1aec0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.293+0000 7f1af19ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec0c8030 con 0x7f1aec0c84c0 2023-09-28T04:23:26.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.293+0000 7f1af19ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec0c7180 con 0x7f1aec14fa90 2023-09-28T04:23:26.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.293+0000 7f1af19ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0c7420 con 0x7f1aec14fe60 2023-09-28T04:23:26.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.293+0000 7f1aeb7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1aec0c84c0 0x7f1aec0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.293+0000 7f1aeaffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1aec14fa90 0x7f1aec156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.293+0000 7f1aea7fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aec14fe60 0x7f1aec068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.293+0000 7f1aeb7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1aec0c84c0 0x7f1aec0cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45410/0 (socket says 172.21.15.118:45410) 2023-09-28T04:23:26.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.293+0000 7f1aeb7fe700 1 -- 172.21.15.118:0/560396312 learned_addr learned my addr 172.21.15.118:0/560396312 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:26.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.293+0000 7f1aeaffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1aec14fa90 0x7f1aec156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42260/0 (socket says 172.21.15.118:42260) 2023-09-28T04:23:26.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.294+0000 7f1aeb7fe700 1 -- 172.21.15.118:0/560396312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aec14fe60 msgr2=0x7f1aec068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.294+0000 7f1aeb7fe700 1 --2- 172.21.15.118:0/560396312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aec14fe60 0x7f1aec068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.294+0000 7f1aeb7fe700 1 -- 172.21.15.118:0/560396312 >> v2:172.21.15.174:3300/0 conn(0x7f1aec14fa90 msgr2=0x7f1aec156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.294+0000 7f1aeb7fe700 1 --2- 172.21.15.118:0/560396312 >> v2:172.21.15.174:3300/0 conn(0x7f1aec14fa90 0x7f1aec156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.294+0000 7f1aeb7fe700 1 -- 172.21.15.118:0/560396312 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0c7700 con 0x7f1aec0c84c0 2023-09-28T04:23:26.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.294+0000 7f1aeb7fe700 1 --2- 172.21.15.118:0/560396312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1aec0c84c0 0x7f1aec0cc690 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1aec089480 tx=0x7f1ae4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb65f6f1f8e03d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.294+0000 7f1ae9ffb700 1 -- 172.21.15.118:0/560396312 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae400e070 con 0x7f1aec0c84c0 2023-09-28T04:23:26.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.294+0000 7f1ae9ffb700 1 -- 172.21.15.118:0/560396312 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae400b970 con 0x7f1aec0c84c0 2023-09-28T04:23:26.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.294+0000 7f1ae9ffb700 1 -- 172.21.15.118:0/560396312 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae40092e0 con 0x7f1aec0c84c0 2023-09-28T04:23:26.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.295+0000 7f1af19ff700 1 -- 172.21.15.118:0/560396312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1aec0c84c0 msgr2=0x7f1aec0cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.295+0000 7f1af19ff700 1 --2- 172.21.15.118:0/560396312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1aec0c84c0 0x7f1aec0cc690 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1aec089480 tx=0x7f1ae4009840 comp rx=0 tx=0).stop 2023-09-28T04:23:26.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.295+0000 7f1af19ff700 1 -- 172.21.15.118:0/560396312 shutdown_connections 2023-09-28T04:23:26.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.295+0000 7f1af19ff700 1 --2- 172.21.15.118:0/560396312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1aec0c84c0 0x7f1aec0cc690 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.295+0000 7f1af19ff700 1 --2- 172.21.15.118:0/560396312 >> v2:172.21.15.174:3300/0 conn(0x7f1aec14fa90 0x7f1aec156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.295+0000 7f1af19ff700 1 --2- 172.21.15.118:0/560396312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aec14fe60 0x7f1aec068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.295+0000 7f1af19ff700 1 -- 172.21.15.118:0/560396312 >> 172.21.15.118:0/560396312 conn(0x7f1aec063cd0 msgr2=0x7f1aec0cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.295+0000 7f1af19ff700 1 -- 172.21.15.118:0/560396312 shutdown_connections 2023-09-28T04:23:26.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.295+0000 7f1af19ff700 1 -- 172.21.15.118:0/560396312 wait complete. 2023-09-28T04:23:26.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.296+0000 7f1af19ff700 1 Processor -- start 2023-09-28T04:23:26.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.296+0000 7f1af19ff700 1 -- start start 2023-09-28T04:23:26.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.297+0000 7f1af19ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1aec0c84c0 0x7f1aec151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.297+0000 7f1af19ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aec14fa90 0x7f1aec153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.297+0000 7f1af19ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aec14fe60 0x7f1aec14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.297+0000 7f1af19ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec1550a0 con 0x7f1aec0c84c0 2023-09-28T04:23:26.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.297+0000 7f1af19ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec166270 con 0x7f1aec14fe60 2023-09-28T04:23:26.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.297+0000 7f1af19ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec1547a0 con 0x7f1aec14fa90 2023-09-28T04:23:26.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.297+0000 7f1aeaffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1aec0c84c0 0x7f1aec151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.297+0000 7f1aeaffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1aec0c84c0 0x7f1aec151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45426/0 (socket says 172.21.15.118:45426) 2023-09-28T04:23:26.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1aeaffd700 1 -- 172.21.15.118:0/755992486 learned_addr learned my addr 172.21.15.118:0/755992486 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:26.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1aea7fc700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aec14fa90 0x7f1aec153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1aeb7fe700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aec14fe60 0x7f1aec14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1aeaffd700 1 -- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aec14fa90 msgr2=0x7f1aec153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1aeaffd700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aec14fa90 0x7f1aec153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1aeaffd700 1 -- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aec14fe60 msgr2=0x7f1aec14b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1aeaffd700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aec14fe60 0x7f1aec14b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1aeaffd700 1 -- 172.21.15.118:0/755992486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae4009ae0 con 0x7f1aec0c84c0 2023-09-28T04:23:26.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1aeaffd700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1aec0c84c0 0x7f1aec151a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1adc00e960 tx=0x7f1adc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1ad2ffd700 1 -- 172.21.15.118:0/755992486 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc013680 con 0x7f1aec0c84c0 2023-09-28T04:23:26.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1ad2ffd700 1 -- 172.21.15.118:0/755992486 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc0137e0 con 0x7f1aec0c84c0 2023-09-28T04:23:26.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1af19ff700 1 -- 172.21.15.118:0/755992486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aec1552f0 con 0x7f1aec0c84c0 2023-09-28T04:23:26.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1ad2ffd700 1 -- 172.21.15.118:0/755992486 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc013b80 con 0x7f1aec0c84c0 2023-09-28T04:23:26.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.298+0000 7f1af19ff700 1 -- 172.21.15.118:0/755992486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec165f00 con 0x7f1aec0c84c0 2023-09-28T04:23:26.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.300+0000 7f1af19ff700 1 -- 172.21.15.118:0/755992486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aec068180 con 0x7f1aec0c84c0 2023-09-28T04:23:26.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.300+0000 7f1ad2ffd700 1 -- 172.21.15.118:0/755992486 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1adc0123d0 con 0x7f1aec0c84c0 2023-09-28T04:23:26.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.301+0000 7f1ad2ffd700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1ad8067330 0x7f1ad80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.301+0000 7f1ad2ffd700 1 -- 172.21.15.118:0/755992486 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1adc085070 con 0x7f1aec0c84c0 2023-09-28T04:23:26.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.301+0000 7f1aea7fc700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1ad8067330 0x7f1ad80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.302+0000 7f1aea7fc700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1ad8067330 0x7f1ad80697e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1aec1532a0 tx=0x7f1ae00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.305+0000 7f1ad2ffd700 1 -- 172.21.15.118:0/755992486 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1adc051ed0 con 0x7f1aec0c84c0 2023-09-28T04:23:26.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.503+0000 7f1af19ff700 1 -- 172.21.15.118:0/755992486 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1aec071980 con 0x7f1aec0c84c0 2023-09-28T04:23:26.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.504+0000 7f1ad2ffd700 1 -- 172.21.15.118:0/755992486 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f1adc017090 con 0x7f1aec0c84c0 2023-09-28T04:23:26.505 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:26.505 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:19.371938+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T04:23:10.586895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T04:23:10.697802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T04:23:16.491417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T04:23:17.349188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:07.142219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.951857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.911133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.882482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.688096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.764671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.767264+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.763816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:26.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.506+0000 7f1af19ff700 1 -- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1ad8067330 msgr2=0x7f1ad80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.506+0000 7f1af19ff700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1ad8067330 0x7f1ad80697e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1aec1532a0 tx=0x7f1ae00091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.506+0000 7f1af19ff700 1 -- 172.21.15.118:0/755992486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1aec0c84c0 msgr2=0x7f1aec151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.506+0000 7f1af19ff700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1aec0c84c0 0x7f1aec151a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1adc00e960 tx=0x7f1adc0091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.507+0000 7f1af19ff700 1 -- 172.21.15.118:0/755992486 shutdown_connections 2023-09-28T04:23:26.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.507+0000 7f1af19ff700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1ad8067330 0x7f1ad80697e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.507+0000 7f1af19ff700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aec14fe60 0x7f1aec14b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.507+0000 7f1af19ff700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1aec0c84c0 0x7f1aec151a00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.507+0000 7f1af19ff700 1 --2- 172.21.15.118:0/755992486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1aec14fa90 0x7f1aec153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.507+0000 7f1af19ff700 1 -- 172.21.15.118:0/755992486 >> 172.21.15.118:0/755992486 conn(0x7f1aec063cd0 msgr2=0x7f1aec0c89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.507+0000 7f1af19ff700 1 -- 172.21.15.118:0/755992486 shutdown_connections 2023-09-28T04:23:26.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.507+0000 7f1af19ff700 1 -- 172.21.15.118:0/755992486 wait complete. 2023-09-28T04:23:26.525 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-28T04:23:26.525 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-28T04:23:26.526 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-28T04:23:26.526 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-28T04:23:26.527 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-09-28T04:23:26.527 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-09-28T04:23:26.527 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-09-28T04:23:26.528 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-09-28T04:23:26.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.859+0000 7f86e5dff700 1 Processor -- start 2023-09-28T04:23:26.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.859+0000 7f86e5dff700 1 -- start start 2023-09-28T04:23:26.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.861+0000 7f86e5dff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f86e006e9f0 0x7f86e00c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.862+0000 7f86e5dff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e00c3760 con 0x7f86e01658c0 2023-09-28T04:23:26.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.862+0000 7f86e5dff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e00c2900 con 0x7f86e00c2530 2023-09-28T04:23:26.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.862+0000 7f86e5dff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e006e5d0 con 0x7f86e006e9f0 2023-09-28T04:23:26.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.863+0000 7f86df7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f86e00c2530 0x7f86e00c1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46278/0 (socket says 172.21.15.118:46278) 2023-09-28T04:23:26.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.863+0000 7f86df7fe700 1 -- 172.21.15.118:0/2361223595 learned_addr learned my addr 172.21.15.118:0/2361223595 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:26.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.864+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961494747 0 0) 0x7f86d0001110 con 0x7f86e00c2530 2023-09-28T04:23:26.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.864+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c800bd80 con 0x7f86e00c2530 2023-09-28T04:23:26.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.864+0000 7f86deffd700 1 --2- 172.21.15.118:0/2361223595 >> v2:172.21.15.118:3300/0 conn(0x7f86e006e9f0 0x7f86e00c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.864+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792874770 0 0) 0x7f86e00c3760 con 0x7f86e01658c0 2023-09-28T04:23:26.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.864+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d0001110 con 0x7f86e01658c0 2023-09-28T04:23:26.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.865+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3439193725 0 0) 0x7f86d0001110 con 0x7f86e01658c0 2023-09-28T04:23:26.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.865+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 >> v2:172.21.15.118:3300/0 conn(0x7f86e006e9f0 msgr2=0x7f86e00c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.865+0000 7f86de7fc700 1 --2- 172.21.15.118:0/2361223595 >> v2:172.21.15.118:3300/0 conn(0x7f86e006e9f0 0x7f86e00c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.865+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 >> v1:172.21.15.174:6789/0 conn(0x7f86e00c2530 legacy=0x7f86e00c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.865+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e006d9e0 con 0x7f86e01658c0 2023-09-28T04:23:26.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.865+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 605954562 0 0) 0x7f86d4001470 con 0x7f86e01658c0 2023-09-28T04:23:26.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.865+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 >> v1:172.21.15.118:6789/0 conn(0x7f86e01658c0 legacy=0x7f86e0165d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.865+0000 7f86de7fc700 1 --2- 172.21.15.118:0/2361223595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c800c400 0x7f86c800c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.865+0000 7f86de7fc700 1 --2- 172.21.15.118:0/2361223595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86c800d020 0x7f86c800d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.865+0000 7f86de7fc700 1 --2- 172.21.15.118:0/2361223595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86c800d9d0 0x7f86c80094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.865+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e006e5d0 con 0x7f86c800c400 2023-09-28T04:23:26.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.865+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8009bc0 con 0x7f86c800d9d0 2023-09-28T04:23:26.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.865+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8009d80 con 0x7f86c800d020 2023-09-28T04:23:26.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.866+0000 7f86deffd700 1 --2- 172.21.15.118:0/2361223595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86c800d020 0x7f86c800d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.866+0000 7f86dffff700 1 --2- 172.21.15.118:0/2361223595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86c800d9d0 0x7f86c80094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.866+0000 7f86df7fe700 1 --2- 172.21.15.118:0/2361223595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c800c400 0x7f86c800c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.866+0000 7f86deffd700 1 -- 172.21.15.118:0/2361223595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86c800d9d0 msgr2=0x7f86c80094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.866+0000 7f86deffd700 1 --2- 172.21.15.118:0/2361223595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86c800d9d0 0x7f86c80094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.866+0000 7f86deffd700 1 -- 172.21.15.118:0/2361223595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c800c400 msgr2=0x7f86c800c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.866+0000 7f86deffd700 1 --2- 172.21.15.118:0/2361223595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c800c400 0x7f86c800c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.866+0000 7f86deffd700 1 -- 172.21.15.118:0/2361223595 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e006d9e0 con 0x7f86c800d020 2023-09-28T04:23:26.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.867+0000 7f86deffd700 1 --2- 172.21.15.118:0/2361223595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86c800d020 0x7f86c800d490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86d80074b0 tx=0x7f86d8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39bbf3fa5e2e746e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.868+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8007d60 con 0x7f86c800d020 2023-09-28T04:23:26.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.868+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d800f040 con 0x7f86c800d020 2023-09-28T04:23:26.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.868+0000 7f86de7fc700 1 -- 172.21.15.118:0/2361223595 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8013640 con 0x7f86c800d020 2023-09-28T04:23:26.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.868+0000 7f86dffff700 1 -- 172.21.15.118:0/2361223595 reap_dead start 2023-09-28T04:23:26.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.869+0000 7f86e5dff700 1 -- 172.21.15.118:0/2361223595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86c800d020 msgr2=0x7f86c800d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.869+0000 7f86e5dff700 1 --2- 172.21.15.118:0/2361223595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86c800d020 0x7f86c800d490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86d80074b0 tx=0x7f86d8009780 comp rx=0 tx=0).stop 2023-09-28T04:23:26.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.869+0000 7f86e5dff700 1 -- 172.21.15.118:0/2361223595 shutdown_connections 2023-09-28T04:23:26.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.869+0000 7f86e5dff700 1 --2- 172.21.15.118:0/2361223595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86c800d020 0x7f86c800d490 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.869+0000 7f86e5dff700 1 -- 172.21.15.118:0/2361223595 >> 172.21.15.118:0/2361223595 conn(0x7f86e0067630 msgr2=0x7f86e0067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.869+0000 7fc0625ff700 1 Processor -- start 2023-09-28T04:23:26.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.870+0000 7f86e5dff700 1 -- 172.21.15.118:0/2361223595 shutdown_connections 2023-09-28T04:23:26.873 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.870+0000 7f86e5dff700 1 -- 172.21.15.118:0/2361223595 wait complete. 2023-09-28T04:23:26.873 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.873+0000 7f86e5dff700 1 Processor -- start 2023-09-28T04:23:26.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.873+0000 7f86e5dff700 1 -- start start 2023-09-28T04:23:26.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.870+0000 7fc0625ff700 1 -- start start 2023-09-28T04:23:26.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.872+0000 7fc0625ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc05c152250 0x7fc05c14b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.872+0000 7fc0625ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05c0c4fb0 con 0x7fc05c0c2ae0 2023-09-28T04:23:26.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.872+0000 7fc0625ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05c155be0 con 0x7fc05c0c2710 2023-09-28T04:23:26.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.872+0000 7fc0625ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05c154fd0 con 0x7fc05c152250 2023-09-28T04:23:26.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.873+0000 7fc05b7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fc05c0c2ae0 0x7fc05c151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46122/0 (socket says 172.21.15.118:46122) 2023-09-28T04:23:26.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.874+0000 7fc05b7fe700 1 -- 172.21.15.118:0/2849186798 learned_addr learned my addr 172.21.15.118:0/2849186798 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:26.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.874+0000 7fc060b9c700 1 --2- 172.21.15.118:0/2849186798 >> v2:172.21.15.174:3300/0 conn(0x7fc05c152250 0x7fc05c14b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.874+0000 7f86e5dff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c800d020 0x7f86e00c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.874+0000 7f86e5dff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86e0171b20 0x7f86e0173020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.874+0000 7f86e5dff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86e0166b90 0x7f86e00bd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.874+0000 7f86e5dff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00b4650 con 0x7f86c800d020 2023-09-28T04:23:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.874+0000 7f86e5dff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00c3d20 con 0x7f86e0171b20 2023-09-28T04:23:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.874+0000 7f86e5dff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e0172a60 con 0x7f86e0166b90 2023-09-28T04:23:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.875+0000 7f86df7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c800d020 0x7f86e00c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.875+0000 7f86df7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c800d020 0x7f86e00c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45450/0 (socket says 172.21.15.118:45450) 2023-09-28T04:23:26.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.875+0000 7f86df7fe700 1 -- 172.21.15.118:0/2067664053 learned_addr learned my addr 172.21.15.118:0/2067664053 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:26.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.875+0000 7f86dffff700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86e0166b90 0x7f86e00bd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.875+0000 7f86deffd700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86e0171b20 0x7f86e0173020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.876+0000 7f86dffff700 1 -- 172.21.15.118:0/2067664053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86e0171b20 msgr2=0x7f86e0173020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.876+0000 7f86dffff700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86e0171b20 0x7f86e0173020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.876+0000 7f86dffff700 1 -- 172.21.15.118:0/2067664053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c800d020 msgr2=0x7f86e00c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.876+0000 7f86dffff700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86c800d020 0x7f86e00c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.876+0000 7f86dffff700 1 -- 172.21.15.118:0/2067664053 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e00c3110 con 0x7f86e0166b90 2023-09-28T04:23:26.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.876+0000 7f86dffff700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86e0166b90 0x7f86e00bd7a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f86e00c2f40 tx=0x7f86d4002e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.876+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644963142 0 0) 0x7fc05c0c4fb0 con 0x7fc05c0c2ae0 2023-09-28T04:23:26.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.876+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc044003570 con 0x7fc05c0c2ae0 2023-09-28T04:23:26.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.877+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2574765989 0 0) 0x7fc044003570 con 0x7fc05c0c2ae0 2023-09-28T04:23:26.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.877+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 >> v2:172.21.15.174:3300/0 conn(0x7fc05c152250 msgr2=0x7fc05c14b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.877+0000 7fc05affd700 1 --2- 172.21.15.118:0/2849186798 >> v2:172.21.15.174:3300/0 conn(0x7fc05c152250 0x7fc05c14b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.877+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 >> v1:172.21.15.174:6789/0 conn(0x7fc05c0c2710 legacy=0x7fc05c0c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.877+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c1552b0 con 0x7fc05c0c2ae0 2023-09-28T04:23:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.877+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 605954562 0 0) 0x7fc050004cd0 con 0x7fc05c0c2ae0 2023-09-28T04:23:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.877+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 >> v1:172.21.15.118:6789/0 conn(0x7fc05c0c2ae0 legacy=0x7fc05c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.877+0000 7fc05affd700 1 --2- 172.21.15.118:0/2849186798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc044003ae0 0x7fc044003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.877+0000 7fc05affd700 1 --2- 172.21.15.118:0/2849186798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc044004810 0x7fc044004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.877+0000 7fc05affd700 1 --2- 172.21.15.118:0/2849186798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0440052e0 0x7fc04400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.877+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c154fd0 con 0x7fc0440052e0 2023-09-28T04:23:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.877+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04400c260 con 0x7fc044003ae0 2023-09-28T04:23:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.877+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04400c420 con 0x7fc044004810 2023-09-28T04:23:26.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.876+0000 7f86c77fe700 1 -- 172.21.15.118:0/2067664053 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4019070 con 0x7f86e0166b90 2023-09-28T04:23:26.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.876+0000 7f86c77fe700 1 -- 172.21.15.118:0/2067664053 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d4014680 con 0x7f86e0166b90 2023-09-28T04:23:26.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.876+0000 7f86c77fe700 1 -- 172.21.15.118:0/2067664053 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4014a80 con 0x7f86e0166b90 2023-09-28T04:23:26.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.878+0000 7f86e5dff700 1 -- 172.21.15.118:0/2067664053 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e00c33f0 con 0x7f86e0166b90 2023-09-28T04:23:26.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.878+0000 7f86e5dff700 1 -- 172.21.15.118:0/2067664053 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e00c39b0 con 0x7f86e0166b90 2023-09-28T04:23:26.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.879+0000 7fc05b7fe700 1 --2- 172.21.15.118:0/2849186798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc044004810 0x7fc044004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.879+0000 7fc05bfff700 1 --2- 172.21.15.118:0/2849186798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc044003ae0 0x7fc044003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.879+0000 7f86e5dff700 1 -- 172.21.15.118:0/2067664053 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86e0071980 con 0x7f86e0166b90 2023-09-28T04:23:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.879+0000 7fc060b9c700 1 --2- 172.21.15.118:0/2849186798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0440052e0 0x7fc04400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.879+0000 7fc05b7fe700 1 -- 172.21.15.118:0/2849186798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc044003ae0 msgr2=0x7fc044003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.879+0000 7fc05b7fe700 1 --2- 172.21.15.118:0/2849186798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc044003ae0 0x7fc044003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.879+0000 7fc05b7fe700 1 -- 172.21.15.118:0/2849186798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0440052e0 msgr2=0x7fc04400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.879+0000 7fc05b7fe700 1 --2- 172.21.15.118:0/2849186798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0440052e0 0x7fc04400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.879+0000 7fc05b7fe700 1 -- 172.21.15.118:0/2849186798 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c1552b0 con 0x7fc044004810 2023-09-28T04:23:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.880+0000 7fc060b9c700 1 --2- 172.21.15.118:0/2849186798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0440052e0 0x7fc04400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T04:23:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.880+0000 7fc060b9c700 1 -- 172.21.15.118:0/2849186798 reap_dead start 2023-09-28T04:23:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.880+0000 7fc05b7fe700 1 --2- 172.21.15.118:0/2849186798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc044004810 0x7fc044004c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc05000d5a0 tx=0x7fc050001670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d775a5cf7c01289 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.882+0000 7f86c77fe700 1 -- 172.21.15.118:0/2067664053 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f86d4028430 con 0x7f86e0166b90 2023-09-28T04:23:26.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.884+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050012070 con 0x7fc044004810 2023-09-28T04:23:26.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.884+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05000d110 con 0x7fc044004810 2023-09-28T04:23:26.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.884+0000 7fc05affd700 1 -- 172.21.15.118:0/2849186798 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0500019a0 con 0x7fc044004810 2023-09-28T04:23:26.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.884+0000 7f86c77fe700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f86cc0674b0 0x7f86cc069960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.884+0000 7f86c77fe700 1 -- 172.21.15.118:0/2067664053 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f86d40853d0 con 0x7f86e0166b90 2023-09-28T04:23:26.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.884+0000 7f86c77fe700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] conn(0x7f86cc06fd60 0x7f86cc072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.884+0000 7f86c77fe700 1 -- 172.21.15.118:0/2067664053 --> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86cc072820 con 0x7f86cc06fd60 2023-09-28T04:23:26.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.884+0000 7f86c77fe700 1 -- 172.21.15.118:0/2067664053 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86d4085700 con 0x7f86e0166b90 2023-09-28T04:23:26.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.885+0000 7f86df7fe700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f86cc0674b0 0x7f86cc069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.885+0000 7fc0625ff700 1 -- 172.21.15.118:0/2849186798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc044004810 msgr2=0x7fc044004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.885+0000 7fc0625ff700 1 --2- 172.21.15.118:0/2849186798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc044004810 0x7fc044004c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc05000d5a0 tx=0x7fc050001670 comp rx=0 tx=0).stop 2023-09-28T04:23:26.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.885+0000 7fc0625ff700 1 -- 172.21.15.118:0/2849186798 shutdown_connections 2023-09-28T04:23:26.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.885+0000 7fc0625ff700 1 --2- 172.21.15.118:0/2849186798 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc044004810 0x7fc044004c80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.885+0000 7fc0625ff700 1 -- 172.21.15.118:0/2849186798 >> 172.21.15.118:0/2849186798 conn(0x7fc05c067630 msgr2=0x7fc05c067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.885+0000 7f86deffd700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] conn(0x7f86cc06fd60 0x7f86cc072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.886+0000 7fc0625ff700 1 -- 172.21.15.118:0/2849186798 shutdown_connections 2023-09-28T04:23:26.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.886+0000 7fc0625ff700 1 -- 172.21.15.118:0/2849186798 wait complete. 2023-09-28T04:23:26.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.886+0000 7f86df7fe700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f86cc0674b0 0x7f86cc069960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f86d0004e30 tx=0x7f86d0007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.888+0000 7fc0625ff700 1 Processor -- start 2023-09-28T04:23:26.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.888+0000 7f0148fff700 1 Processor -- start 2023-09-28T04:23:26.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.888+0000 7f0148fff700 1 -- start start 2023-09-28T04:23:26.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.889+0000 7f86deffd700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] conn(0x7f86cc06fd60 0x7f86cc072170 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.888+0000 7fc0625ff700 1 -- start start 2023-09-28T04:23:26.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.889+0000 7f594adff700 1 Processor -- start 2023-09-28T04:23:26.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.891+0000 7fc0625ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc044004810 0x7fc05c0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.891+0000 7fc0625ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc05c0c5ce0 0x7fc05c143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.891+0000 7fc0625ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc05c0c0740 0x7fc05c0c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.891+0000 7fc0625ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0bd580 con 0x7fc05c0c0740 2023-09-28T04:23:26.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.891+0000 7fc0625ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0c8520 con 0x7fc05c0c5ce0 2023-09-28T04:23:26.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.891+0000 7fc0625ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0bd360 con 0x7fc044004810 2023-09-28T04:23:26.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.890+0000 7f594adff700 1 -- start start 2023-09-28T04:23:26.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.892+0000 7f594adff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5944153a20 0x7f5944153df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.892+0000 7f594adff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f594415d9b0 0x7f59440c3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.892+0000 7f594adff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59440c28f0 con 0x7f59440c5110 2023-09-28T04:23:26.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.892+0000 7f594adff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5944159b70 con 0x7f594415d9b0 2023-09-28T04:23:26.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.892+0000 7f594adff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594415a950 con 0x7f5944153a20 2023-09-28T04:23:26.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.893+0000 7f0148fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f01440c5110 0x7f014406de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.893+0000 7f0148fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f014406e3d0 0x7f014406e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.893+0000 7f0148fff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014406bf60 con 0x7f0144153d10 2023-09-28T04:23:26.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.893+0000 7f0148fff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014406f700 con 0x7f01440c5110 2023-09-28T04:23:26.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.893+0000 7f0148fff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014406c3f0 con 0x7f014406e3d0 2023-09-28T04:23:26.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.893+0000 7fc05b7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc05c0c5ce0 0x7fc05c143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.893+0000 7fc05bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc044004810 0x7fc05c0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.893+0000 7fc05b7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc05c0c5ce0 0x7fc05c143fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42328/0 (socket says 172.21.15.118:42328) 2023-09-28T04:23:26.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.893+0000 7fc05b7fe700 1 -- 172.21.15.118:0/1100185008 learned_addr learned my addr 172.21.15.118:0/1100185008 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:26.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7f0141d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f01440c5110 0x7f014406de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7f0141d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f01440c5110 0x7f014406de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45482/0 (socket says 172.21.15.118:45482) 2023-09-28T04:23:26.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7f0141d9b700 1 -- 172.21.15.118:0/3995977775 learned_addr learned my addr 172.21.15.118:0/3995977775 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:26.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7f5948b9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5944153a20 0x7f5944153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7f5948b9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5944153a20 0x7f5944153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:59124/0 (socket says 172.21.15.118:59124) 2023-09-28T04:23:26.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7f5948b9b700 1 -- 172.21.15.118:0/3572409595 learned_addr learned my addr 172.21.15.118:0/3572409595 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:26.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7fc05bfff700 1 -- 172.21.15.118:0/1100185008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc05c0c5ce0 msgr2=0x7fc05c143fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7fc05bfff700 1 --2- 172.21.15.118:0/1100185008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc05c0c5ce0 0x7fc05c143fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7fc05bfff700 1 -- 172.21.15.118:0/1100185008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc05c0c0740 msgr2=0x7fc05c0c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7fc05bfff700 1 --2- 172.21.15.118:0/1100185008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc05c0c0740 0x7fc05c0c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7fc05bfff700 1 -- 172.21.15.118:0/1100185008 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c0c6150 con 0x7fc044004810 2023-09-28T04:23:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7f0141d9b700 1 -- 172.21.15.118:0/3995977775 >> v2:172.21.15.174:3300/0 conn(0x7f014406e3d0 msgr2=0x7f014406e7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-28T04:23:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7f0141d9b700 1 --2- 172.21.15.118:0/3995977775 >> v2:172.21.15.174:3300/0 conn(0x7f014406e3d0 0x7f014406e7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7f0141d9b700 1 -- 172.21.15.118:0/3995977775 >> v1:172.21.15.118:6789/0 conn(0x7f0144153d10 legacy=0x7f014415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.894+0000 7f0141d9b700 1 -- 172.21.15.118:0/3995977775 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014415a510 con 0x7f01440c5110 2023-09-28T04:23:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.895+0000 7f5948b9b700 1 -- 172.21.15.118:0/3572409595 >> v2:172.21.15.118:3300/0 conn(0x7f594415d9b0 msgr2=0x7f59440c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.895+0000 7f5948b9b700 1 --2- 172.21.15.118:0/3572409595 >> v2:172.21.15.118:3300/0 conn(0x7f594415d9b0 0x7f59440c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.895+0000 7f5948b9b700 1 -- 172.21.15.118:0/3572409595 >> v1:172.21.15.118:6789/0 conn(0x7f59440c5110 legacy=0x7f59440c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.895+0000 7f5948b9b700 1 -- 172.21.15.118:0/3572409595 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944159dd0 con 0x7f5944153a20 2023-09-28T04:23:26.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.895+0000 7fc05bfff700 1 --2- 172.21.15.118:0/1100185008 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc044004810 0x7fc05c0c7750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00f930 tx=0x7fc04c007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.890+0000 7f86c77fe700 1 -- 172.21.15.118:0/2067664053 <== osd.0 v2:172.21.15.118:6819/114261 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f86cc072820 con 0x7f86cc06fd60 2023-09-28T04:23:26.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.895+0000 7f21393ff700 1 Processor -- start 2023-09-28T04:23:26.900 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.896+0000 7f5948b9b700 1 --2- 172.21.15.118:0/3572409595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5944153a20 0x7f5944153df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59340099b0 tx=0x7f5934009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c66121060bfcf9b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.900 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.896+0000 7f21393ff700 1 -- start start 2023-09-28T04:23:26.900 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.896+0000 7f0141d9b700 1 --2- 172.21.15.118:0/3995977775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01440c5110 0x7f014406de90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f01440bede0 tx=0x7f0138009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e7c43e106bcf8f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.896+0000 7f593b7fe700 1 -- 172.21.15.118:0/3572409595 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400b8b0 con 0x7f5944153a20 2023-09-28T04:23:26.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.896+0000 7f593b7fe700 1 -- 172.21.15.118:0/3572409595 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593400ba10 con 0x7f5944153a20 2023-09-28T04:23:26.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.896+0000 7f593b7fe700 1 -- 172.21.15.118:0/3572409595 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400bdb0 con 0x7f5944153a20 2023-09-28T04:23:26.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.896+0000 7fc043fff700 1 -- 172.21.15.118:0/1100185008 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c0135e0 con 0x7fc044004810 2023-09-28T04:23:26.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.896+0000 7fc043fff700 1 -- 172.21.15.118:0/1100185008 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c013740 con 0x7fc044004810 2023-09-28T04:23:26.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.896+0000 7fc043fff700 1 -- 172.21.15.118:0/1100185008 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c013b00 con 0x7fc044004810 2023-09-28T04:23:26.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.896+0000 7fc0625ff700 1 -- 172.21.15.118:0/1100185008 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05c0c1ac0 con 0x7fc044004810 2023-09-28T04:23:26.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.896+0000 7fc0625ff700 1 -- 172.21.15.118:0/1100185008 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c0c8770 con 0x7fc044004810 2023-09-28T04:23:26.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.896+0000 7f014159a700 1 -- 172.21.15.118:0/3995977775 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013800b820 con 0x7f01440c5110 2023-09-28T04:23:26.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.897+0000 7f014159a700 1 -- 172.21.15.118:0/3995977775 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013800b980 con 0x7f01440c5110 2023-09-28T04:23:26.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.897+0000 7f014159a700 1 -- 172.21.15.118:0/3995977775 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013800bd20 con 0x7f01440c5110 2023-09-28T04:23:26.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f0148fff700 1 -- 172.21.15.118:0/3995977775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01440c5110 msgr2=0x7f014406de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f0148fff700 1 --2- 172.21.15.118:0/3995977775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01440c5110 0x7f014406de90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f01440bede0 tx=0x7f0138009250 comp rx=0 tx=0).stop 2023-09-28T04:23:26.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.897+0000 7f594adff700 1 -- 172.21.15.118:0/3572409595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5944153a20 msgr2=0x7f5944153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.897+0000 7f594adff700 1 --2- 172.21.15.118:0/3572409595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5944153a20 0x7f5944153df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59340099b0 tx=0x7f5934009250 comp rx=0 tx=0).stop 2023-09-28T04:23:26.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.897+0000 7f594adff700 1 -- 172.21.15.118:0/3572409595 shutdown_connections 2023-09-28T04:23:26.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.897+0000 7f594adff700 1 --2- 172.21.15.118:0/3572409595 >> v2:172.21.15.118:3300/0 conn(0x7f594415d9b0 0x7f59440c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.897+0000 7f594adff700 1 --2- 172.21.15.118:0/3572409595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5944153a20 0x7f5944153df0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.897+0000 7f594adff700 1 -- 172.21.15.118:0/3572409595 >> 172.21.15.118:0/3572409595 conn(0x7f5944067630 msgr2=0x7f5944067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f594adff700 1 -- 172.21.15.118:0/3572409595 shutdown_connections 2023-09-28T04:23:26.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.897+0000 7f21393ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21340adf10 0x7f21341562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f21393ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f213414f9f0 0x7f21340c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f21393ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21340c7980 con 0x7f2134089830 2023-09-28T04:23:26.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f21393ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21340cce60 con 0x7f213414f9f0 2023-09-28T04:23:26.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f21393ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21340c75e0 con 0x7f21340adf10 2023-09-28T04:23:26.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f0148fff700 1 -- 172.21.15.118:0/3995977775 shutdown_connections 2023-09-28T04:23:26.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f0148fff700 1 --2- 172.21.15.118:0/3995977775 >> v2:172.21.15.174:3300/0 conn(0x7f014406e3d0 0x7f014406e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f0148fff700 1 --2- 172.21.15.118:0/3995977775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01440c5110 0x7f014406de90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f0148fff700 1 -- 172.21.15.118:0/3995977775 >> 172.21.15.118:0/3995977775 conn(0x7f0144067630 msgr2=0x7f0144067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f21337fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f213414f9f0 0x7f21340c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f21337fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f213414f9f0 0x7f21340c7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42346/0 (socket says 172.21.15.118:42346) 2023-09-28T04:23:26.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f21337fe700 1 -- 172.21.15.118:0/296192085 learned_addr learned my addr 172.21.15.118:0/296192085 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:26.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f21327fc700 1 --1- 172.21.15.118:0/296192085 >> v1:172.21.15.174:6789/0 conn(0x7f2134089830 0x7f213414f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46304/0 (socket says 172.21.15.118:46304) 2023-09-28T04:23:26.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.898+0000 7f594adff700 1 -- 172.21.15.118:0/3572409595 wait complete. 2023-09-28T04:23:26.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.899+0000 7f2132ffd700 1 --2- 172.21.15.118:0/296192085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21340adf10 0x7f21341562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.899+0000 7f2131ffb700 1 -- 172.21.15.118:0/296192085 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949308688 0 0) 0x7f21340c7980 con 0x7f2134089830 2023-09-28T04:23:26.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.899+0000 7f2131ffb700 1 -- 172.21.15.118:0/296192085 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f211c003570 con 0x7f2134089830 2023-09-28T04:23:26.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.899+0000 7febdbfff700 1 Processor -- start 2023-09-28T04:23:26.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.899+0000 7febdbfff700 1 -- start start 2023-09-28T04:23:26.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.900+0000 7f0148fff700 1 -- 172.21.15.118:0/3995977775 shutdown_connections 2023-09-28T04:23:26.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.900+0000 7f0148fff700 1 -- 172.21.15.118:0/3995977775 wait complete. 2023-09-28T04:23:26.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.900+0000 7fc0625ff700 1 -- 172.21.15.118:0/1100185008 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc03c000fd0 con 0x7fc044004810 2023-09-28T04:23:26.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7f0148fff700 1 Processor -- start 2023-09-28T04:23:26.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.900+0000 7fdce27ff700 1 Processor -- start 2023-09-28T04:23:26.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.901+0000 7fdce27ff700 1 -- start start 2023-09-28T04:23:26.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7fdce27ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcdc0c3b70 0x7fdcdc0c4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7fdce27ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdcdc0c49d0 0x7fdcdc151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7fdce27ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc0c4fb0 con 0x7fdcdc068140 2023-09-28T04:23:26.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.900+0000 7f594adff700 1 Processor -- start 2023-09-28T04:23:26.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.900+0000 7f594adff700 1 -- start start 2023-09-28T04:23:26.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7f594adff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59440c5110 0x7f5944154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7f594adff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5944153a20 0x7f5944142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7f594adff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f594415d9b0 0x7f5944156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7f594adff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59441557c0 con 0x7f5944153a20 2023-09-28T04:23:26.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7f594adff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594413f620 con 0x7f59440c5110 2023-09-28T04:23:26.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7f594adff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5944142d40 con 0x7f594415d9b0 2023-09-28T04:23:26.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7f593bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5944153a20 0x7f5944142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7f593bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5944153a20 0x7f5944142800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45494/0 (socket says 172.21.15.118:45494) 2023-09-28T04:23:26.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7f593bfff700 1 -- 172.21.15.118:0/3954307096 learned_addr learned my addr 172.21.15.118:0/3954307096 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:26.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7f5948b9b700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59440c5110 0x7f5944154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7f594939c700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f594415d9b0 0x7f5944156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.901+0000 7febdbfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7febd40c5110 0x7febd406de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7febdbfff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd406bf60 con 0x7febd4153d10 2023-09-28T04:23:26.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7febdbfff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd415a510 con 0x7febd406e3d0 2023-09-28T04:23:26.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7febdbfff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd406f700 con 0x7febd40c5110 2023-09-28T04:23:26.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7febd959a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7febd40c5110 0x7febd406de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7febd9d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7febd4153d10 0x7febd415af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46134/0 (socket says 172.21.15.118:46134) 2023-09-28T04:23:26.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7febd9d9b700 1 -- 172.21.15.118:0/1011864161 learned_addr learned my addr 172.21.15.118:0/1011864161 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:26.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7fdce27ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc0c2e20 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7fdce27ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc155be0 con 0x7fdcdc0c3b70 2023-09-28T04:23:26.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7fdce0d9c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdcdc0c49d0 0x7fdcdc151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7fdcdbfff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fdcdc068140 0x7fdcdc0c2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46324/0 (socket says 172.21.15.118:46324) 2023-09-28T04:23:26.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7fdcdbfff700 1 -- 172.21.15.118:0/3369882078 learned_addr learned my addr 172.21.15.118:0/3369882078 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:26.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7fdcdb7fe700 1 --2- 172.21.15.118:0/3369882078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcdc0c3b70 0x7fdcdc0c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7f5948b9b700 1 -- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f594415d9b0 msgr2=0x7f5944156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7f5948b9b700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f594415d9b0 0x7f5944156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7f5948b9b700 1 -- 172.21.15.118:0/3954307096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5944153a20 msgr2=0x7f5944142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7f5948b9b700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5944153a20 0x7f5944142800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7f5948b9b700 1 -- 172.21.15.118:0/3954307096 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59340094f0 con 0x7f59440c5110 2023-09-28T04:23:26.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7febd8d99700 1 -- 172.21.15.118:0/1011864161 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426227993 0 0) 0x7febd415a510 con 0x7febd406e3d0 2023-09-28T04:23:26.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7febd8d99700 1 -- 172.21.15.118:0/1011864161 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febc0003570 con 0x7febd406e3d0 2023-09-28T04:23:26.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.903+0000 7febd959a700 1 -- 172.21.15.118:0/1011864161 >> v1:172.21.15.174:6789/0 conn(0x7febd406e3d0 legacy=0x7febd41643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7febd959a700 1 -- 172.21.15.118:0/1011864161 >> v1:172.21.15.118:6789/0 conn(0x7febd4153d10 legacy=0x7febd415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7febd959a700 1 -- 172.21.15.118:0/1011864161 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd415a790 con 0x7febd40c5110 2023-09-28T04:23:26.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.902+0000 7f0148fff700 1 -- start start 2023-09-28T04:23:26.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7fdce0d9c700 1 -- 172.21.15.118:0/3369882078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcdc0c3b70 msgr2=0x7fdcdc0c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7fdce0d9c700 1 --2- 172.21.15.118:0/3369882078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcdc0c3b70 0x7fdcdc0c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7fdce0d9c700 1 -- 172.21.15.118:0/3369882078 >> v1:172.21.15.174:6789/0 conn(0x7fdcdc068140 legacy=0x7fdcdc0c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7f0148fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f014406e3d0 0x7f01440bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7f0148fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01440c5110 0x7f014416cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7f0148fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0144153d10 0x7f0144150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7f0148fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440bc1d0 con 0x7f01440c5110 2023-09-28T04:23:26.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7f0148fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440bb1b0 con 0x7f014406e3d0 2023-09-28T04:23:26.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7f0148fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01440bb770 con 0x7f0144153d10 2023-09-28T04:23:26.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7febd959a700 1 --2- 172.21.15.118:0/1011864161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febd40c5110 0x7febd406de90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7febc40098e0 tx=0x7febc40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a89b8c3555b86075 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7f5948b9b700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59440c5110 0x7f5944154350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f594406c4d0 tx=0x7f5934016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.899+0000 7f2132ffd700 1 -- 172.21.15.118:0/296192085 >> v2:172.21.15.174:3300/0 conn(0x7f213414f9f0 msgr2=0x7f21340c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.899+0000 7f2132ffd700 1 --2- 172.21.15.118:0/296192085 >> v2:172.21.15.174:3300/0 conn(0x7f213414f9f0 0x7f21340c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.899+0000 7f2132ffd700 1 -- 172.21.15.118:0/296192085 >> v1:172.21.15.174:6789/0 conn(0x7f2134089830 legacy=0x7f213414f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.900+0000 7f2132ffd700 1 -- 172.21.15.118:0/296192085 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340ccbc0 con 0x7f21340adf10 2023-09-28T04:23:26.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7f2132ffd700 1 --2- 172.21.15.118:0/296192085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21340adf10 0x7f21341562b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f21240098e0 tx=0x7f21240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3250a68fd08c8c89 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7f5938ff9700 1 -- 172.21.15.118:0/3954307096 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934026480 con 0x7f59440c5110 2023-09-28T04:23:26.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7f5938ff9700 1 -- 172.21.15.118:0/3954307096 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593401f070 con 0x7f59440c5110 2023-09-28T04:23:26.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7f5938ff9700 1 -- 172.21.15.118:0/3954307096 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934026830 con 0x7f59440c5110 2023-09-28T04:23:26.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7f0142d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0144153d10 0x7f0144150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7f0142d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0144153d10 0x7f0144150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:59156/0 (socket says 172.21.15.118:59156) 2023-09-28T04:23:26.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7f0142d9d700 1 -- 172.21.15.118:0/3927720021 learned_addr learned my addr 172.21.15.118:0/3927720021 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:26.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7f014259c700 1 --2- 172.21.15.118:0/3927720021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f014406e3d0 0x7f01440bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.901+0000 7fc043fff700 1 -- 172.21.15.118:0/1100185008 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc04c014470 con 0x7fc044004810 2023-09-28T04:23:26.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7fdcdaffd700 1 -- 172.21.15.118:0/3369882078 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025156553 0 0) 0x7fdcdc0c4fb0 con 0x7fdcdc068140 2023-09-28T04:23:26.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.904+0000 7fdce0d9c700 1 -- 172.21.15.118:0/3369882078 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc154fd0 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7fdce0d9c700 1 --2- 172.21.15.118:0/3369882078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcdc0c49d0 0x7fdcdc151b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400bf00 tx=0x7fdcd400d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8364dab997167871 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7fdcdaffd700 1 -- 172.21.15.118:0/3369882078 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400b2e0 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7fdcdaffd700 1 -- 172.21.15.118:0/3369882078 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd400ca10 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7fdcdaffd700 1 -- 172.21.15.118:0/3369882078 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400cdd0 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7febd8d99700 1 -- 172.21.15.118:0/1011864161 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc400b640 con 0x7febd40c5110 2023-09-28T04:23:26.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7febd8d99700 1 -- 172.21.15.118:0/1011864161 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc400b7a0 con 0x7febd40c5110 2023-09-28T04:23:26.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7febd8d99700 1 -- 172.21.15.118:0/1011864161 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc400bb40 con 0x7febd40c5110 2023-09-28T04:23:26.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.906+0000 7febdbfff700 1 -- 172.21.15.118:0/1011864161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febd40c5110 msgr2=0x7febd406de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.906+0000 7febdbfff700 1 --2- 172.21.15.118:0/1011864161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febd40c5110 0x7febd406de90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7febc40098e0 tx=0x7febc40091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.906+0000 7f014259c700 1 -- 172.21.15.118:0/3927720021 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0144153d10 msgr2=0x7f0144150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.906+0000 7f014259c700 1 --2- 172.21.15.118:0/3927720021 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0144153d10 0x7f0144150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.906+0000 7f014259c700 1 -- 172.21.15.118:0/3927720021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01440c5110 msgr2=0x7f014416cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.906+0000 7f014259c700 1 --2- 172.21.15.118:0/3927720021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01440c5110 0x7f014416cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.906+0000 7f014259c700 1 -- 172.21.15.118:0/3927720021 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01380094f0 con 0x7f014406e3d0 2023-09-28T04:23:26.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.906+0000 7f014259c700 1 --2- 172.21.15.118:0/3927720021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f014406e3d0 0x7f01440bd5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f013400b570 tx=0x7f0134009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7f594adff700 1 -- 172.21.15.118:0/3954307096 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59440c65c0 con 0x7f59440c5110 2023-09-28T04:23:26.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.905+0000 7f594adff700 1 -- 172.21.15.118:0/3954307096 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59440c6b20 con 0x7f59440c5110 2023-09-28T04:23:26.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.906+0000 7f2131ffb700 1 -- 172.21.15.118:0/296192085 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124011630 con 0x7f21340adf10 2023-09-28T04:23:26.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.906+0000 7f2131ffb700 1 -- 172.21.15.118:0/296192085 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2124011790 con 0x7f21340adf10 2023-09-28T04:23:26.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.906+0000 7f2131ffb700 1 -- 172.21.15.118:0/296192085 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124011b30 con 0x7f21340adf10 2023-09-28T04:23:26.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.906+0000 7fc043fff700 1 --2- 172.21.15.118:0/1100185008 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc048067480 0x7fc048069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.906+0000 7fc043fff700 1 -- 172.21.15.118:0/1100185008 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc04c085020 con 0x7fc044004810 2023-09-28T04:23:26.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7f01327fc700 1 -- 172.21.15.118:0/3927720021 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400f510 con 0x7f014406e3d0 2023-09-28T04:23:26.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7f01327fc700 1 -- 172.21.15.118:0/3927720021 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013400f690 con 0x7f014406e3d0 2023-09-28T04:23:26.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7f01327fc700 1 -- 172.21.15.118:0/3927720021 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400fa50 con 0x7f014406e3d0 2023-09-28T04:23:26.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7f0148fff700 1 -- 172.21.15.118:0/3927720021 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01440c1110 con 0x7f014406e3d0 2023-09-28T04:23:26.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7f0148fff700 1 -- 172.21.15.118:0/3927720021 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01440be100 con 0x7f014406e3d0 2023-09-28T04:23:26.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7fdce27ff700 1 -- 172.21.15.118:0/3369882078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcdc0c49d0 msgr2=0x7fdcdc151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7fdce27ff700 1 --2- 172.21.15.118:0/3369882078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcdc0c49d0 0x7fdcdc151b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400bf00 tx=0x7fdcd400d040 comp rx=0 tx=0).stop 2023-09-28T04:23:26.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7fdce27ff700 1 -- 172.21.15.118:0/3369882078 shutdown_connections 2023-09-28T04:23:26.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7fdce27ff700 1 --2- 172.21.15.118:0/3369882078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcdc0c49d0 0x7fdcdc151b40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7fdce27ff700 1 --2- 172.21.15.118:0/3369882078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcdc0c3b70 0x7fdcdc0c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7fdce27ff700 1 -- 172.21.15.118:0/3369882078 >> 172.21.15.118:0/3369882078 conn(0x7fdcdc067630 msgr2=0x7fdcdc067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.908+0000 7fdce27ff700 1 -- 172.21.15.118:0/3369882078 shutdown_connections 2023-09-28T04:23:26.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7f594adff700 1 -- 172.21.15.118:0/3954307096 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5924000fd0 con 0x7f59440c5110 2023-09-28T04:23:26.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7febdbfff700 1 -- 172.21.15.118:0/1011864161 shutdown_connections 2023-09-28T04:23:26.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7febdbfff700 1 --2- 172.21.15.118:0/1011864161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febd40c5110 0x7febd406de90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7febdbfff700 1 -- 172.21.15.118:0/1011864161 >> 172.21.15.118:0/1011864161 conn(0x7febd4067630 msgr2=0x7febd4067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7febdbfff700 1 -- 172.21.15.118:0/1011864161 shutdown_connections 2023-09-28T04:23:26.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7f21393ff700 1 -- 172.21.15.118:0/296192085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21340adf10 msgr2=0x7f21341562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7f21393ff700 1 --2- 172.21.15.118:0/296192085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21340adf10 0x7f21341562b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f21240098e0 tx=0x7f21240091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.908+0000 7f21393ff700 1 -- 172.21.15.118:0/296192085 shutdown_connections 2023-09-28T04:23:26.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.908+0000 7f21393ff700 1 --2- 172.21.15.118:0/296192085 >> v2:172.21.15.174:3300/0 conn(0x7f213414f9f0 0x7f21340c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.908+0000 7f21393ff700 1 --2- 172.21.15.118:0/296192085 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21340adf10 0x7f21341562b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.908+0000 7f21393ff700 1 -- 172.21.15.118:0/296192085 >> 172.21.15.118:0/296192085 conn(0x7f2134063cc0 msgr2=0x7f21340cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7fc043fff700 1 --2- 172.21.15.118:0/1100185008 >> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] conn(0x7fc04806fd30 0x7fc048072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7fc043fff700 1 -- 172.21.15.118:0/1100185008 --> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0480727f0 con 0x7fc04806fd30 2023-09-28T04:23:26.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7fc043fff700 1 -- 172.21.15.118:0/1100185008 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc04c087560 con 0x7fc044004810 2023-09-28T04:23:26.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7fc05b7fe700 1 --2- 172.21.15.118:0/1100185008 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc048067480 0x7fc048069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.926 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.908+0000 7fdce27ff700 1 -- 172.21.15.118:0/3369882078 wait complete. 2023-09-28T04:23:26.926 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.909+0000 7f0148fff700 1 -- 172.21.15.118:0/3927720021 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f01440be4a0 con 0x7f014406e3d0 2023-09-28T04:23:26.926 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.910+0000 7fdce27ff700 1 Processor -- start 2023-09-28T04:23:26.926 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.910+0000 7fdce27ff700 1 -- start start 2023-09-28T04:23:26.926 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7fdce27ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcdc068140 0x7fdcdc150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7fdce27ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcdc0c3b70 0x7fdcdc1624a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7fdce27ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcdc0c49d0 0x7fdcdc1629e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7fdce27ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1577c0 con 0x7fdcdc068140 2023-09-28T04:23:26.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7fdce27ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc151940 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7fdce27ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc157330 con 0x7fdcdc0c3b70 2023-09-28T04:23:26.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7fdce0d9c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcdc0c49d0 0x7fdcdc1629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7fdce0d9c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcdc0c49d0 0x7fdcdc1629e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42396/0 (socket says 172.21.15.118:42396) 2023-09-28T04:23:26.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7fdce0d9c700 1 -- 172.21.15.118:0/1563332852 learned_addr learned my addr 172.21.15.118:0/1563332852 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:26.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7fdcdb7fe700 1 --2- 172.21.15.118:0/1563332852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcdc0c3b70 0x7fdcdc1624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.913+0000 7fdce0d9c700 1 -- 172.21.15.118:0/1563332852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcdc0c3b70 msgr2=0x7fdcdc1624a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.913+0000 7fdce0d9c700 1 --2- 172.21.15.118:0/1563332852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcdc0c3b70 0x7fdcdc1624a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.910+0000 7f5938ff9700 1 -- 172.21.15.118:0/3954307096 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5934026be0 con 0x7f59440c5110 2023-09-28T04:23:26.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7f5938ff9700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f59300674b0 0x7f5930069960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7f5938ff9700 1 -- 172.21.15.118:0/3954307096 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5934021070 con 0x7f59440c5110 2023-09-28T04:23:26.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7f5938ff9700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] conn(0x7f593006fd60 0x7f5930072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7f5938ff9700 1 -- 172.21.15.118:0/3954307096 --> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5930072820 con 0x7f593006fd60 2023-09-28T04:23:26.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7f5938ff9700 1 -- 172.21.15.118:0/3954307096 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5934087380 con 0x7f59440c5110 2023-09-28T04:23:26.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7f593bfff700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f59300674b0 0x7f5930069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7f594939c700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] conn(0x7f593006fd60 0x7f5930072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.907+0000 7febdbfff700 1 -- 172.21.15.118:0/1011864161 wait complete. 2023-09-28T04:23:26.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.910+0000 7febdbfff700 1 Processor -- start 2023-09-28T04:23:26.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.910+0000 7febdbfff700 1 -- start start 2023-09-28T04:23:26.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7febdbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febd406e3d0 0x7febd414b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7febdbfff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febd40c5110 0x7febd4144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7febdbfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd4153d10 0x7febd40c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7febdbfff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd40bdb90 con 0x7febd4153d10 2023-09-28T04:23:26.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7febdbfff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd414b540 con 0x7febd40c5110 2023-09-28T04:23:26.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7febdbfff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd4155b70 con 0x7febd406e3d0 2023-09-28T04:23:26.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7febd9d9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febd406e3d0 0x7febd414b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7febd9d9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febd406e3d0 0x7febd414b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:59170/0 (socket says 172.21.15.118:59170) 2023-09-28T04:23:26.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7febd9d9b700 1 -- 172.21.15.118:0/3938396447 learned_addr learned my addr 172.21.15.118:0/3938396447 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:26.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7febd9d9b700 1 -- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febd40c5110 msgr2=0x7febd4144910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-28T04:23:26.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7febd9d9b700 1 --2- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febd40c5110 0x7febd4144910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7febd9d9b700 1 -- 172.21.15.118:0/3938396447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd4153d10 msgr2=0x7febd40c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7febd9d9b700 1 --2- 172.21.15.118:0/3938396447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febd4153d10 0x7febd40c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7febd9d9b700 1 -- 172.21.15.118:0/3938396447 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc4009420 con 0x7febd406e3d0 2023-09-28T04:23:26.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.909+0000 7f21393ff700 1 -- 172.21.15.118:0/296192085 shutdown_connections 2023-09-28T04:23:26.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.909+0000 7f21393ff700 1 -- 172.21.15.118:0/296192085 wait complete. 2023-09-28T04:23:26.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7f21393ff700 1 Processor -- start 2023-09-28T04:23:26.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.912+0000 7f21393ff700 1 -- start start 2023-09-28T04:23:26.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.910+0000 7f42125ff700 1 Processor -- start 2023-09-28T04:23:26.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7f42125ff700 1 -- start start 2023-09-28T04:23:26.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.913+0000 7fdce0d9c700 1 -- 172.21.15.118:0/1563332852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcdc068140 msgr2=0x7fdcdc150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.913+0000 7fdce0d9c700 1 --2- 172.21.15.118:0/1563332852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcdc068140 0x7fdcdc150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.913+0000 7fdce0d9c700 1 -- 172.21.15.118:0/1563332852 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd400ba40 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.913+0000 7febd9d9b700 1 --2- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febd406e3d0 0x7febd414b000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7febd000c5e0 tx=0x7febd0000fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.911+0000 7f01327fc700 1 -- 172.21.15.118:0/3927720021 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f013401a400 con 0x7f014406e3d0 2023-09-28T04:23:26.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.913+0000 7f594939c700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] conn(0x7f593006fd60 0x7f5930072170 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.913+0000 7fc060b9c700 1 --2- 172.21.15.118:0/1100185008 >> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] conn(0x7fc04806fd30 0x7fc048072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7fc060b9c700 1 --2- 172.21.15.118:0/1100185008 >> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] conn(0x7fc04806fd30 0x7fc048072140 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f21393ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2134089830 0x7f21340c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f21393ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21340adf10 0x7f2134159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f21393ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f213414f9f0 0x7f2134159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f21393ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2134170280 con 0x7f2134089830 2023-09-28T04:23:26.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f21393ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2134158bd0 con 0x7f213414f9f0 2023-09-28T04:23:26.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f21393ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2134158eb0 con 0x7f21340adf10 2023-09-28T04:23:26.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7fdce0d9c700 1 --2- 172.21.15.118:0/1563332852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcdc0c49d0 0x7fdcdc1629e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc06d380 tx=0x7fdcd4016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f42125ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f420c151b40 0x7f420c151f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f42125ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c0c4fb0 con 0x7f420c0c3b70 2023-09-28T04:23:26.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f42125ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c155be0 con 0x7f420c068140 2023-09-28T04:23:26.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f42125ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c0c4ba0 con 0x7f420c151b40 2023-09-28T04:23:26.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7fc05b7fe700 1 --2- 172.21.15.118:0/1100185008 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc048067480 0x7fc048069930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc050001ed0 tx=0x7fc050018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.913+0000 7febc9ffb700 1 -- 172.21.15.118:0/3938396447 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0005b30 con 0x7febd406e3d0 2023-09-28T04:23:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.913+0000 7febc9ffb700 1 -- 172.21.15.118:0/3938396447 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd0005cb0 con 0x7febd406e3d0 2023-09-28T04:23:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.913+0000 7febc9ffb700 1 -- 172.21.15.118:0/3938396447 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0007320 con 0x7febd406e3d0 2023-09-28T04:23:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7f593bfff700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f59300674b0 0x7f5930069960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5940006fd0 tx=0x7f5940008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f01327fc700 1 --2- 172.21.15.118:0/3927720021 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f01240674b0 0x7f0124069960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f01327fc700 1 -- 172.21.15.118:0/3927720021 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0134084590 con 0x7f014406e3d0 2023-09-28T04:23:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f01327fc700 1 --2- 172.21.15.118:0/3927720021 >> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] conn(0x7f012406fd60 0x7f0124072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f01327fc700 1 -- 172.21.15.118:0/3927720021 --> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0124072820 con 0x7f012406fd60 2023-09-28T04:23:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.914+0000 7f01327fc700 1 -- 172.21.15.118:0/3927720021 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0134086b30 con 0x7f014406e3d0 2023-09-28T04:23:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7f0142d9d700 1 --2- 172.21.15.118:0/3927720021 >> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] conn(0x7f012406fd60 0x7f0124072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7f5938ff9700 1 -- 172.21.15.118:0/3954307096 <== osd.4 v2:172.21.15.174:6800/119880 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5930072820 con 0x7f593006fd60 2023-09-28T04:23:26.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7f420bfff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f420c068140 0x7f420c0c4490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46332/0 (socket says 172.21.15.118:46332) 2023-09-28T04:23:26.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7f420bfff700 1 -- 172.21.15.118:0/2333708749 learned_addr learned my addr 172.21.15.118:0/2333708749 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:26.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7f21337fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f213414f9f0 0x7f2134159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7f21337fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f213414f9f0 0x7f2134159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42422/0 (socket says 172.21.15.118:42422) 2023-09-28T04:23:26.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7f21337fe700 1 -- 172.21.15.118:0/562620213 learned_addr learned my addr 172.21.15.118:0/562620213 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:26.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.916+0000 7fc043fff700 1 -- 172.21.15.118:0/1100185008 <== osd.1 v2:172.21.15.118:6816/114260 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc0480727f0 con 0x7fc04806fd30 2023-09-28T04:23:26.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7fdcc3fff700 1 -- 172.21.15.118:0/1563332852 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd401d410 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7fdcc3fff700 1 -- 172.21.15.118:0/1563332852 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd401d570 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7fdce27ff700 1 -- 172.21.15.118:0/1563332852 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc151660 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7f4210b9c700 1 --2- 172.21.15.118:0/2333708749 >> v2:172.21.15.174:3300/0 conn(0x7f420c151b40 0x7f420c151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.916+0000 7fdce27ff700 1 -- 172.21.15.118:0/1563332852 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc156ce0 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.916+0000 7fdcc3fff700 1 -- 172.21.15.118:0/1563332852 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd401d910 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7febdbfff700 1 -- 172.21.15.118:0/3938396447 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd4155260 con 0x7febd406e3d0 2023-09-28T04:23:26.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7febdbfff700 1 -- 172.21.15.118:0/3938396447 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd415c710 con 0x7febd406e3d0 2023-09-28T04:23:26.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.916+0000 7febdbfff700 1 -- 172.21.15.118:0/3938396447 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7febd4071980 con 0x7febd406e3d0 2023-09-28T04:23:26.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.916+0000 7f21327fc700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21340adf10 0x7f2134159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.916+0000 7f4210b9c700 1 -- 172.21.15.118:0/2333708749 >> v1:172.21.15.174:6789/0 conn(0x7f420c068140 legacy=0x7f420c0c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.916+0000 7f4210b9c700 1 -- 172.21.15.118:0/2333708749 >> v1:172.21.15.118:6789/0 conn(0x7f420c0c3b70 legacy=0x7f420c0c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:26.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.916+0000 7f4210b9c700 1 -- 172.21.15.118:0/2333708749 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c154fd0 con 0x7f420c151b40 2023-09-28T04:23:26.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.916+0000 7f2132ffd700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2134089830 0x7f21340c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.917+0000 7f4210b9c700 1 --2- 172.21.15.118:0/2333708749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f420c151b40 0x7f420c151f40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f42000098e0 tx=0x7f42000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4333de3777b5ee13 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.917+0000 7fdcc1ffb700 1 -- 172.21.15.118:0/1563332852 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdcdc071980 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.917+0000 7f21327fc700 1 -- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f213414f9f0 msgr2=0x7f2134159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.917+0000 7f21327fc700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f213414f9f0 0x7f2134159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.917+0000 7f21327fc700 1 -- 172.21.15.118:0/562620213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2134089830 msgr2=0x7f21340c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.917+0000 7f21327fc700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2134089830 0x7f21340c5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.917+0000 7f21327fc700 1 -- 172.21.15.118:0/562620213 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2124009420 con 0x7f21340adf10 2023-09-28T04:23:26.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.915+0000 7f0141d9b700 1 --2- 172.21.15.118:0/3927720021 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f01240674b0 0x7f0124069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.917+0000 7f21327fc700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21340adf10 0x7f2134159340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f212800c4c0 tx=0x7f2128007d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.920+0000 7f86e5dff700 1 -- 172.21.15.118:0/2067664053 --> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f86e006dc30 con 0x7f86cc06fd60 2023-09-28T04:23:26.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.919+0000 7f0142d9d700 1 --2- 172.21.15.118:0/3927720021 >> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] conn(0x7f012406fd60 0x7f0124072170 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.918+0000 7f211affd700 1 -- 172.21.15.118:0/562620213 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2128005a70 con 0x7f21340adf10 2023-09-28T04:23:26.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.918+0000 7f211affd700 1 -- 172.21.15.118:0/562620213 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2128005bf0 con 0x7f21340adf10 2023-09-28T04:23:26.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.918+0000 7f211affd700 1 -- 172.21.15.118:0/562620213 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21280070d0 con 0x7f21340adf10 2023-09-28T04:23:26.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.918+0000 7f21393ff700 1 -- 172.21.15.118:0/562620213 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2134172bb0 con 0x7f21340adf10 2023-09-28T04:23:26.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.918+0000 7f21393ff700 1 -- 172.21.15.118:0/562620213 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2134173170 con 0x7f21340adf10 2023-09-28T04:23:26.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.918+0000 7f420affd700 1 -- 172.21.15.118:0/2333708749 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200009e80 con 0x7f420c151b40 2023-09-28T04:23:26.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.918+0000 7f420affd700 1 -- 172.21.15.118:0/2333708749 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420000b820 con 0x7f420c151b40 2023-09-28T04:23:26.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.918+0000 7f420affd700 1 -- 172.21.15.118:0/2333708749 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420000bbc0 con 0x7f420c151b40 2023-09-28T04:23:26.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.919+0000 7f42125ff700 1 -- 172.21.15.118:0/2333708749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f420c151b40 msgr2=0x7f420c151f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.919+0000 7f42125ff700 1 --2- 172.21.15.118:0/2333708749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f420c151b40 0x7f420c151f40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f42000098e0 tx=0x7f42000091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.919+0000 7f42125ff700 1 -- 172.21.15.118:0/2333708749 shutdown_connections 2023-09-28T04:23:26.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.919+0000 7f42125ff700 1 --2- 172.21.15.118:0/2333708749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f420c151b40 0x7f420c151f40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.919+0000 7f42125ff700 1 -- 172.21.15.118:0/2333708749 >> 172.21.15.118:0/2333708749 conn(0x7f420c067630 msgr2=0x7f420c067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.919+0000 7f42125ff700 1 -- 172.21.15.118:0/2333708749 shutdown_connections 2023-09-28T04:23:26.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.919+0000 7f42125ff700 1 -- 172.21.15.118:0/2333708749 wait complete. 2023-09-28T04:23:26.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.920+0000 7f86c77fe700 1 -- 172.21.15.118:0/2067664053 <== osd.0 v2:172.21.15.118:6819/114261 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f86e006dc30 con 0x7f86cc06fd60 2023-09-28T04:23:26.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.919+0000 7febc9ffb700 1 -- 172.21.15.118:0/3938396447 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7febd001c440 con 0x7febd406e3d0 2023-09-28T04:23:26.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.920+0000 7febc9ffb700 1 --2- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7febb8067480 0x7febb8069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.921+0000 7febc9ffb700 1 -- 172.21.15.118:0/3938396447 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7febd0084400 con 0x7febd406e3d0 2023-09-28T04:23:26.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.921+0000 7febc9ffb700 1 --2- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] conn(0x7febb806fd30 0x7febb8072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.921+0000 7febc9ffb700 1 -- 172.21.15.118:0/3938396447 --> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febb80727f0 con 0x7febb806fd30 2023-09-28T04:23:26.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.921+0000 7febc9ffb700 1 -- 172.21.15.118:0/3938396447 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7febd0084730 con 0x7febd406e3d0 2023-09-28T04:23:26.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.921+0000 7f86e5dff700 1 -- 172.21.15.118:0/2067664053 >> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] conn(0x7f86cc06fd60 msgr2=0x7f86cc072170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.921+0000 7f86e5dff700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] conn(0x7f86cc06fd60 0x7f86cc072170 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.921+0000 7f86e5dff700 1 -- 172.21.15.118:0/2067664053 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f86cc0674b0 msgr2=0x7f86cc069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.921+0000 7f86e5dff700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f86cc0674b0 0x7f86cc069960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f86d0004e30 tx=0x7f86d0007de0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.921+0000 7f86e5dff700 1 -- 172.21.15.118:0/2067664053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86e0166b90 msgr2=0x7f86e00bd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.921+0000 7f86e5dff700 1 --2- 172.21.15.118:0/2067664053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f86e0166b90 0x7f86e00bd7a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f86e00c2f40 tx=0x7f86d4002e60 comp rx=0 tx=0).stop 2023-09-28T04:23:26.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.922+0000 7febda59c700 1 --2- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] conn(0x7febb806fd30 0x7febb8072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.922+0000 7f42125ff700 1 Processor -- start 2023-09-28T04:23:26.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.922+0000 7febd959a700 1 --2- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7febb8067480 0x7febb8069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.922+0000 7f86dffff700 1 -- 172.21.15.118:0/2067664053 reap_dead start 2023-09-28T04:23:26.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.922+0000 7f86e5dff700 1 -- 172.21.15.118:0/2067664053 shutdown_connections 2023-09-28T04:23:26.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.922+0000 7f86e5dff700 1 -- 172.21.15.118:0/2067664053 >> 172.21.15.118:0/2067664053 conn(0x7f86e0067630 msgr2=0x7f86e0160340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.923+0000 7febd959a700 1 --2- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7febb8067480 0x7febb8069930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7febd406d900 tx=0x7febc4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.922+0000 7fdcc3fff700 1 -- 172.21.15.118:0/1563332852 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdcd401a070 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.923+0000 7f01327fc700 1 -- 172.21.15.118:0/3927720021 <== osd.2 v2:172.21.15.118:6808/114259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0124072820 con 0x7f012406fd60 2023-09-28T04:23:26.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.922+0000 7f21393ff700 1 -- 172.21.15.118:0/562620213 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2134071980 con 0x7f21340adf10 2023-09-28T04:23:26.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.923+0000 7fdcc3fff700 1 --2- 172.21.15.118:0/1563332852 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdcc8067480 0x7fdcc8069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.923+0000 7f86e5dff700 1 -- 172.21.15.118:0/2067664053 shutdown_connections 2023-09-28T04:23:26.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7f86e5dff700 1 -- 172.21.15.118:0/2067664053 wait complete. 2023-09-28T04:23:26.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7f0141d9b700 1 --2- 172.21.15.118:0/3927720021 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f01240674b0 0x7f0124069960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01440bede0 tx=0x7f0138016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7fdcc3fff700 1 -- 172.21.15.118:0/1563332852 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdcd4086670 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7fdcdbfff700 1 --2- 172.21.15.118:0/1563332852 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdcc8067480 0x7fdcc8069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7fdcc3fff700 1 --2- 172.21.15.118:0/1563332852 >> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] conn(0x7fdcc806fd30 0x7fdcc8072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7fdcc3fff700 1 -- 172.21.15.118:0/1563332852 --> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdcc80727f0 con 0x7fdcc806fd30 2023-09-28T04:23:26.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.922+0000 7f42125ff700 1 -- start start 2023-09-28T04:23:26.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7f42125ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f420c068140 0x7f420c16c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7f42125ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f420c0c3b70 0x7f420c14dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7f42125ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f420c151b40 0x7f420c140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7f42125ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c14e1e0 con 0x7f420c151b40 2023-09-28T04:23:26.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7f42125ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c14d810 con 0x7f420c068140 2023-09-28T04:23:26.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7f42125ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0c2190 con 0x7f420c0c3b70 2023-09-28T04:23:26.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7f420b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f420c0c3b70 0x7f420c14dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7fdcc3fff700 1 -- 172.21.15.118:0/1563332852 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcd40869a0 con 0x7fdcdc0c49d0 2023-09-28T04:23:26.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7f420b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f420c0c3b70 0x7f420c14dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:59190/0 (socket says 172.21.15.118:59190) 2023-09-28T04:23:26.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7f420b7fe700 1 -- 172.21.15.118:0/1854208459 learned_addr learned my addr 172.21.15.118:0/1854208459 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:26.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7f420bfff700 1 --2- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f420c068140 0x7f420c16c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7fdcdb7fe700 1 --2- 172.21.15.118:0/1563332852 >> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] conn(0x7fdcc806fd30 0x7fdcc8072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.924+0000 7fdcdbfff700 1 --2- 172.21.15.118:0/1563332852 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdcc8067480 0x7fdcc8069930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00011e0 tx=0x7fdcd00079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.925+0000 7f420bfff700 1 -- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f420c0c3b70 msgr2=0x7f420c14dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.925+0000 7f420bfff700 1 --2- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f420c0c3b70 0x7f420c14dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.925+0000 7f420bfff700 1 -- 172.21.15.118:0/1854208459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f420c151b40 msgr2=0x7f420c140f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.925+0000 7f420bfff700 1 --2- 172.21.15.118:0/1854208459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f420c151b40 0x7f420c140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.925+0000 7f420bfff700 1 -- 172.21.15.118:0/1854208459 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4200009420 con 0x7f420c068140 2023-09-28T04:23:26.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.925+0000 7fdcdb7fe700 1 --2- 172.21.15.118:0/1563332852 >> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] conn(0x7fdcc806fd30 0x7fdcc8072140 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.925+0000 7f420bfff700 1 --2- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f420c068140 0x7f420c16c120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f420400cc70 tx=0x7f4204001a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.926+0000 7f41f3fff700 1 -- 172.21.15.118:0/1854208459 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204004bb0 con 0x7f420c068140 2023-09-28T04:23:26.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.926+0000 7f41f3fff700 1 -- 172.21.15.118:0/1854208459 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4204004d30 con 0x7f420c068140 2023-09-28T04:23:26.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.926+0000 7f41f3fff700 1 -- 172.21.15.118:0/1854208459 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204004ea0 con 0x7f420c068140 2023-09-28T04:23:26.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.926+0000 7f42125ff700 1 -- 172.21.15.118:0/1854208459 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c149290 con 0x7f420c068140 2023-09-28T04:23:26.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.926+0000 7f42125ff700 1 -- 172.21.15.118:0/1854208459 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c14cf00 con 0x7f420c068140 2023-09-28T04:23:26.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.927+0000 7febda59c700 1 --2- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] conn(0x7febb806fd30 0x7febb8072140 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.927+0000 7fdcc3fff700 1 -- 172.21.15.118:0/1563332852 <== osd.3 v2:172.21.15.118:6800/114258 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fdcc80727f0 con 0x7fdcc806fd30 2023-09-28T04:23:26.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.926+0000 7f211affd700 1 -- 172.21.15.118:0/562620213 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f21280074c0 con 0x7f21340adf10 2023-09-28T04:23:26.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.927+0000 7f211affd700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f21200674b0 0x7f2120069960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.927+0000 7f211affd700 1 -- 172.21.15.118:0/562620213 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f21280843b0 con 0x7f21340adf10 2023-09-28T04:23:26.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.928+0000 7f211affd700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] conn(0x7f212006fd60 0x7f2120072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.928+0000 7f211affd700 1 -- 172.21.15.118:0/562620213 --> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2120072820 con 0x7f212006fd60 2023-09-28T04:23:26.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.928+0000 7f211affd700 1 -- 172.21.15.118:0/562620213 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21280846e0 con 0x7f21340adf10 2023-09-28T04:23:26.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.928+0000 7febc9ffb700 1 -- 172.21.15.118:0/3938396447 <== osd.5 v2:172.21.15.174:6817/119908 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7febb80727f0 con 0x7febb806fd30 2023-09-28T04:23:26.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.928+0000 7f21337fe700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] conn(0x7f212006fd60 0x7f2120072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.928+0000 7f2132ffd700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f21200674b0 0x7f2120069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.929+0000 7f42125ff700 1 -- 172.21.15.118:0/1854208459 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41ec000fd0 con 0x7f420c068140 2023-09-28T04:23:26.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.929+0000 7f2132ffd700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f21200674b0 0x7f2120069960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f21240091e0 tx=0x7f2124017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.929+0000 7f41f3fff700 1 -- 172.21.15.118:0/1854208459 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f42040070f0 con 0x7f420c068140 2023-09-28T04:23:26.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.932+0000 7f21337fe700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] conn(0x7f212006fd60 0x7f2120072170 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.932+0000 7f211affd700 1 -- 172.21.15.118:0/562620213 <== osd.6 v2:172.21.15.174:6816/119911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2120072820 con 0x7f212006fd60 2023-09-28T04:23:26.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.931+0000 7f41f3fff700 1 --2- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f41f8067400 0x7f41f80698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.931+0000 7f41f3fff700 1 -- 172.21.15.118:0/1854208459 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4204084870 con 0x7f420c068140 2023-09-28T04:23:26.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.931+0000 7f41f3fff700 1 --2- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] conn(0x7f41f806fcb0 0x7f41f80720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:26.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.931+0000 7f41f3fff700 1 -- 172.21.15.118:0/1854208459 --> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41f8072770 con 0x7f41f806fcb0 2023-09-28T04:23:26.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.931+0000 7f41f3fff700 1 -- 172.21.15.118:0/1854208459 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4204086dd0 con 0x7f420c068140 2023-09-28T04:23:26.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.931+0000 7f420b7fe700 1 --2- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f41f8067400 0x7f41f80698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.932+0000 7f4210b9c700 1 --2- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] conn(0x7f41f806fcb0 0x7f41f80720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:26.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.932+0000 7f420b7fe700 1 --2- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f41f8067400 0x7f41f80698b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f420c0b41d0 tx=0x7f41fc0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.932+0000 7f4210b9c700 1 --2- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] conn(0x7f41f806fcb0 0x7f41f80720c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:26.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.933+0000 7f41f3fff700 1 -- 172.21.15.118:0/1854208459 <== osd.7 v2:172.21.15.174:6808/119881 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f41f8072770 con 0x7f41f806fcb0 2023-09-28T04:23:26.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.944+0000 7fc0625ff700 1 -- 172.21.15.118:0/1100185008 --> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc03c002d30 con 0x7fc04806fd30 2023-09-28T04:23:26.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.945+0000 7fc043fff700 1 -- 172.21.15.118:0/1100185008 <== osd.1 v2:172.21.15.118:6816/114260 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc03c002d30 con 0x7fc04806fd30 2023-09-28T04:23:26.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.949+0000 7f594adff700 1 -- 172.21.15.118:0/3954307096 --> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5924002d30 con 0x7f593006fd60 2023-09-28T04:23:26.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.950+0000 7fc0625ff700 1 -- 172.21.15.118:0/1100185008 >> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] conn(0x7fc04806fd30 msgr2=0x7fc048072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.950+0000 7fc0625ff700 1 --2- 172.21.15.118:0/1100185008 >> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] conn(0x7fc04806fd30 0x7fc048072140 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.950+0000 7f5938ff9700 1 -- 172.21.15.118:0/3954307096 <== osd.4 v2:172.21.15.174:6800/119880 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5924002d30 con 0x7f593006fd60 2023-09-28T04:23:26.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.950+0000 7fc0625ff700 1 -- 172.21.15.118:0/1100185008 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc048067480 msgr2=0x7fc048069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.950+0000 7fc0625ff700 1 --2- 172.21.15.118:0/1100185008 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc048067480 0x7fc048069930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc050001ed0 tx=0x7fc050018000 comp rx=0 tx=0).stop 2023-09-28T04:23:26.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.950+0000 7fc0625ff700 1 -- 172.21.15.118:0/1100185008 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc044004810 msgr2=0x7fc05c0c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.950+0000 7fc0625ff700 1 --2- 172.21.15.118:0/1100185008 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc044004810 0x7fc05c0c7750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00f930 tx=0x7fc04c007d30 comp rx=0 tx=0).stop 2023-09-28T04:23:26.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.951+0000 7fc060b9c700 1 -- 172.21.15.118:0/1100185008 reap_dead start 2023-09-28T04:23:26.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.951+0000 7fc0625ff700 1 -- 172.21.15.118:0/1100185008 shutdown_connections 2023-09-28T04:23:26.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.951+0000 7fc0625ff700 1 -- 172.21.15.118:0/1100185008 >> 172.21.15.118:0/1100185008 conn(0x7fc05c067630 msgr2=0x7fc05c144990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.951+0000 7fc0625ff700 1 -- 172.21.15.118:0/1100185008 shutdown_connections 2023-09-28T04:23:26.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.951+0000 7fc0625ff700 1 -- 172.21.15.118:0/1100185008 wait complete. 2023-09-28T04:23:26.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.952+0000 7f594adff700 1 -- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] conn(0x7f593006fd60 msgr2=0x7f5930072170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.952+0000 7f594adff700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] conn(0x7f593006fd60 0x7f5930072170 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.952+0000 7f594adff700 1 -- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f59300674b0 msgr2=0x7f5930069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.952+0000 7f594adff700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f59300674b0 0x7f5930069960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5940006fd0 tx=0x7f5940008040 comp rx=0 tx=0).stop 2023-09-28T04:23:26.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.952+0000 7f594adff700 1 -- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59440c5110 msgr2=0x7f5944154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.952+0000 7f594adff700 1 --2- 172.21.15.118:0/3954307096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59440c5110 0x7f5944154350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f594406c4d0 tx=0x7f5934016000 comp rx=0 tx=0).stop 2023-09-28T04:23:26.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.952+0000 7f594939c700 1 -- 172.21.15.118:0/3954307096 reap_dead start 2023-09-28T04:23:26.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.952+0000 7f594adff700 1 -- 172.21.15.118:0/3954307096 shutdown_connections 2023-09-28T04:23:26.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.952+0000 7f594adff700 1 -- 172.21.15.118:0/3954307096 >> 172.21.15.118:0/3954307096 conn(0x7f5944067630 msgr2=0x7f59440c3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.954+0000 7f594adff700 1 -- 172.21.15.118:0/3954307096 shutdown_connections 2023-09-28T04:23:26.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.954+0000 7f594adff700 1 -- 172.21.15.118:0/3954307096 wait complete. 2023-09-28T04:23:26.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.957+0000 7f0148fff700 1 -- 172.21.15.118:0/3927720021 --> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0144071980 con 0x7f012406fd60 2023-09-28T04:23:26.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.957+0000 7febdbfff700 1 -- 172.21.15.118:0/3938396447 --> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7febd40bacc0 con 0x7febb806fd30 2023-09-28T04:23:26.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.957+0000 7f01327fc700 1 -- 172.21.15.118:0/3927720021 <== osd.2 v2:172.21.15.118:6808/114259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0144071980 con 0x7f012406fd60 2023-09-28T04:23:26.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.958+0000 7febc9ffb700 1 -- 172.21.15.118:0/3938396447 <== osd.5 v2:172.21.15.174:6817/119908 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7febd40bacc0 con 0x7febb806fd30 2023-09-28T04:23:26.968 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2023-09-28T04:23:26.969 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-28T04:23:26.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.958+0000 7f0148fff700 1 -- 172.21.15.118:0/3927720021 >> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] conn(0x7f012406fd60 msgr2=0x7f0124072170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.958+0000 7f0148fff700 1 --2- 172.21.15.118:0/3927720021 >> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] conn(0x7f012406fd60 0x7f0124072170 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7fdcc1ffb700 1 -- 172.21.15.118:0/1563332852 --> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdcdc1552b0 con 0x7fdcc806fd30 2023-09-28T04:23:26.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7febdbfff700 1 -- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] conn(0x7febb806fd30 msgr2=0x7febb8072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7febdbfff700 1 --2- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] conn(0x7febb806fd30 0x7febb8072140 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7febdbfff700 1 -- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7febb8067480 msgr2=0x7febb8069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7febdbfff700 1 --2- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7febb8067480 0x7febb8069930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7febd406d900 tx=0x7febc4017000 comp rx=0 tx=0).stop 2023-09-28T04:23:26.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7febdbfff700 1 -- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febd406e3d0 msgr2=0x7febd414b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7febdbfff700 1 --2- 172.21.15.118:0/3938396447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febd406e3d0 0x7febd414b000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7febd000c5e0 tx=0x7febd0000fb0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7f0148fff700 1 -- 172.21.15.118:0/3927720021 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f01240674b0 msgr2=0x7f0124069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7f0148fff700 1 --2- 172.21.15.118:0/3927720021 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f01240674b0 0x7f0124069960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01440bede0 tx=0x7f0138016000 comp rx=0 tx=0).stop 2023-09-28T04:23:26.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7f0148fff700 1 -- 172.21.15.118:0/3927720021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f014406e3d0 msgr2=0x7f01440bd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7f0148fff700 1 --2- 172.21.15.118:0/3927720021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f014406e3d0 0x7f01440bd5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f013400b570 tx=0x7f0134009060 comp rx=0 tx=0).stop 2023-09-28T04:23:26.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7f0142d9d700 1 -- 172.21.15.118:0/3927720021 reap_dead start 2023-09-28T04:23:26.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7f0148fff700 1 -- 172.21.15.118:0/3927720021 shutdown_connections 2023-09-28T04:23:26.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7f0148fff700 1 -- 172.21.15.118:0/3927720021 >> 172.21.15.118:0/3927720021 conn(0x7f0144067630 msgr2=0x7f014406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7fdcc3fff700 1 -- 172.21.15.118:0/1563332852 <== osd.3 v2:172.21.15.118:6800/114258 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdcdc1552b0 con 0x7fdcc806fd30 2023-09-28T04:23:26.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7febda59c700 1 -- 172.21.15.118:0/3938396447 reap_dead start 2023-09-28T04:23:26.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7febdbfff700 1 -- 172.21.15.118:0/3938396447 shutdown_connections 2023-09-28T04:23:26.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.959+0000 7febdbfff700 1 -- 172.21.15.118:0/3938396447 >> 172.21.15.118:0/3938396447 conn(0x7febd4067630 msgr2=0x7febd40c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.960+0000 7febdbfff700 1 -- 172.21.15.118:0/3938396447 shutdown_connections 2023-09-28T04:23:26.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.960+0000 7febdbfff700 1 -- 172.21.15.118:0/3938396447 wait complete. 2023-09-28T04:23:26.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.960+0000 7f0148fff700 1 -- 172.21.15.118:0/3927720021 shutdown_connections 2023-09-28T04:23:26.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.960+0000 7f0148fff700 1 -- 172.21.15.118:0/3927720021 wait complete. 2023-09-28T04:23:26.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.960+0000 7fdcc1ffb700 1 -- 172.21.15.118:0/1563332852 >> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] conn(0x7fdcc806fd30 msgr2=0x7fdcc8072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.960+0000 7fdcc1ffb700 1 --2- 172.21.15.118:0/1563332852 >> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] conn(0x7fdcc806fd30 0x7fdcc8072140 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.961+0000 7fdcc1ffb700 1 -- 172.21.15.118:0/1563332852 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdcc8067480 msgr2=0x7fdcc8069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.961+0000 7fdcc1ffb700 1 --2- 172.21.15.118:0/1563332852 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdcc8067480 0x7fdcc8069930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00011e0 tx=0x7fdcd00079d0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.961+0000 7fdcc1ffb700 1 -- 172.21.15.118:0/1563332852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcdc0c49d0 msgr2=0x7fdcdc1629e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.961+0000 7fdcc1ffb700 1 --2- 172.21.15.118:0/1563332852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcdc0c49d0 0x7fdcdc1629e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc06d380 tx=0x7fdcd4016000 comp rx=0 tx=0).stop 2023-09-28T04:23:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.961+0000 7fdce0d9c700 1 -- 172.21.15.118:0/1563332852 reap_dead start 2023-09-28T04:23:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.961+0000 7fdcc1ffb700 1 -- 172.21.15.118:0/1563332852 shutdown_connections 2023-09-28T04:23:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.961+0000 7fdcc1ffb700 1 -- 172.21.15.118:0/1563332852 >> 172.21.15.118:0/1563332852 conn(0x7fdcdc067630 msgr2=0x7fdcdc14b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.962+0000 7fdcc1ffb700 1 -- 172.21.15.118:0/1563332852 shutdown_connections 2023-09-28T04:23:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.962+0000 7fdcc1ffb700 1 -- 172.21.15.118:0/1563332852 wait complete. 2023-09-28T04:23:26.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.965+0000 7f42125ff700 1 -- 172.21.15.118:0/1854208459 --> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41ec002d30 con 0x7f41f806fcb0 2023-09-28T04:23:26.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.966+0000 7f41f3fff700 1 -- 172.21.15.118:0/1854208459 <== osd.7 v2:172.21.15.174:6808/119881 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f41ec002d30 con 0x7f41f806fcb0 2023-09-28T04:23:26.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.966+0000 7f21393ff700 1 -- 172.21.15.118:0/562620213 --> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f21340c63a0 con 0x7f212006fd60 2023-09-28T04:23:26.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.966+0000 7f42125ff700 1 -- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] conn(0x7f41f806fcb0 msgr2=0x7f41f80720c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.966+0000 7f42125ff700 1 --2- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] conn(0x7f41f806fcb0 0x7f41f80720c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.967+0000 7f211affd700 1 -- 172.21.15.118:0/562620213 <== osd.6 v2:172.21.15.174:6816/119911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f21340c63a0 con 0x7f212006fd60 2023-09-28T04:23:26.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.967+0000 7f42125ff700 1 -- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f41f8067400 msgr2=0x7f41f80698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.967+0000 7f42125ff700 1 --2- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f41f8067400 0x7f41f80698b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f420c0b41d0 tx=0x7f41fc0091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.967+0000 7f42125ff700 1 -- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f420c068140 msgr2=0x7f420c16c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.967+0000 7f42125ff700 1 --2- 172.21.15.118:0/1854208459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f420c068140 0x7f420c16c120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f420400cc70 tx=0x7f4204001a10 comp rx=0 tx=0).stop 2023-09-28T04:23:26.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.967+0000 7f4210b9c700 1 -- 172.21.15.118:0/1854208459 reap_dead start 2023-09-28T04:23:26.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.967+0000 7f42125ff700 1 -- 172.21.15.118:0/1854208459 shutdown_connections 2023-09-28T04:23:26.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.967+0000 7f42125ff700 1 -- 172.21.15.118:0/1854208459 >> 172.21.15.118:0/1854208459 conn(0x7f420c067630 msgr2=0x7f420c06dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.968+0000 7f42125ff700 1 -- 172.21.15.118:0/1854208459 shutdown_connections 2023-09-28T04:23:26.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.968+0000 7f42125ff700 1 -- 172.21.15.118:0/1854208459 wait complete. 2023-09-28T04:23:26.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.974+0000 7f21393ff700 1 -- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] conn(0x7f212006fd60 msgr2=0x7f2120072170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.974+0000 7f21393ff700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] conn(0x7f212006fd60 0x7f2120072170 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:26.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.974+0000 7f21393ff700 1 -- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f21200674b0 msgr2=0x7f2120069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.974+0000 7f21393ff700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f21200674b0 0x7f2120069960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f21240091e0 tx=0x7f2124017000 comp rx=0 tx=0).stop 2023-09-28T04:23:26.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.974+0000 7f21393ff700 1 -- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21340adf10 msgr2=0x7f2134159340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:26.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.974+0000 7f21393ff700 1 --2- 172.21.15.118:0/562620213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21340adf10 0x7f2134159340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f212800c4c0 tx=0x7f2128007d40 comp rx=0 tx=0).stop 2023-09-28T04:23:26.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.974+0000 7f21337fe700 1 -- 172.21.15.118:0/562620213 reap_dead start 2023-09-28T04:23:26.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.974+0000 7f21393ff700 1 -- 172.21.15.118:0/562620213 shutdown_connections 2023-09-28T04:23:26.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.974+0000 7f21393ff700 1 -- 172.21.15.118:0/562620213 >> 172.21.15.118:0/562620213 conn(0x7f2134063cc0 msgr2=0x7f21340cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:26.980 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2023-09-28T04:23:26.981 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-28T04:23:26.989 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2023-09-28T04:23:26.989 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.983+0000 7f21393ff700 1 -- 172.21.15.118:0/562620213 shutdown_connections 2023-09-28T04:23:26.989 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:26.985+0000 7f21393ff700 1 -- 172.21.15.118:0/562620213 wait complete. 2023-09-28T04:23:26.989 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-28T04:23:26.994 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2023-09-28T04:23:26.995 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-28T04:23:26.995 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2023-09-28T04:23:26.996 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-28T04:23:26.999 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2023-09-28T04:23:27.000 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-28T04:23:27.000 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2023-09-28T04:23:27.001 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-28T04:23:27.009 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2023-09-28T04:23:27.010 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-28T04:23:27.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.310+0000 7f7bbc5ff700 1 Processor -- start 2023-09-28T04:23:27.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.310+0000 7f7bbc5ff700 1 -- start start 2023-09-28T04:23:27.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.313+0000 7f7bbc5ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bb4153da0 0x7f7bb415af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.313+0000 7f7bbc5ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7bb40c5110 0x7f7bb406de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.313+0000 7f7bbc5ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb406bf60 con 0x7f7bb415b4a0 2023-09-28T04:23:27.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.313+0000 7f7bbc5ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb406c3f0 con 0x7f7bb40c5110 2023-09-28T04:23:27.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.313+0000 7f7bbc5ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb40685f0 con 0x7f7bb4153da0 2023-09-28T04:23:27.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.313+0000 7f7bb9b9a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7bb40c5110 0x7f7bb406de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.313+0000 7f7bb9b9a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7bb40c5110 0x7f7bb406de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42456/0 (socket says 172.21.15.118:42456) 2023-09-28T04:23:27.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.314+0000 7f7bb9b9a700 1 -- 172.21.15.118:0/3226415868 learned_addr learned my addr 172.21.15.118:0/3226415868 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.314+0000 7f7bba39b700 1 --2- 172.21.15.118:0/3226415868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bb4153da0 0x7f7bb415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.314+0000 7f7bb9b9a700 1 -- 172.21.15.118:0/3226415868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bb4153da0 msgr2=0x7f7bb415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:27.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.314+0000 7f7bb9b9a700 1 --2- 172.21.15.118:0/3226415868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bb4153da0 0x7f7bb415af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.314+0000 7f7bb9b9a700 1 -- 172.21.15.118:0/3226415868 >> v1:172.21.15.174:6789/0 conn(0x7f7bb415b4a0 legacy=0x7f7bb406e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:27.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.314+0000 7f7bb9b9a700 1 -- 172.21.15.118:0/3226415868 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb415a510 con 0x7f7bb40c5110 2023-09-28T04:23:27.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.314+0000 7f7bb9b9a700 1 --2- 172.21.15.118:0/3226415868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb40c5110 0x7f7bb406de90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009f20 tx=0x7f7bac009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd16c159cd88c7c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.315+0000 7f7bb9399700 1 -- 172.21.15.118:0/3226415868 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac00e070 con 0x7f7bb40c5110 2023-09-28T04:23:27.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.315+0000 7f7bb9399700 1 -- 172.21.15.118:0/3226415868 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac00ba20 con 0x7f7bb40c5110 2023-09-28T04:23:27.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.315+0000 7f7bb9399700 1 -- 172.21.15.118:0/3226415868 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac0092e0 con 0x7f7bb40c5110 2023-09-28T04:23:27.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.316+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/3226415868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb40c5110 msgr2=0x7f7bb406de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.316+0000 7f7bbc5ff700 1 --2- 172.21.15.118:0/3226415868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb40c5110 0x7f7bb406de90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009f20 tx=0x7f7bac009840 comp rx=0 tx=0).stop 2023-09-28T04:23:27.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.316+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/3226415868 shutdown_connections 2023-09-28T04:23:27.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.316+0000 7f7bbc5ff700 1 --2- 172.21.15.118:0/3226415868 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bb4153da0 0x7f7bb415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.316+0000 7f7bbc5ff700 1 --2- 172.21.15.118:0/3226415868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb40c5110 0x7f7bb406de90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.316+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/3226415868 >> 172.21.15.118:0/3226415868 conn(0x7f7bb4067630 msgr2=0x7f7bb4067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.317+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/3226415868 shutdown_connections 2023-09-28T04:23:27.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.317+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/3226415868 wait complete. 2023-09-28T04:23:27.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.315+0000 7f9fb37ff700 1 Processor -- start 2023-09-28T04:23:27.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.315+0000 7f9fb37ff700 1 -- start start 2023-09-28T04:23:27.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.317+0000 7f9fb37ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9fac0c18c0 0x7f9fac0c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.317+0000 7f9fb37ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9fac06e9f0 0x7f9fac0c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.317+0000 7f9fb37ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fac0c3760 con 0x7f9fac0c1c90 2023-09-28T04:23:27.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.317+0000 7f9fb37ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac06e5d0 con 0x7f9fac06e9f0 2023-09-28T04:23:27.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.317+0000 7f9fb37ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac06d9e0 con 0x7f9fac0c18c0 2023-09-28T04:23:27.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.318+0000 7f9fb0d9a700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9fac0c1c90 0x7f9fac06b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46352/0 (socket says 172.21.15.118:46352) 2023-09-28T04:23:27.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.318+0000 7f9fb0d9a700 1 -- 172.21.15.118:0/2120495836 learned_addr learned my addr 172.21.15.118:0/2120495836 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:27.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.318+0000 7f9fb159b700 1 --2- 172.21.15.118:0/2120495836 >> v2:172.21.15.174:3300/0 conn(0x7f9fac0c18c0 0x7f9fac0c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.319+0000 7f9fb1d9c700 1 --2- 172.21.15.118:0/2120495836 >> v2:172.21.15.118:3300/0 conn(0x7f9fac06e9f0 0x7f9fac0c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.319+0000 7f9fb159b700 1 -- 172.21.15.118:0/2120495836 >> v2:172.21.15.118:3300/0 conn(0x7f9fac06e9f0 msgr2=0x7f9fac0c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:27.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.319+0000 7f9fb159b700 1 --2- 172.21.15.118:0/2120495836 >> v2:172.21.15.118:3300/0 conn(0x7f9fac06e9f0 0x7f9fac0c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.319+0000 7f9fb159b700 1 -- 172.21.15.118:0/2120495836 >> v1:172.21.15.174:6789/0 conn(0x7f9fac0c1c90 legacy=0x7f9fac06b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:27.322 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.319+0000 7f9fb159b700 1 -- 172.21.15.118:0/2120495836 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac163100 con 0x7f9fac0c18c0 2023-09-28T04:23:27.322 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.320+0000 7f9fb159b700 1 --2- 172.21.15.118:0/2120495836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fac0c18c0 0x7f9fac0c2530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9fac06c570 tx=0x7f9fa8007200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeff48cfb80ffb2c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.322 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.319+0000 7f7bbc5ff700 1 Processor -- start 2023-09-28T04:23:27.322 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.320+0000 7f9fa3fff700 1 -- 172.21.15.118:0/2120495836 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80092e0 con 0x7f9fac0c18c0 2023-09-28T04:23:27.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.320+0000 7f9fa3fff700 1 -- 172.21.15.118:0/2120495836 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa800f960 con 0x7f9fac0c18c0 2023-09-28T04:23:27.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.320+0000 7f9fa3fff700 1 -- 172.21.15.118:0/2120495836 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa800fd20 con 0x7f9fac0c18c0 2023-09-28T04:23:27.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.321+0000 7f9fb37ff700 1 -- 172.21.15.118:0/2120495836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fac0c18c0 msgr2=0x7f9fac0c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.321+0000 7f9fb37ff700 1 --2- 172.21.15.118:0/2120495836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fac0c18c0 0x7f9fac0c2530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9fac06c570 tx=0x7f9fa8007200 comp rx=0 tx=0).stop 2023-09-28T04:23:27.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.321+0000 7f9fb37ff700 1 -- 172.21.15.118:0/2120495836 shutdown_connections 2023-09-28T04:23:27.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.321+0000 7f9fb37ff700 1 --2- 172.21.15.118:0/2120495836 >> v2:172.21.15.118:3300/0 conn(0x7f9fac06e9f0 0x7f9fac0c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.321+0000 7f9fb37ff700 1 --2- 172.21.15.118:0/2120495836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fac0c18c0 0x7f9fac0c2530 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.321+0000 7f9fb37ff700 1 -- 172.21.15.118:0/2120495836 >> 172.21.15.118:0/2120495836 conn(0x7f9fac067630 msgr2=0x7f9fac067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.319+0000 7f7bbc5ff700 1 -- start start 2023-09-28T04:23:27.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.321+0000 7f7bbc5ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bb40c5110 0x7f7bb4158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.321+0000 7f7bbc5ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb4153da0 0x7f7bb4158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.321+0000 7f7bbc5ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb415b4a0 0x7f7bb4169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.321+0000 7f7bbc5ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb416d7e0 con 0x7f7bb4153da0 2023-09-28T04:23:27.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.321+0000 7f7bbc5ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb40bb560 con 0x7f7bb415b4a0 2023-09-28T04:23:27.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.321+0000 7f7bbc5ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb41698a0 con 0x7f7bb40c5110 2023-09-28T04:23:27.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.322+0000 7f7bba39b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bb40c5110 0x7f7bb4158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.322+0000 7f7bba39b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bb40c5110 0x7f7bb4158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:59212/0 (socket says 172.21.15.118:59212) 2023-09-28T04:23:27.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.322+0000 7f7bba39b700 1 -- 172.21.15.118:0/2070382866 learned_addr learned my addr 172.21.15.118:0/2070382866 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.322+0000 7f7bbab9c700 1 --2- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb415b4a0 0x7f7bb4169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.322+0000 7f7bba39b700 1 -- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb415b4a0 msgr2=0x7f7bb4169d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.322+0000 7f7bba39b700 1 --2- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb415b4a0 0x7f7bb4169d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.322+0000 7f7bba39b700 1 -- 172.21.15.118:0/2070382866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb4153da0 msgr2=0x7f7bb4158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.322+0000 7f7bba39b700 1 --2- 172.21.15.118:0/2070382866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb4153da0 0x7f7bb4158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.322+0000 7f7bba39b700 1 -- 172.21.15.118:0/2070382866 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac009ae0 con 0x7f7bb40c5110 2023-09-28T04:23:27.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.323+0000 7f7bba39b700 1 --2- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bb40c5110 0x7f7bb4158a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000ecb0 tx=0x7f7bb00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.323+0000 7f9fb37ff700 1 -- 172.21.15.118:0/2120495836 shutdown_connections 2023-09-28T04:23:27.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.325+0000 7f7baa7fc700 1 -- 172.21.15.118:0/2070382866 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb000c920 con 0x7f7bb40c5110 2023-09-28T04:23:27.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.325+0000 7f7baa7fc700 1 -- 172.21.15.118:0/2070382866 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb000ca80 con 0x7f7bb40c5110 2023-09-28T04:23:27.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.325+0000 7f7baa7fc700 1 -- 172.21.15.118:0/2070382866 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb000ce20 con 0x7f7bb40c5110 2023-09-28T04:23:27.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.325+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/2070382866 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb416d9d0 con 0x7f7bb40c5110 2023-09-28T04:23:27.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.325+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/2070382866 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb406e820 con 0x7f7bb40c5110 2023-09-28T04:23:27.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.324+0000 7f9fb37ff700 1 -- 172.21.15.118:0/2120495836 wait complete. 2023-09-28T04:23:27.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.327+0000 7f9fb37ff700 1 Processor -- start 2023-09-28T04:23:27.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.327+0000 7f9fb37ff700 1 -- start start 2023-09-28T04:23:27.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.328+0000 7f9fb37ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fac06e9f0 0x7f9fac164390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.328+0000 7f9fb37ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fac0c18c0 0x7f9fac1648d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.328+0000 7f9fb37ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fac0c5a50 0x7f9fac156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.328+0000 7f9fb37ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac163830 con 0x7f9fac0c5a50 2023-09-28T04:23:27.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.328+0000 7f9fb37ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1779b0 con 0x7f9fac0c18c0 2023-09-28T04:23:27.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.328+0000 7f9fb37ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1663f0 con 0x7f9fac06e9f0 2023-09-28T04:23:27.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.329+0000 7f9fb159b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fac06e9f0 0x7f9fac164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.329+0000 7f9fb159b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fac06e9f0 0x7f9fac164390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:59216/0 (socket says 172.21.15.118:59216) 2023-09-28T04:23:27.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.329+0000 7f9fb159b700 1 -- 172.21.15.118:0/3952173955 learned_addr learned my addr 172.21.15.118:0/3952173955 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.329+0000 7f9fb0d9a700 1 --2- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fac0c18c0 0x7f9fac1648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.330+0000 7f9fb159b700 1 -- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fac0c18c0 msgr2=0x7f9fac1648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.330+0000 7f9fb159b700 1 --2- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fac0c18c0 0x7f9fac1648d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.330+0000 7f9fb159b700 1 -- 172.21.15.118:0/3952173955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fac0c5a50 msgr2=0x7f9fac156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.330+0000 7f9fb159b700 1 --2- 172.21.15.118:0/3952173955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fac0c5a50 0x7f9fac156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.330+0000 7f9fb159b700 1 -- 172.21.15.118:0/3952173955 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80094d0 con 0x7f9fac06e9f0 2023-09-28T04:23:27.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.330+0000 7f9fb159b700 1 --2- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fac06e9f0 0x7f9fac164390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80089e0 tx=0x7f9fa801a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.330+0000 7f9fa17fa700 1 -- 172.21.15.118:0/3952173955 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa800f070 con 0x7f9fac06e9f0 2023-09-28T04:23:27.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.330+0000 7f9fa17fa700 1 -- 172.21.15.118:0/3952173955 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa80092e0 con 0x7f9fac06e9f0 2023-09-28T04:23:27.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.330+0000 7f9fa17fa700 1 -- 172.21.15.118:0/3952173955 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8017410 con 0x7f9fac06e9f0 2023-09-28T04:23:27.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.330+0000 7f9fb37ff700 1 -- 172.21.15.118:0/3952173955 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac177bc0 con 0x7f9fac06e9f0 2023-09-28T04:23:27.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.331+0000 7f9fb37ff700 1 -- 172.21.15.118:0/3952173955 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac165040 con 0x7f9fac06e9f0 2023-09-28T04:23:27.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.331+0000 7f7baa7fc700 1 -- 172.21.15.118:0/2070382866 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7bb0013680 con 0x7f7bb40c5110 2023-09-28T04:23:27.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.332+0000 7f7baa7fc700 1 --2- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7b98067450 0x7f7b98069900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.336 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.333+0000 7f7baa7fc700 1 -- 172.21.15.118:0/2070382866 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7bb0084e90 con 0x7f7bb40c5110 2023-09-28T04:23:27.336 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.333+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/2070382866 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c0052b0 con 0x7f7bb40c5110 2023-09-28T04:23:27.336 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.334+0000 7f7bb9b9a700 1 --2- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7b98067450 0x7f7b98069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.336 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.335+0000 7f9fa17fa700 1 -- 172.21.15.118:0/3952173955 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9fa8017800 con 0x7f9fac06e9f0 2023-09-28T04:23:27.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.336+0000 7f9fb37ff700 1 -- 172.21.15.118:0/3952173955 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c0052b0 con 0x7f9fac06e9f0 2023-09-28T04:23:27.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.336+0000 7f0c71fff700 1 Processor -- start 2023-09-28T04:23:27.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.336+0000 7f0c71fff700 1 -- start start 2023-09-28T04:23:27.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.337+0000 7f9fa17fa700 1 --2- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9f90067480 0x7f9f90069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.337+0000 7f9fa17fa700 1 -- 172.21.15.118:0/3952173955 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9fa8084e70 con 0x7f9fac06e9f0 2023-09-28T04:23:27.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.338+0000 7f7bb9b9a700 1 --2- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7b98067450 0x7f7b98069900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7bb40bea70 tx=0x7f7bac017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.338+0000 7f9fb0d9a700 1 --2- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9f90067480 0x7f9f90069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.338+0000 7f0c71fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06b490 0x7f0c6c0c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.338+0000 7f0c71fff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6c06d9e0 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.338+0000 7f0c71fff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6c163100 con 0x7f0c6c06bf70 2023-09-28T04:23:27.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.338+0000 7f0c71fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c06e5d0 con 0x7f0c6c06b490 2023-09-28T04:23:27.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.339+0000 7f0c6b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06b490 0x7f0c6c0c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.339+0000 7f0c6b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06b490 0x7f0c6c0c2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:59226/0 (socket says 172.21.15.118:59226) 2023-09-28T04:23:27.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.339+0000 7f0c6b7fe700 1 -- 172.21.15.118:0/13095763 learned_addr learned my addr 172.21.15.118:0/13095763 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.339+0000 7f0c6bfff700 1 --1- 172.21.15.118:0/13095763 >> v1:172.21.15.174:6789/0 conn(0x7f0c6c06bf70 0x7f0c6c16cc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46362/0 (socket says 172.21.15.118:46362) 2023-09-28T04:23:27.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.339+0000 7f0c6affd700 1 -- 172.21.15.118:0/13095763 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636426087 0 0) 0x7f0c6c163100 con 0x7f0c6c06bf70 2023-09-28T04:23:27.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.339+0000 7f0c6affd700 1 -- 172.21.15.118:0/13095763 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c58003570 con 0x7f0c6c06bf70 2023-09-28T04:23:27.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.339+0000 7f0c6b7fe700 1 -- 172.21.15.118:0/13095763 >> v1:172.21.15.174:6789/0 conn(0x7f0c6c06bf70 legacy=0x7f0c6c16cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.339+0000 7f0c6b7fe700 1 -- 172.21.15.118:0/13095763 >> v1:172.21.15.118:6789/0 conn(0x7f0c6c06e9f0 legacy=0x7f0c6c06b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.339+0000 7f0c6b7fe700 1 -- 172.21.15.118:0/13095763 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c06dc30 con 0x7f0c6c06b490 2023-09-28T04:23:27.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.340+0000 7f9fb0d9a700 1 --2- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9f90067480 0x7f9f90069930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0c8a20 tx=0x7f9f9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.340+0000 7f0c6b7fe700 1 --2- 172.21.15.118:0/13095763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06b490 0x7f0c6c0c2530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400bc70 tx=0x7f0c5400b4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc3f18c933f01ba0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.340+0000 7f7baa7fc700 1 -- 172.21.15.118:0/2070382866 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7bb0051db0 con 0x7f7bb40c5110 2023-09-28T04:23:27.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.345+0000 7f9fa17fa700 1 -- 172.21.15.118:0/3952173955 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9fa8051d50 con 0x7f9fac06e9f0 2023-09-28T04:23:27.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.345+0000 7f0c6affd700 1 -- 172.21.15.118:0/13095763 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5400dac0 con 0x7f0c6c06b490 2023-09-28T04:23:27.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.345+0000 7f0c6affd700 1 -- 172.21.15.118:0/13095763 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5400dc20 con 0x7f0c6c06b490 2023-09-28T04:23:27.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.345+0000 7f0c6affd700 1 -- 172.21.15.118:0/13095763 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54017420 con 0x7f0c6c06b490 2023-09-28T04:23:27.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.346+0000 7f0c71fff700 1 -- 172.21.15.118:0/13095763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06b490 msgr2=0x7f0c6c0c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.346+0000 7f0c71fff700 1 --2- 172.21.15.118:0/13095763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06b490 0x7f0c6c0c2530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400bc70 tx=0x7f0c5400b4e0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.347+0000 7f0c71fff700 1 -- 172.21.15.118:0/13095763 shutdown_connections 2023-09-28T04:23:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.347+0000 7f0c71fff700 1 --2- 172.21.15.118:0/13095763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06b490 0x7f0c6c0c2530 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.347+0000 7f0c71fff700 1 -- 172.21.15.118:0/13095763 >> 172.21.15.118:0/13095763 conn(0x7f0c6c067630 msgr2=0x7f0c6c067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.347+0000 7f0c71fff700 1 -- 172.21.15.118:0/13095763 shutdown_connections 2023-09-28T04:23:27.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.347+0000 7f0c71fff700 1 -- 172.21.15.118:0/13095763 wait complete. 2023-09-28T04:23:27.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.349+0000 7f0c71fff700 1 Processor -- start 2023-09-28T04:23:27.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.350+0000 7f0c71fff700 1 -- start start 2023-09-28T04:23:27.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.351+0000 7f0c71fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c6c06b490 0x7f0c6c0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.351+0000 7f0c71fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c6c06bf70 0x7f0c6c0b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.351+0000 7f0c71fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06e9f0 0x7f0c6c0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.351+0000 7f0c71fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0bdc00 con 0x7f0c6c06b490 2023-09-28T04:23:27.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.351+0000 7f0c71fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c161fe0 con 0x7f0c6c06bf70 2023-09-28T04:23:27.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.351+0000 7f0c71fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c157ac0 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.352+0000 7f0c6bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06e9f0 0x7f0c6c0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.352+0000 7f0c6bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06e9f0 0x7f0c6c0c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:59236/0 (socket says 172.21.15.118:59236) 2023-09-28T04:23:27.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.352+0000 7f0c6bfff700 1 -- 172.21.15.118:0/999437767 learned_addr learned my addr 172.21.15.118:0/999437767 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.352+0000 7f0c62ffd700 1 --2- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c6c06bf70 0x7f0c6c0b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.354+0000 7f0c6bfff700 1 -- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c6c06bf70 msgr2=0x7f0c6c0b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.354+0000 7f0c6bfff700 1 --2- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c6c06bf70 0x7f0c6c0b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.354+0000 7f0c6bfff700 1 -- 172.21.15.118:0/999437767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c6c06b490 msgr2=0x7f0c6c0b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.354+0000 7f0c6bfff700 1 --2- 172.21.15.118:0/999437767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c6c06b490 0x7f0c6c0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.355+0000 7f0c6bfff700 1 -- 172.21.15.118:0/999437767 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5400b780 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.355+0000 7f0c6bfff700 1 --2- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06e9f0 0x7f0c6c0c78b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400cd60 tx=0x7f0c64001b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.356+0000 7f0c63fff700 1 -- 172.21.15.118:0/999437767 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c64005df0 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.356+0000 7f0c63fff700 1 -- 172.21.15.118:0/999437767 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6400a920 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.356+0000 7f0c63fff700 1 -- 172.21.15.118:0/999437767 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6400aca0 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.356+0000 7f0c71fff700 1 -- 172.21.15.118:0/999437767 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6c157d40 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.356+0000 7f0c71fff700 1 -- 172.21.15.118:0/999437767 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6c0b44b0 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.359+0000 7f60589ff700 1 Processor -- start 2023-09-28T04:23:27.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.359+0000 7f60589ff700 1 -- start start 2023-09-28T04:23:27.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.359+0000 7f0c71fff700 1 -- 172.21.15.118:0/999437767 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c500052b0 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.361+0000 7f0c63fff700 1 -- 172.21.15.118:0/999437767 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0c64007300 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.362+0000 7f0c63fff700 1 --2- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f0c4c067480 0x7f0c4c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.362+0000 7f0c63fff700 1 -- 172.21.15.118:0/999437767 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0c64085130 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.362+0000 7f60589ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60540c5110 0x7f6054153df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.362+0000 7f60589ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60540c28f0 con 0x7f6054153a20 2023-09-28T04:23:27.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.362+0000 7f60589ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6054159b70 con 0x7f605415d9b0 2023-09-28T04:23:27.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.362+0000 7f60589ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605415a950 con 0x7f60540c5110 2023-09-28T04:23:27.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.362+0000 7f6051d9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60540c5110 0x7f6054153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.362+0000 7f6051d9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60540c5110 0x7f6054153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:59252/0 (socket says 172.21.15.118:59252) 2023-09-28T04:23:27.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.363+0000 7f6051d9b700 1 -- 172.21.15.118:0/426863747 learned_addr learned my addr 172.21.15.118:0/426863747 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.364+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819363913 0 0) 0x7f60540c28f0 con 0x7f6054153a20 2023-09-28T04:23:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.364+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f603c003570 con 0x7f6054153a20 2023-09-28T04:23:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.364+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898078660 0 0) 0x7f6054159b70 con 0x7f605415d9b0 2023-09-28T04:23:27.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.364+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60540c28f0 con 0x7f605415d9b0 2023-09-28T04:23:27.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.364+0000 7f0c63fff700 1 -- 172.21.15.118:0/999437767 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0c64052000 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f0c6b7fe700 1 --2- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f0c4c067480 0x7f0c4c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2222422204 0 0) 0x7f603c003570 con 0x7f6054153a20 2023-09-28T04:23:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60540c5110 msgr2=0x7f6054153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f605159a700 1 --2- 172.21.15.118:0/426863747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60540c5110 0x7f6054153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 >> v1:172.21.15.174:6789/0 conn(0x7f605415d9b0 legacy=0x7f60540c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6054159dd0 con 0x7f6054153a20 2023-09-28T04:23:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 605954562 0 0) 0x7f604c0017f0 con 0x7f6054153a20 2023-09-28T04:23:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 >> v1:172.21.15.118:6789/0 conn(0x7f6054153a20 legacy=0x7f60540c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f605159a700 1 --2- 172.21.15.118:0/426863747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f603c004d30 0x7f603c005100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f605159a700 1 --2- 172.21.15.118:0/426863747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f603c0037b0 0x7f603c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f605159a700 1 --2- 172.21.15.118:0/426863747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c0041b0 0x7f603c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60480010e0 con 0x7f603c004d30 2023-09-28T04:23:27.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605415a950 con 0x7f603c0037b0 2023-09-28T04:23:27.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.365+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c00c130 con 0x7f603c0041b0 2023-09-28T04:23:27.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.366+0000 7f605259c700 1 --2- 172.21.15.118:0/426863747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f603c004d30 0x7f603c005100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.367+0000 7f605259c700 1 -- 172.21.15.118:0/426863747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c0041b0 msgr2=0x7f603c00ba60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-28T04:23:27.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.367+0000 7f605259c700 1 --2- 172.21.15.118:0/426863747 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f603c0041b0 0x7f603c00ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.367+0000 7f605259c700 1 -- 172.21.15.118:0/426863747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f603c0037b0 msgr2=0x7f603c003c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T04:23:27.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.367+0000 7f605259c700 1 --2- 172.21.15.118:0/426863747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f603c0037b0 0x7f603c003c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.367+0000 7f605259c700 1 -- 172.21.15.118:0/426863747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6054159dd0 con 0x7f603c004d30 2023-09-28T04:23:27.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.367+0000 7f605259c700 1 --2- 172.21.15.118:0/426863747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f603c004d30 0x7f603c005100 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f604c00c640 tx=0x7f604c002e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555582c4eca3fa13 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.368+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c016070 con 0x7f603c004d30 2023-09-28T04:23:27.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.368+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c006ba0 con 0x7f603c004d30 2023-09-28T04:23:27.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.368+0000 7f605159a700 1 -- 172.21.15.118:0/426863747 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c003130 con 0x7f603c004d30 2023-09-28T04:23:27.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.369+0000 7f60589ff700 1 -- 172.21.15.118:0/426863747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f603c004d30 msgr2=0x7f603c005100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.369+0000 7f60589ff700 1 --2- 172.21.15.118:0/426863747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f603c004d30 0x7f603c005100 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f604c00c640 tx=0x7f604c002e20 comp rx=0 tx=0).stop 2023-09-28T04:23:27.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.369+0000 7f6052d9d700 1 -- 172.21.15.118:0/426863747 reap_dead start 2023-09-28T04:23:27.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.369+0000 7f60589ff700 1 -- 172.21.15.118:0/426863747 shutdown_connections 2023-09-28T04:23:27.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.369+0000 7f60589ff700 1 -- 172.21.15.118:0/426863747 >> 172.21.15.118:0/426863747 conn(0x7f6054067630 msgr2=0x7f6054067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.371+0000 7f60589ff700 1 -- 172.21.15.118:0/426863747 shutdown_connections 2023-09-28T04:23:27.372 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.371+0000 7f60589ff700 1 -- 172.21.15.118:0/426863747 wait complete. 2023-09-28T04:23:27.372 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.370+0000 7fd8d83ff700 1 Processor -- start 2023-09-28T04:23:27.372 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.371+0000 7fd8d83ff700 1 -- start start 2023-09-28T04:23:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.373+0000 7f60589ff700 1 Processor -- start 2023-09-28T04:23:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.373+0000 7f60589ff700 1 -- start start 2023-09-28T04:23:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.373+0000 7fd8d83ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8d00c5110 0x7fd8d006de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.373+0000 7fd8d83ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd8d006e3d0 0x7fd8d006e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.373+0000 7fd8d83ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d006bf60 con 0x7fd8d0153d10 2023-09-28T04:23:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.373+0000 7fd8d83ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d006f700 con 0x7fd8d006e3d0 2023-09-28T04:23:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.373+0000 7fd8d83ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d006c3f0 con 0x7fd8d00c5110 2023-09-28T04:23:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.373+0000 7fd8d699c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd8d006e3d0 0x7fd8d006e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.374+0000 7fd8d699c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd8d006e3d0 0x7fd8d006e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42510/0 (socket says 172.21.15.118:42510) 2023-09-28T04:23:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.374+0000 7fd8d699c700 1 -- 172.21.15.118:0/333737552 learned_addr learned my addr 172.21.15.118:0/333737552 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.374+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927235178 0 0) 0x7fd8d006bf60 con 0x7fd8d0153d10 2023-09-28T04:23:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.374+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8bc003570 con 0x7fd8d0153d10 2023-09-28T04:23:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7f0c6b7fe700 1 --2- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f0c4c067480 0x7f0c4c069930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400bbc0 tx=0x7f0c5401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7f60589ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f603c004d30 0x7f60540c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7f60589ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6054155260 0x7f60540c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7f60589ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f605416cb80 0x7f6054150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7f60589ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60540c75d0 con 0x7f603c004d30 2023-09-28T04:23:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7f60589ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6054154350 con 0x7f6054155260 2023-09-28T04:23:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7f60589ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60540c5cb0 con 0x7f605416cb80 2023-09-28T04:23:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7f6052d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f605416cb80 0x7f6054150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7f6052d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f605416cb80 0x7f6054150bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:59264/0 (socket says 172.21.15.118:59264) 2023-09-28T04:23:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7f6052d9d700 1 -- 172.21.15.118:0/675647865 learned_addr learned my addr 172.21.15.118:0/675647865 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.376+0000 7f6051d9b700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6054155260 0x7f60540c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.376+0000 7f605259c700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f603c004d30 0x7f60540c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.374+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3787326355 0 0) 0x7fd8bc003570 con 0x7fd8d0153d10 2023-09-28T04:23:27.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.374+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8d00c5110 msgr2=0x7fd8d006de90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T04:23:27.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.374+0000 7fd8d5199700 1 --2- 172.21.15.118:0/333737552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8d00c5110 0x7fd8d006de90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.374+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 >> v2:172.21.15.174:3300/0 conn(0x7fd8d006e3d0 msgr2=0x7fd8d006e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:27.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.374+0000 7fd8d5199700 1 --2- 172.21.15.118:0/333737552 >> v2:172.21.15.174:3300/0 conn(0x7fd8d006e3d0 0x7fd8d006e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.374+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d015a510 con 0x7fd8d0153d10 2023-09-28T04:23:27.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.374+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 605954562 0 0) 0x7fd8c0001470 con 0x7fd8d0153d10 2023-09-28T04:23:27.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 >> v1:172.21.15.174:6789/0 conn(0x7fd8d0153d10 legacy=0x7fd8d015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7fd8d5199700 1 --2- 172.21.15.118:0/333737552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8bc003ae0 0x7fd8bc003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7fd8d5199700 1 --2- 172.21.15.118:0/333737552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8bc004810 0x7fd8bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7fd8d5199700 1 --2- 172.21.15.118:0/333737552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8bc0051c0 0x7fd8bc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d006f700 con 0x7fd8bc003ae0 2023-09-28T04:23:27.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc00c080 con 0x7fd8bc0051c0 2023-09-28T04:23:27.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.375+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc00c240 con 0x7fd8bc004810 2023-09-28T04:23:27.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.376+0000 7f6052d9d700 1 -- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6054155260 msgr2=0x7f60540c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.376+0000 7f6052d9d700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6054155260 0x7f60540c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.376+0000 7f6052d9d700 1 -- 172.21.15.118:0/675647865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f603c004d30 msgr2=0x7f60540c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.380 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.376+0000 7f6052d9d700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f603c004d30 0x7f60540c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.380 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.376+0000 7f6052d9d700 1 -- 172.21.15.118:0/675647865 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60540c6c00 con 0x7f605416cb80 2023-09-28T04:23:27.380 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.376+0000 7f6052d9d700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f605416cb80 0x7f6054150bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f604800c610 tx=0x7f6048000dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.380 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.376+0000 7fd8d619b700 1 --2- 172.21.15.118:0/333737552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8bc003ae0 0x7fd8bc003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.380 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.376+0000 7fd8d699c700 1 --2- 172.21.15.118:0/333737552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8bc0051c0 0x7fd8bc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.380 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.377+0000 7fd8d619b700 1 -- 172.21.15.118:0/333737552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8bc004810 msgr2=0x7fd8bc004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T04:23:27.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.377+0000 7fd8d619b700 1 --2- 172.21.15.118:0/333737552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8bc004810 0x7fd8bc004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.377+0000 7fd8d619b700 1 -- 172.21.15.118:0/333737552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8bc0051c0 msgr2=0x7fd8bc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:27.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.377+0000 7fd8d619b700 1 --2- 172.21.15.118:0/333737552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8bc0051c0 0x7fd8bc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.377+0000 7fd8d619b700 1 -- 172.21.15.118:0/333737552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d015a510 con 0x7fd8bc003ae0 2023-09-28T04:23:27.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.378+0000 7fd8d619b700 1 --2- 172.21.15.118:0/333737552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8bc003ae0 0x7fd8bc003ef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000c320 tx=0x7fd8c00078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67972d024dbcbb14 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.377+0000 7f60427fc700 1 -- 172.21.15.118:0/675647865 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6048016070 con 0x7f605416cb80 2023-09-28T04:23:27.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.377+0000 7f60427fc700 1 -- 172.21.15.118:0/675647865 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604800e550 con 0x7f605416cb80 2023-09-28T04:23:27.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.377+0000 7f60427fc700 1 -- 172.21.15.118:0/675647865 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604800e8d0 con 0x7f605416cb80 2023-09-28T04:23:27.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.377+0000 7f60589ff700 1 -- 172.21.15.118:0/675647865 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60540c8840 con 0x7f605416cb80 2023-09-28T04:23:27.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.378+0000 7f60589ff700 1 -- 172.21.15.118:0/675647865 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60540c6890 con 0x7f605416cb80 2023-09-28T04:23:27.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.378+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0007af0 con 0x7fd8bc003ae0 2023-09-28T04:23:27.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.378+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c000cbd0 con 0x7fd8bc003ae0 2023-09-28T04:23:27.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.378+0000 7fd8d5199700 1 -- 172.21.15.118:0/333737552 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0012420 con 0x7fd8bc003ae0 2023-09-28T04:23:27.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.378+0000 7f9b6abff700 1 Processor -- start 2023-09-28T04:23:27.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.379+0000 7f9b6abff700 1 -- start start 2023-09-28T04:23:27.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.378+0000 7fef0b9ff700 1 Processor -- start 2023-09-28T04:23:27.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.379+0000 7fef0b9ff700 1 -- start start 2023-09-28T04:23:27.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.379+0000 7fd8d83ff700 1 -- 172.21.15.118:0/333737552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8bc003ae0 msgr2=0x7fd8bc003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.379+0000 7fd8d83ff700 1 --2- 172.21.15.118:0/333737552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8bc003ae0 0x7fd8bc003ef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000c320 tx=0x7fd8c00078c0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.379+0000 7fd8d699c700 1 -- 172.21.15.118:0/333737552 reap_dead start 2023-09-28T04:23:27.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.380+0000 7fd8d83ff700 1 -- 172.21.15.118:0/333737552 shutdown_connections 2023-09-28T04:23:27.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.380+0000 7fd8d83ff700 1 -- 172.21.15.118:0/333737552 >> 172.21.15.118:0/333737552 conn(0x7fd8d0067630 msgr2=0x7fd8d0067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.381+0000 7f9b6abff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9b64153d80 0x7f9b640c5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.381+0000 7f9b6abff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b640c3060 con 0x7f9b640c3d80 2023-09-28T04:23:27.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.381+0000 7f9b6abff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6415a930 con 0x7f9b640c6310 2023-09-28T04:23:27.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.381+0000 7f9b6abff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b6415dd30 con 0x7f9b64153d80 2023-09-28T04:23:27.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.381+0000 7f9b63fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9b640c6310 0x7f9b640c3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:46388/0 (socket says 172.21.15.118:46388) 2023-09-28T04:23:27.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.382+0000 7f9b63fff700 1 -- 172.21.15.118:0/4011568764 learned_addr learned my addr 172.21.15.118:0/4011568764 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:27.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.382+0000 7fdf211ff700 1 Processor -- start 2023-09-28T04:23:27.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.381+0000 7fef0b9ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef04155930 0x7fef040c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.381+0000 7fef0b9ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef04151830 0x7fef040c0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.381+0000 7fef0b9ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fef040c10a0 0x7fef0406da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.381+0000 7fef0b9ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef040c2f40 con 0x7fef040c10a0 2023-09-28T04:23:27.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.381+0000 7fef0b9ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef040c3420 con 0x7fef04151830 2023-09-28T04:23:27.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.381+0000 7fef0b9ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef040c3700 con 0x7fef04155930 2023-09-28T04:23:27.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.380+0000 7f60589ff700 1 -- 172.21.15.118:0/675647865 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60541546c0 con 0x7f605416cb80 2023-09-28T04:23:27.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.383+0000 7f60427fc700 1 -- 172.21.15.118:0/675647865 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f604800ecc0 con 0x7f605416cb80 2023-09-28T04:23:27.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.382+0000 7fdf211ff700 1 -- start start 2023-09-28T04:23:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.382+0000 7fef08f9a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef04151830 0x7fef040c0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.382+0000 7fef08f9a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef04151830 0x7fef040c0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42532/0 (socket says 172.21.15.118:42532) 2023-09-28T04:23:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.382+0000 7fef08f9a700 1 -- 172.21.15.118:0/2475580808 learned_addr learned my addr 172.21.15.118:0/2475580808 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.383+0000 7fef0979b700 1 --2- 172.21.15.118:0/2475580808 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef04155930 0x7fef040c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.383+0000 7fef09f9c700 1 --2- 172.21.15.118:0/2475580808 >> v2:172.21.15.118:3300/0 conn(0x7fef040c10a0 0x7fef0406da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.383+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369023835 0 0) 0x7f9b6415a930 con 0x7f9b640c6310 2023-09-28T04:23:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.383+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b4c003570 con 0x7f9b640c6310 2023-09-28T04:23:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.383+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602438480 0 0) 0x7f9b640c3060 con 0x7f9b640c3d80 2023-09-28T04:23:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.383+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b6415a930 con 0x7f9b640c3d80 2023-09-28T04:23:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.383+0000 7f9b6899b700 1 --2- 172.21.15.118:0/4011568764 >> v2:172.21.15.174:3300/0 conn(0x7f9b64153d80 0x7f9b640c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7fef08f9a700 1 -- 172.21.15.118:0/2475580808 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef04155930 msgr2=0x7fef040c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7fef08f9a700 1 --2- 172.21.15.118:0/2475580808 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef04155930 0x7fef040c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7fef08f9a700 1 -- 172.21.15.118:0/2475580808 >> v2:172.21.15.118:3300/0 conn(0x7fef040c10a0 msgr2=0x7fef0406da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:27.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7fef08f9a700 1 --2- 172.21.15.118:0/2475580808 >> v2:172.21.15.118:3300/0 conn(0x7fef040c10a0 0x7fef0406da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7fef08f9a700 1 -- 172.21.15.118:0/2475580808 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef04154e50 con 0x7fef04151830 2023-09-28T04:23:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 805230034 0 0) 0x7f9b6415a930 con 0x7f9b640c3d80 2023-09-28T04:23:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 >> v2:172.21.15.174:3300/0 conn(0x7f9b64153d80 msgr2=0x7f9b640c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f9b637fe700 1 --2- 172.21.15.118:0/4011568764 >> v2:172.21.15.174:3300/0 conn(0x7f9b64153d80 0x7f9b640c5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 >> v1:172.21.15.174:6789/0 conn(0x7f9b640c6310 legacy=0x7f9b640c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6415d0b0 con 0x7f9b640c3d80 2023-09-28T04:23:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 605954562 0 0) 0x7f9b5c001770 con 0x7f9b640c3d80 2023-09-28T04:23:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 >> v1:172.21.15.118:6789/0 conn(0x7f9b640c3d80 legacy=0x7f9b641643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f9b637fe700 1 --2- 172.21.15.118:0/4011568764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b4c004c80 0x7f9b4c005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f9b637fe700 1 --2- 172.21.15.118:0/4011568764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b4c0037b0 0x7f9b4c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f9b637fe700 1 --2- 172.21.15.118:0/4011568764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b4c004160 0x7f9b4c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b58001230 con 0x7f9b4c004160 2023-09-28T04:23:27.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6415dd30 con 0x7f9b4c004c80 2023-09-28T04:23:27.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c00c1b0 con 0x7f9b4c0037b0 2023-09-28T04:23:27.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7fd8d83ff700 1 -- 172.21.15.118:0/333737552 shutdown_connections 2023-09-28T04:23:27.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.384+0000 7f60427fc700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6034067480 0x7f6034069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.385+0000 7f60427fc700 1 -- 172.21.15.118:0/675647865 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f604800d040 con 0x7f605416cb80 2023-09-28T04:23:27.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.385+0000 7f9b6919c700 1 --2- 172.21.15.118:0/4011568764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b4c004160 0x7f9b4c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.385+0000 7fdf211ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf1c068140 0x7fdf1c0c2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.385+0000 7fdf211ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf1c0c3b70 0x7fdf1c0c4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.385+0000 7fdf211ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdf1c0c49d0 0x7fdf1c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.385+0000 7f9b63fff700 1 --2- 172.21.15.118:0/4011568764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b4c0037b0 0x7f9b4c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.385+0000 7fdf211ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c0c4fb0 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.385+0000 7fdf211ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c155be0 con 0x7fdf1c0c3b70 2023-09-28T04:23:27.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.385+0000 7fdf211ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c154fd0 con 0x7fdf1c068140 2023-09-28T04:23:27.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.385+0000 7f605259c700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6034067480 0x7f6034069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.386+0000 7fdf1a59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf1c0c3b70 0x7fdf1c0c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.386+0000 7fdf1a59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf1c0c3b70 0x7fdf1c0c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42544/0 (socket says 172.21.15.118:42544) 2023-09-28T04:23:27.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.386+0000 7fdf1a59c700 1 -- 172.21.15.118:0/1369559717 learned_addr learned my addr 172.21.15.118:0/1369559717 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.386+0000 7fdf1b59e700 1 --2- 172.21.15.118:0/1369559717 >> v2:172.21.15.118:3300/0 conn(0x7fdf1c0c49d0 0x7fdf1c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.386+0000 7f9b63fff700 1 -- 172.21.15.118:0/4011568764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b4c004c80 msgr2=0x7f9b4c005050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-28T04:23:27.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.386+0000 7f9b63fff700 1 --2- 172.21.15.118:0/4011568764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b4c004c80 0x7f9b4c005050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.386+0000 7f9b63fff700 1 -- 172.21.15.118:0/4011568764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b4c004160 msgr2=0x7f9b4c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:27.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.386+0000 7f9b63fff700 1 --2- 172.21.15.118:0/4011568764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b4c004160 0x7f9b4c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.386+0000 7f9b63fff700 1 -- 172.21.15.118:0/4011568764 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6415d0b0 con 0x7f9b4c0037b0 2023-09-28T04:23:27.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.386+0000 7f9b6919c700 1 -- 172.21.15.118:0/4011568764 reap_dead start 2023-09-28T04:23:27.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.386+0000 7fd8d83ff700 1 -- 172.21.15.118:0/333737552 wait complete. 2023-09-28T04:23:27.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.386+0000 7f9b63fff700 1 --2- 172.21.15.118:0/4011568764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b4c0037b0 0x7f9b4c003c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9b58007fd0 tx=0x7f9b58001d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3616682719c6cb0d server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.387+0000 7fdf1a59c700 1 -- 172.21.15.118:0/1369559717 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf1c068140 msgr2=0x7fdf1c0c2710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-28T04:23:27.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.387+0000 7fdf1a59c700 1 --2- 172.21.15.118:0/1369559717 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf1c068140 0x7fdf1c0c2710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.387+0000 7fdf1a59c700 1 -- 172.21.15.118:0/1369559717 >> v2:172.21.15.118:3300/0 conn(0x7fdf1c0c49d0 msgr2=0x7fdf1c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:27.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.387+0000 7fdf1a59c700 1 --2- 172.21.15.118:0/1369559717 >> v2:172.21.15.118:3300/0 conn(0x7fdf1c0c49d0 0x7fdf1c151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.387+0000 7fdf1a59c700 1 -- 172.21.15.118:0/1369559717 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c1552b0 con 0x7fdf1c0c3b70 2023-09-28T04:23:27.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.387+0000 7f605259c700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6034067480 0x7f6034069930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f604c000f80 tx=0x7f604c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.387+0000 7fef08f9a700 1 --2- 172.21.15.118:0/2475580808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef04151830 0x7fef040c0b60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef0406c4d0 tx=0x7feef4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ce3aad45a3a7e36 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.387+0000 7fdf1a59c700 1 --2- 172.21.15.118:0/1369559717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf1c0c3b70 0x7fdf1c0c4490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0685f0 tx=0x7fdf0c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf5a3e799e11a0cd server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.387+0000 7feefbfff700 1 -- 172.21.15.118:0/2475580808 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4009e70 con 0x7fef04151830 2023-09-28T04:23:27.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.387+0000 7feefbfff700 1 -- 172.21.15.118:0/2475580808 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef400b8f0 con 0x7fef04151830 2023-09-28T04:23:27.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.387+0000 7feefbfff700 1 -- 172.21.15.118:0/2475580808 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef400bc70 con 0x7fef04151830 2023-09-28T04:23:27.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.388+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58007a10 con 0x7f9b4c0037b0 2023-09-28T04:23:27.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.388+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5800caf0 con 0x7f9b4c0037b0 2023-09-28T04:23:27.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.388+0000 7f9b637fe700 1 -- 172.21.15.118:0/4011568764 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800ce70 con 0x7f9b4c0037b0 2023-09-28T04:23:27.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.388+0000 7f60427fc700 1 -- 172.21.15.118:0/675647865 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f60541546c0 con 0x7f605416cb80 2023-09-28T04:23:27.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.388+0000 7fdf19d9b700 1 -- 172.21.15.118:0/1369559717 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c00e070 con 0x7fdf1c0c3b70 2023-09-28T04:23:27.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.388+0000 7fdf19d9b700 1 -- 172.21.15.118:0/1369559717 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c00ba20 con 0x7fdf1c0c3b70 2023-09-28T04:23:27.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.388+0000 7fdf19d9b700 1 -- 172.21.15.118:0/1369559717 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0092e0 con 0x7fdf1c0c3b70 2023-09-28T04:23:27.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.388+0000 7fd8d83ff700 1 Processor -- start 2023-09-28T04:23:27.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.389+0000 7f9b6abff700 1 -- 172.21.15.118:0/4011568764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b4c0037b0 msgr2=0x7f9b4c003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.389+0000 7f9b6abff700 1 --2- 172.21.15.118:0/4011568764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b4c0037b0 0x7f9b4c003c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9b58007fd0 tx=0x7f9b58001d20 comp rx=0 tx=0).stop 2023-09-28T04:23:27.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.389+0000 7fef0b9ff700 1 -- 172.21.15.118:0/2475580808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef04151830 msgr2=0x7fef040c0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.389+0000 7fef0b9ff700 1 --2- 172.21.15.118:0/2475580808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef04151830 0x7fef040c0b60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef0406c4d0 tx=0x7feef4009250 comp rx=0 tx=0).stop 2023-09-28T04:23:27.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.389+0000 7fdf211ff700 1 -- 172.21.15.118:0/1369559717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf1c0c3b70 msgr2=0x7fdf1c0c4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.389+0000 7fdf211ff700 1 --2- 172.21.15.118:0/1369559717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf1c0c3b70 0x7fdf1c0c4490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0685f0 tx=0x7fdf0c009840 comp rx=0 tx=0).stop 2023-09-28T04:23:27.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fdf211ff700 1 -- 172.21.15.118:0/1369559717 shutdown_connections 2023-09-28T04:23:27.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fdf211ff700 1 --2- 172.21.15.118:0/1369559717 >> v2:172.21.15.118:3300/0 conn(0x7fdf1c0c49d0 0x7fdf1c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fdf211ff700 1 --2- 172.21.15.118:0/1369559717 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf1c068140 0x7fdf1c0c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fdf211ff700 1 --2- 172.21.15.118:0/1369559717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf1c0c3b70 0x7fdf1c0c4490 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fdf211ff700 1 -- 172.21.15.118:0/1369559717 >> 172.21.15.118:0/1369559717 conn(0x7fdf1c067630 msgr2=0x7fdf1c067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.388+0000 7fd8d83ff700 1 -- start start 2023-09-28T04:23:27.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7f9b6abff700 1 -- 172.21.15.118:0/4011568764 shutdown_connections 2023-09-28T04:23:27.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7f9b6abff700 1 --2- 172.21.15.118:0/4011568764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b4c0037b0 0x7f9b4c003c20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7f9b6abff700 1 -- 172.21.15.118:0/4011568764 >> 172.21.15.118:0/4011568764 conn(0x7f9b64068740 msgr2=0x7f9b64068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fdf211ff700 1 -- 172.21.15.118:0/1369559717 shutdown_connections 2023-09-28T04:23:27.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fd8d83ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8bc003ae0 0x7fd8d014a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fd8d83ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8d015ac50 0x7fd8d00bf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fd8d83ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8d00bf900 0x7fd8d016c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fd8d83ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d014ac70 con 0x7fd8d00bf900 2023-09-28T04:23:27.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fd8d83ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d015c4a0 con 0x7fd8bc003ae0 2023-09-28T04:23:27.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fd8d83ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d015b120 con 0x7fd8d015ac50 2023-09-28T04:23:27.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fd8d599a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8d015ac50 0x7fd8d00bf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fd8d599a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8d015ac50 0x7fd8d00bf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:59298/0 (socket says 172.21.15.118:59298) 2023-09-28T04:23:27.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fd8d599a700 1 -- 172.21.15.118:0/2154264317 learned_addr learned my addr 172.21.15.118:0/2154264317 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.391+0000 7fd8d599a700 1 -- 172.21.15.118:0/2154264317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8bc003ae0 msgr2=0x7fd8d014a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.391+0000 7fd8d599a700 1 --2- 172.21.15.118:0/2154264317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8bc003ae0 0x7fd8d014a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.391+0000 7fd8d599a700 1 -- 172.21.15.118:0/2154264317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8d00bf900 msgr2=0x7fd8d016c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.391+0000 7fd8d599a700 1 --2- 172.21.15.118:0/2154264317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8d00bf900 0x7fd8d016c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.391+0000 7fd8d599a700 1 -- 172.21.15.118:0/2154264317 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d015b400 con 0x7fd8d015ac50 2023-09-28T04:23:27.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.391+0000 7fd8d599a700 1 --2- 172.21.15.118:0/2154264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8d015ac50 0x7fd8d00bf3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800ba80 tx=0x7fd8c8009760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.392+0000 7fd8c67fc700 1 -- 172.21.15.118:0/2154264317 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c800c860 con 0x7fd8d015ac50 2023-09-28T04:23:27.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.392+0000 7fd8c67fc700 1 -- 172.21.15.118:0/2154264317 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c800c9e0 con 0x7fd8d015ac50 2023-09-28T04:23:27.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.392+0000 7fd8c67fc700 1 -- 172.21.15.118:0/2154264317 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c800cda0 con 0x7fd8d015ac50 2023-09-28T04:23:27.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.392+0000 7fd8d83ff700 1 -- 172.21.15.118:0/2154264317 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d015b6e0 con 0x7fd8d015ac50 2023-09-28T04:23:27.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.392+0000 7fd8d83ff700 1 -- 172.21.15.118:0/2154264317 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d015bca0 con 0x7fd8d015ac50 2023-09-28T04:23:27.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.390+0000 7fdf211ff700 1 -- 172.21.15.118:0/1369559717 wait complete. 2023-09-28T04:23:27.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.392+0000 7fdf211ff700 1 Processor -- start 2023-09-28T04:23:27.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.392+0000 7fef0b9ff700 1 -- 172.21.15.118:0/2475580808 shutdown_connections 2023-09-28T04:23:27.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.392+0000 7fef0b9ff700 1 --2- 172.21.15.118:0/2475580808 >> v2:172.21.15.118:3300/0 conn(0x7fef040c10a0 0x7fef0406da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.392+0000 7fef0b9ff700 1 --2- 172.21.15.118:0/2475580808 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef04155930 0x7fef040c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.392+0000 7fef0b9ff700 1 --2- 172.21.15.118:0/2475580808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef04151830 0x7fef040c0b60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.392+0000 7fef0b9ff700 1 -- 172.21.15.118:0/2475580808 >> 172.21.15.118:0/2475580808 conn(0x7fef04067630 msgr2=0x7fef04067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.393+0000 7fef0b9ff700 1 -- 172.21.15.118:0/2475580808 shutdown_connections 2023-09-28T04:23:27.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.393+0000 7fdf211ff700 1 -- start start 2023-09-28T04:23:27.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.393+0000 7fef0b9ff700 1 -- 172.21.15.118:0/2475580808 wait complete. 2023-09-28T04:23:27.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.394+0000 7fdf211ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf1c068140 0x7fdf1c150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.394+0000 7fdf211ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf1c0c3b70 0x7fdf1c1394c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.394+0000 7fdf211ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf1c0c49d0 0x7fdf1c139a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.394+0000 7fdf211ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c13ac00 con 0x7fdf1c0c3b70 2023-09-28T04:23:27.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.394+0000 7fdf211ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c13b1c0 con 0x7fdf1c068140 2023-09-28T04:23:27.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.394+0000 7fdf211ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c1366a0 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.395+0000 7fdf1ad9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf1c068140 0x7fdf1c150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.395+0000 7fdf1ad9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf1c068140 0x7fdf1c150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42560/0 (socket says 172.21.15.118:42560) 2023-09-28T04:23:27.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.395+0000 7fdf1ad9d700 1 -- 172.21.15.118:0/2066539749 learned_addr learned my addr 172.21.15.118:0/2066539749 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.395+0000 7fdf1b59e700 1 --2- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf1c0c49d0 0x7fdf1c139a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.396+0000 7fdf1b59e700 1 -- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf1c068140 msgr2=0x7fdf1c150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.396+0000 7fdf1b59e700 1 --2- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf1c068140 0x7fdf1c150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.396+0000 7fdf1b59e700 1 -- 172.21.15.118:0/2066539749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf1c0c3b70 msgr2=0x7fdf1c1394c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.396+0000 7fdf1b59e700 1 --2- 172.21.15.118:0/2066539749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf1c0c3b70 0x7fdf1c1394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.396+0000 7fdf1b59e700 1 -- 172.21.15.118:0/2066539749 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c009ae0 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.395+0000 7fef0b9ff700 1 Processor -- start 2023-09-28T04:23:27.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.396+0000 7fdf1b59e700 1 --2- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf1c0c49d0 0x7fdf1c139a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400e930 tx=0x7fdf140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.396+0000 7fdf02ffd700 1 -- 172.21.15.118:0/2066539749 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14013680 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.396+0000 7fdf02ffd700 1 -- 172.21.15.118:0/2066539749 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf14013820 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.396+0000 7fdf02ffd700 1 -- 172.21.15.118:0/2066539749 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14013be0 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.397+0000 7fdf211ff700 1 -- 172.21.15.118:0/2066539749 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c136960 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.397+0000 7fdf211ff700 1 -- 172.21.15.118:0/2066539749 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c13ae50 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.397+0000 7fef0b9ff700 1 -- start start 2023-09-28T04:23:27.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.396+0000 7fd8c67fc700 1 -- 172.21.15.118:0/2154264317 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd8c8014620 con 0x7fd8d015ac50 2023-09-28T04:23:27.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.397+0000 7fd8c67fc700 1 --2- 172.21.15.118:0/2154264317 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd8b4067480 0x7fd8b4069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.398+0000 7fd8c67fc700 1 -- 172.21.15.118:0/2154264317 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd8c8084b20 con 0x7fd8d015ac50 2023-09-28T04:23:27.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.399+0000 7fd8d83ff700 1 -- 172.21.15.118:0/2154264317 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d0071980 con 0x7fd8d015ac50 2023-09-28T04:23:27.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.399+0000 7fdf211ff700 1 -- 172.21.15.118:0/2066539749 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c071980 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.399+0000 7fd8d619b700 1 --2- 172.21.15.118:0/2154264317 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd8b4067480 0x7fd8b4069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.398+0000 7fef0b9ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef040c10a0 0x7fef040c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.398+0000 7fef0b9ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef04151830 0x7fef0414c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.398+0000 7fef0b9ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef04155930 0x7fef0416a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.399+0000 7fef0b9ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0416e100 con 0x7fef04151830 2023-09-28T04:23:27.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.399+0000 7fef0b9ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0414d760 con 0x7fef040c10a0 2023-09-28T04:23:27.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.399+0000 7fef0b9ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef040be1d0 con 0x7fef04155930 2023-09-28T04:23:27.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.399+0000 7fef09f9c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef04155930 0x7fef0416a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.399+0000 7fef09f9c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef04155930 0x7fef0416a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:59320/0 (socket says 172.21.15.118:59320) 2023-09-28T04:23:27.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.399+0000 7fef09f9c700 1 -- 172.21.15.118:0/3879660730 learned_addr learned my addr 172.21.15.118:0/3879660730 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.400+0000 7fef08f9a700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef04151830 0x7fef0414c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.400+0000 7f9b6abff700 1 -- 172.21.15.118:0/4011568764 shutdown_connections 2023-09-28T04:23:27.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.400+0000 7fef0979b700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef040c10a0 0x7fef040c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.400+0000 7f9b6abff700 1 -- 172.21.15.118:0/4011568764 wait complete. 2023-09-28T04:23:27.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.400+0000 7fd8d619b700 1 --2- 172.21.15.118:0/2154264317 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd8b4067480 0x7fd8b4069930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000fd0 tx=0x7fd8c0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.401+0000 7fdf02ffd700 1 -- 172.21.15.118:0/2066539749 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdf140123d0 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.400+0000 7fef09f9c700 1 -- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef040c10a0 msgr2=0x7fef040c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.400+0000 7fef09f9c700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef040c10a0 0x7fef040c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.400+0000 7fef09f9c700 1 -- 172.21.15.118:0/3879660730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef04151830 msgr2=0x7fef0414c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.400+0000 7fef09f9c700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef04151830 0x7fef0414c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.400+0000 7fef09f9c700 1 -- 172.21.15.118:0/3879660730 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef40094f0 con 0x7fef04155930 2023-09-28T04:23:27.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.402+0000 7fef09f9c700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef04155930 0x7fef0416a020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feefc007f50 tx=0x7feefc009860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.402+0000 7f9b6abff700 1 Processor -- start 2023-09-28T04:23:27.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.402+0000 7f9b6abff700 1 -- start start 2023-09-28T04:23:27.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.403+0000 7fdf02ffd700 1 --2- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdf08067330 0x7fdf080697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.420 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.403+0000 7fdf02ffd700 1 -- 172.21.15.118:0/2066539749 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf14084af0 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.420 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.403+0000 7fdf1ad9d700 1 --2- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdf08067330 0x7fdf080697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.404+0000 7f9b6abff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b4c0037b0 0x7f9b64154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.404+0000 7f9b6abff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b6416d320 0x7f9b64158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.404+0000 7f9b6abff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b64156730 0x7f9b64152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.404+0000 7f9b6abff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b641578e0 con 0x7f9b4c0037b0 2023-09-28T04:23:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.404+0000 7f9b6abff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6416ce90 con 0x7f9b6416d320 2023-09-28T04:23:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.404+0000 7f9b6abff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64157b30 con 0x7f9b64156730 2023-09-28T04:23:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.404+0000 7f9b63fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b6416d320 0x7f9b64158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.404+0000 7f9b63fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b6416d320 0x7f9b64158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:42584/0 (socket says 172.21.15.118:42584) 2023-09-28T04:23:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.404+0000 7f9b63fff700 1 -- 172.21.15.118:0/2974068648 learned_addr learned my addr 172.21.15.118:0/2974068648 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.404+0000 7f9b6899b700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b4c0037b0 0x7f9b64154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.404+0000 7f9b6919c700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b64156730 0x7f9b64152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.405+0000 7f9b6899b700 1 -- 172.21.15.118:0/2974068648 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b64156730 msgr2=0x7f9b64152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.405+0000 7f9b6899b700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b64156730 0x7f9b64152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.405+0000 7f9b6899b700 1 -- 172.21.15.118:0/2974068648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b6416d320 msgr2=0x7f9b64158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.405+0000 7f9b6899b700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b6416d320 0x7f9b64158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.405+0000 7f9b6899b700 1 -- 172.21.15.118:0/2974068648 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b64157e10 con 0x7f9b4c0037b0 2023-09-28T04:23:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.405+0000 7f9b6899b700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b4c0037b0 0x7f9b64154b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009fd0 tx=0x7f9b540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.406+0000 7f9b60ff9700 1 -- 172.21.15.118:0/2974068648 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54013680 con 0x7f9b4c0037b0 2023-09-28T04:23:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.406+0000 7f9b60ff9700 1 -- 172.21.15.118:0/2974068648 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b54013800 con 0x7f9b4c0037b0 2023-09-28T04:23:27.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.406+0000 7fdf1ad9d700 1 --2- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdf08067330 0x7fdf080697e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009b80 tx=0x7fdf100091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.423 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.406+0000 7f9b6abff700 1 -- 172.21.15.118:0/2974068648 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6416c840 con 0x7f9b4c0037b0 2023-09-28T04:23:27.423 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.406+0000 7f9b6abff700 1 -- 172.21.15.118:0/2974068648 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b64158970 con 0x7f9b4c0037b0 2023-09-28T04:23:27.423 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.406+0000 7fdf02ffd700 1 -- 172.21.15.118:0/2066539749 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdf14051950 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.406+0000 7f9b60ff9700 1 -- 172.21.15.118:0/2974068648 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54013bc0 con 0x7f9b4c0037b0 2023-09-28T04:23:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.410+0000 7f9b60ff9700 1 -- 172.21.15.118:0/2974068648 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9b540123d0 con 0x7f9b4c0037b0 2023-09-28T04:23:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.411+0000 7f9b6abff700 1 -- 172.21.15.118:0/2974068648 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b440052b0 con 0x7f9b4c0037b0 2023-09-28T04:23:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.412+0000 7f9b60ff9700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9b50067480 0x7f9b50069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.413+0000 7f9b60ff9700 1 -- 172.21.15.118:0/2974068648 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9b54084930 con 0x7f9b4c0037b0 2023-09-28T04:23:27.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.411+0000 7fd8c67fc700 1 -- 172.21.15.118:0/2154264317 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd8c804c570 con 0x7fd8d015ac50 2023-09-28T04:23:27.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.416+0000 7f9b63fff700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9b50067480 0x7f9b50069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.416+0000 7feef97fa700 1 -- 172.21.15.118:0/3879660730 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc00ecd0 con 0x7fef04155930 2023-09-28T04:23:27.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.416+0000 7feef97fa700 1 -- 172.21.15.118:0/3879660730 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc00ee50 con 0x7fef04155930 2023-09-28T04:23:27.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.416+0000 7feef97fa700 1 -- 172.21.15.118:0/3879660730 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc014670 con 0x7fef04155930 2023-09-28T04:23:27.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.416+0000 7fef0b9ff700 1 -- 172.21.15.118:0/3879660730 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0416dbd0 con 0x7fef04155930 2023-09-28T04:23:27.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.416+0000 7fef0b9ff700 1 -- 172.21.15.118:0/3879660730 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef040be3c0 con 0x7fef04155930 2023-09-28T04:23:27.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.419+0000 7fef0b9ff700 1 -- 172.21.15.118:0/3879660730 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee40052b0 con 0x7fef04155930 2023-09-28T04:23:27.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.422+0000 7feef97fa700 1 -- 172.21.15.118:0/3879660730 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7feefc0149e0 con 0x7fef04155930 2023-09-28T04:23:27.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.423+0000 7feef97fa700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7feee8067480 0x7feee8069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:27.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.424+0000 7feef97fa700 1 -- 172.21.15.118:0/3879660730 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feefc0852d0 con 0x7fef04155930 2023-09-28T04:23:27.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.422+0000 7f9b60ff9700 1 -- 172.21.15.118:0/2974068648 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9b54051810 con 0x7f9b4c0037b0 2023-09-28T04:23:27.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.425+0000 7fef0979b700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7feee8067480 0x7feee8069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:27.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.428+0000 7feef97fa700 1 -- 172.21.15.118:0/3879660730 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7feefc0521b0 con 0x7fef04155930 2023-09-28T04:23:27.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.442+0000 7fef0979b700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7feee8067480 0x7feee8069930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef000093f0 tx=0x7fef00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.458+0000 7f9b63fff700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9b50067480 0x7f9b50069930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b64157340 tx=0x7f9b58015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:27.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.756+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/2070382866 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7b9c005560 con 0x7f7bb40c5110 2023-09-28T04:23:27.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.758+0000 7f7baa7fc700 1 -- 172.21.15.118:0/2070382866 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7bb0021020 con 0x7f7bb40c5110 2023-09-28T04:23:27.767 INFO:teuthology.orchestra.run.smithi118.stdout:55834574852 2023-09-28T04:23:27.772 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.772+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7b98067450 msgr2=0x7f7b98069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.772 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.772+0000 7f7bbc5ff700 1 --2- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7b98067450 0x7f7b98069900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7bb40bea70 tx=0x7f7bac017000 comp rx=0 tx=0).stop 2023-09-28T04:23:27.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.772+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bb40c5110 msgr2=0x7f7bb4158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.772+0000 7f7bbc5ff700 1 --2- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bb40c5110 0x7f7bb4158a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000ecb0 tx=0x7f7bb00091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.772+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/2070382866 shutdown_connections 2023-09-28T04:23:27.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.772+0000 7f7bbc5ff700 1 --2- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7b98067450 0x7f7b98069900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.772+0000 7f7bbc5ff700 1 --2- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb415b4a0 0x7f7bb4169d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.772+0000 7f7bbc5ff700 1 --2- 172.21.15.118:0/2070382866 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7bb40c5110 0x7f7bb4158a60 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000ecb0 tx=0x7f7bb00091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.772+0000 7f7bbc5ff700 1 --2- 172.21.15.118:0/2070382866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb4153da0 0x7f7bb4158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.774 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.772+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/2070382866 >> 172.21.15.118:0/2070382866 conn(0x7f7bb4067630 msgr2=0x7f7bb4067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.774 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.773+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/2070382866 shutdown_connections 2023-09-28T04:23:27.774 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.773+0000 7f7bbc5ff700 1 -- 172.21.15.118:0/2070382866 wait complete. 2023-09-28T04:23:27.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.787+0000 7f9fb37ff700 1 -- 172.21.15.118:0/3952173955 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9f8c005560 con 0x7f9fac06e9f0 2023-09-28T04:23:27.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.787+0000 7f9fa17fa700 1 -- 172.21.15.118:0/3952173955 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9fa8006ad0 con 0x7f9fac06e9f0 2023-09-28T04:23:27.790 INFO:teuthology.orchestra.run.smithi118.stdout:55834574852 2023-09-28T04:23:27.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.790+0000 7f0c71fff700 1 -- 172.21.15.118:0/999437767 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0c50005830 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.790+0000 7f0c63fff700 1 -- 172.21.15.118:0/999437767 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0c64055620 con 0x7f0c6c06e9f0 2023-09-28T04:23:27.792 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2023-09-28T04:23:27.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.792+0000 7f9fb37ff700 1 -- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9f90067480 msgr2=0x7f9f90069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.792+0000 7f9fb37ff700 1 --2- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9f90067480 0x7f9f90069930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0c8a20 tx=0x7f9f9c009040 comp rx=0 tx=0).stop 2023-09-28T04:23:27.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.792+0000 7f9fb37ff700 1 -- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fac06e9f0 msgr2=0x7f9fac164390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.792+0000 7f9fb37ff700 1 --2- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fac06e9f0 0x7f9fac164390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80089e0 tx=0x7f9fa801a000 comp rx=0 tx=0).stop 2023-09-28T04:23:27.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.793+0000 7f9fb37ff700 1 -- 172.21.15.118:0/3952173955 shutdown_connections 2023-09-28T04:23:27.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.793+0000 7f9fb37ff700 1 --2- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9f90067480 0x7f9f90069930 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.793+0000 7f9fb37ff700 1 --2- 172.21.15.118:0/3952173955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fac0c5a50 0x7f9fac156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.793+0000 7f9fb37ff700 1 --2- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fac06e9f0 0x7f9fac164390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.793+0000 7f9fb37ff700 1 --2- 172.21.15.118:0/3952173955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fac0c18c0 0x7f9fac1648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.793+0000 7f9fb37ff700 1 -- 172.21.15.118:0/3952173955 >> 172.21.15.118:0/3952173955 conn(0x7f9fac067630 msgr2=0x7f9fac0c2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.795+0000 7f0c71fff700 1 -- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f0c4c067480 msgr2=0x7f0c4c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.796 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.795+0000 7f0c71fff700 1 --2- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f0c4c067480 0x7f0c4c069930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400bbc0 tx=0x7f0c5401a000 comp rx=0 tx=0).stop 2023-09-28T04:23:27.796 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.795+0000 7f0c71fff700 1 -- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06e9f0 msgr2=0x7f0c6c0c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.796 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.795+0000 7f0c71fff700 1 --2- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06e9f0 0x7f0c6c0c78b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400cd60 tx=0x7f0c64001b60 comp rx=0 tx=0).stop 2023-09-28T04:23:27.796 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.795+0000 7f0c71fff700 1 -- 172.21.15.118:0/999437767 shutdown_connections 2023-09-28T04:23:27.796 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.795+0000 7f0c71fff700 1 --2- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f0c4c067480 0x7f0c4c069930 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400bbc0 tx=0x7f0c5401a000 comp rx=0 tx=0).stop 2023-09-28T04:23:27.796 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.795+0000 7f0c71fff700 1 --2- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c6c06e9f0 0x7f0c6c0c78b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.796 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.795+0000 7f0c71fff700 1 --2- 172.21.15.118:0/999437767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c6c06b490 0x7f0c6c0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.796 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.795+0000 7f0c71fff700 1 --2- 172.21.15.118:0/999437767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c6c06bf70 0x7f0c6c0b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.796 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.795+0000 7f0c71fff700 1 -- 172.21.15.118:0/999437767 >> 172.21.15.118:0/999437767 conn(0x7f0c6c067630 msgr2=0x7f0c6c0c2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.795+0000 7f0c71fff700 1 -- 172.21.15.118:0/999437767 shutdown_connections 2023-09-28T04:23:27.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.796+0000 7f0c71fff700 1 -- 172.21.15.118:0/999437767 wait complete. 2023-09-28T04:23:27.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-09-28T04:23:27.804 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.803+0000 7f9fb37ff700 1 -- 172.21.15.118:0/3952173955 shutdown_connections 2023-09-28T04:23:27.804 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.803+0000 7f9fb37ff700 1 -- 172.21.15.118:0/3952173955 wait complete. 2023-09-28T04:23:27.825 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2023-09-28T04:23:27.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.821+0000 7f9b6abff700 1 -- 172.21.15.118:0/2974068648 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9b44005560 con 0x7f9b4c0037b0 2023-09-28T04:23:27.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.822+0000 7f9b60ff9700 1 -- 172.21.15.118:0/2974068648 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b54020030 con 0x7f9b4c0037b0 2023-09-28T04:23:27.826 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2023-09-28T04:23:27.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.823+0000 7f60589ff700 1 -- 172.21.15.118:0/675647865 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f60541546c0 con 0x7f605416cb80 2023-09-28T04:23:27.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.824+0000 7f60427fc700 1 -- 172.21.15.118:0/675647865 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f60541546c0 con 0x7f605416cb80 2023-09-28T04:23:27.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.825+0000 7f9b6abff700 1 -- 172.21.15.118:0/2974068648 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9b50067480 msgr2=0x7f9b50069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.825+0000 7f9b6abff700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9b50067480 0x7f9b50069930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b64157340 tx=0x7f9b58015000 comp rx=0 tx=0).stop 2023-09-28T04:23:27.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.825+0000 7f9b6abff700 1 -- 172.21.15.118:0/2974068648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b4c0037b0 msgr2=0x7f9b64154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.825+0000 7f9b6abff700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b4c0037b0 0x7f9b64154b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009fd0 tx=0x7f9b540091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-09-28T04:23:27.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.825+0000 7f9b6abff700 1 -- 172.21.15.118:0/2974068648 shutdown_connections 2023-09-28T04:23:27.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.825+0000 7f9b6abff700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9b50067480 0x7f9b50069930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.825+0000 7f9b6abff700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b64156730 0x7f9b64152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.825+0000 7f9b6abff700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b4c0037b0 0x7f9b64154b10 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009fd0 tx=0x7f9b540091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.825+0000 7f9b6abff700 1 --2- 172.21.15.118:0/2974068648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b6416d320 0x7f9b64158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.825+0000 7f9b6abff700 1 -- 172.21.15.118:0/2974068648 >> 172.21.15.118:0/2974068648 conn(0x7f9b64068740 msgr2=0x7f9b640c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.826+0000 7f9b6abff700 1 -- 172.21.15.118:0/2974068648 shutdown_connections 2023-09-28T04:23:27.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.826+0000 7f9b6abff700 1 -- 172.21.15.118:0/2974068648 wait complete. 2023-09-28T04:23:27.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.827+0000 7f60589ff700 1 -- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6034067480 msgr2=0x7f6034069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.827+0000 7f60589ff700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6034067480 0x7f6034069930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f604c000f80 tx=0x7f604c016000 comp rx=0 tx=0).stop 2023-09-28T04:23:27.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.827+0000 7f60589ff700 1 -- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f605416cb80 msgr2=0x7f6054150bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.827+0000 7f60589ff700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f605416cb80 0x7f6054150bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f604800c610 tx=0x7f6048000dd0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.829+0000 7f60589ff700 1 -- 172.21.15.118:0/675647865 shutdown_connections 2023-09-28T04:23:27.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.829+0000 7f60589ff700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6034067480 0x7f6034069930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.829+0000 7f60589ff700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f605416cb80 0x7f6054150bb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.829+0000 7f60589ff700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f603c004d30 0x7f60540c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.829+0000 7f60589ff700 1 --2- 172.21.15.118:0/675647865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6054155260 0x7f60540c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.829+0000 7f60589ff700 1 -- 172.21.15.118:0/675647865 >> 172.21.15.118:0/675647865 conn(0x7f6054067630 msgr2=0x7f60540bf980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.829+0000 7f60589ff700 1 -- 172.21.15.118:0/675647865 shutdown_connections 2023-09-28T04:23:27.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.829+0000 7f60589ff700 1 -- 172.21.15.118:0/675647865 wait complete. 2023-09-28T04:23:27.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-09-28T04:23:27.837 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.837+0000 7fd8d83ff700 1 -- 172.21.15.118:0/2154264317 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd8d00c3c90 con 0x7fd8d015ac50 2023-09-28T04:23:27.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.837+0000 7fd8c67fc700 1 -- 172.21.15.118:0/2154264317 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8c8051a00 con 0x7fd8d015ac50 2023-09-28T04:23:27.838 INFO:teuthology.orchestra.run.smithi118.stdout:55834574852 2023-09-28T04:23:27.842 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.841+0000 7fd8d83ff700 1 -- 172.21.15.118:0/2154264317 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd8b4067480 msgr2=0x7fd8b4069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.842 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.841+0000 7fd8d83ff700 1 --2- 172.21.15.118:0/2154264317 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd8b4067480 0x7fd8b4069930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000fd0 tx=0x7fd8c0017000 comp rx=0 tx=0).stop 2023-09-28T04:23:27.842 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.841+0000 7fd8d83ff700 1 -- 172.21.15.118:0/2154264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8d015ac50 msgr2=0x7fd8d00bf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.842 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.841+0000 7fd8d83ff700 1 --2- 172.21.15.118:0/2154264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8d015ac50 0x7fd8d00bf3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800ba80 tx=0x7fd8c8009760 comp rx=0 tx=0).stop 2023-09-28T04:23:27.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.841+0000 7fd8d83ff700 1 -- 172.21.15.118:0/2154264317 shutdown_connections 2023-09-28T04:23:27.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.841+0000 7fd8d83ff700 1 --2- 172.21.15.118:0/2154264317 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd8b4067480 0x7fd8b4069930 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.841+0000 7fd8d83ff700 1 --2- 172.21.15.118:0/2154264317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8d00bf900 0x7fd8d016c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.841+0000 7fd8d83ff700 1 --2- 172.21.15.118:0/2154264317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8bc003ae0 0x7fd8d014a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.841+0000 7fd8d83ff700 1 --2- 172.21.15.118:0/2154264317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd8d015ac50 0x7fd8d00bf3c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.842+0000 7fd8d83ff700 1 -- 172.21.15.118:0/2154264317 >> 172.21.15.118:0/2154264317 conn(0x7fd8d0067630 msgr2=0x7fd8d0070720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.842+0000 7fd8d83ff700 1 -- 172.21.15.118:0/2154264317 shutdown_connections 2023-09-28T04:23:27.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.842+0000 7fd8d83ff700 1 -- 172.21.15.118:0/2154264317 wait complete. 2023-09-28T04:23:27.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-09-28T04:23:27.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.846+0000 7fdf211ff700 1 -- 172.21.15.118:0/2066539749 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fdf1c13b300 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.847+0000 7fdf02ffd700 1 -- 172.21.15.118:0/2066539749 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf14017090 con 0x7fdf1c0c49d0 2023-09-28T04:23:27.848 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2023-09-28T04:23:27.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.850+0000 7fdf211ff700 1 -- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdf08067330 msgr2=0x7fdf080697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.850+0000 7fdf211ff700 1 --2- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdf08067330 0x7fdf080697e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009b80 tx=0x7fdf100091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.850+0000 7fdf211ff700 1 -- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf1c0c49d0 msgr2=0x7fdf1c139a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.850+0000 7fdf211ff700 1 --2- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf1c0c49d0 0x7fdf1c139a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400e930 tx=0x7fdf140091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.850+0000 7fdf211ff700 1 -- 172.21.15.118:0/2066539749 shutdown_connections 2023-09-28T04:23:27.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.850+0000 7fdf211ff700 1 --2- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdf08067330 0x7fdf080697e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.850+0000 7fdf211ff700 1 --2- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf1c0c49d0 0x7fdf1c139a00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.850+0000 7fdf211ff700 1 --2- 172.21.15.118:0/2066539749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf1c068140 0x7fdf1c150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.850+0000 7fdf211ff700 1 --2- 172.21.15.118:0/2066539749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf1c0c3b70 0x7fdf1c1394c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.850+0000 7fdf211ff700 1 -- 172.21.15.118:0/2066539749 >> 172.21.15.118:0/2066539749 conn(0x7fdf1c067630 msgr2=0x7fdf1c06eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.850+0000 7fdf211ff700 1 -- 172.21.15.118:0/2066539749 shutdown_connections 2023-09-28T04:23:27.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.850+0000 7fdf211ff700 1 -- 172.21.15.118:0/2066539749 wait complete. 2023-09-28T04:23:27.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-09-28T04:23:27.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-09-28T04:23:27.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.865+0000 7fef0b9ff700 1 -- 172.21.15.118:0/3879660730 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7feee4005560 con 0x7fef04155930 2023-09-28T04:23:27.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.866+0000 7feef97fa700 1 -- 172.21.15.118:0/3879660730 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feefc0099a0 con 0x7fef04155930 2023-09-28T04:23:27.867 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2023-09-28T04:23:27.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.869+0000 7fef0b9ff700 1 -- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7feee8067480 msgr2=0x7feee8069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.869+0000 7fef0b9ff700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7feee8067480 0x7feee8069930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef000093f0 tx=0x7fef00008040 comp rx=0 tx=0).stop 2023-09-28T04:23:27.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.869+0000 7fef0b9ff700 1 -- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef04155930 msgr2=0x7fef0416a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:27.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.869+0000 7fef0b9ff700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef04155930 0x7fef0416a020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feefc007f50 tx=0x7feefc009860 comp rx=0 tx=0).stop 2023-09-28T04:23:27.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.869+0000 7fef0b9ff700 1 -- 172.21.15.118:0/3879660730 shutdown_connections 2023-09-28T04:23:27.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.869+0000 7fef0b9ff700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7feee8067480 0x7feee8069930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.869+0000 7fef0b9ff700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef04155930 0x7fef0416a020 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.869+0000 7fef0b9ff700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef040c10a0 0x7fef040c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.869+0000 7fef0b9ff700 1 --2- 172.21.15.118:0/3879660730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef04151830 0x7fef0414c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:27.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.869+0000 7fef0b9ff700 1 -- 172.21.15.118:0/3879660730 >> 172.21.15.118:0/3879660730 conn(0x7fef04067630 msgr2=0x7fef0406e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:27.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.869+0000 7fef0b9ff700 1 -- 172.21.15.118:0/3879660730 shutdown_connections 2023-09-28T04:23:27.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:27.869+0000 7fef0b9ff700 1 -- 172.21.15.118:0/3879660730 wait complete. 2023-09-28T04:23:27.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-09-28T04:23:27.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-09-28T04:23:28.804 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-28T04:23:28.829 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-28T04:23:28.833 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-28T04:23:28.848 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-28T04:23:28.855 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-28T04:23:28.863 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-28T04:23:28.876 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-28T04:23:28.882 INFO:tasks.ceph.mds.a.smithi118.stderr:2023-09-28T04:23:28.882+0000 7f18cb3f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-28T04:23:28.883 INFO:tasks.ceph.mds.a.smithi118.stderr:2023-09-28T04:23:28.882+0000 7f18cb3f1700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-09-28T04:23:28.887 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-28T04:23:29.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.103+0000 7f64f79ff700 1 Processor -- start 2023-09-28T04:23:29.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.103+0000 7f64f79ff700 1 -- start start 2023-09-28T04:23:29.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.105+0000 7f64f79ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64f006e5a0 0x7f64f01653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.105+0000 7f64f79ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f006bf60 con 0x7f64f00c5110 2023-09-28T04:23:29.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.105+0000 7f64f79ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f015a510 con 0x7f64f0153d10 2023-09-28T04:23:29.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.105+0000 7f64f79ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f006f700 con 0x7f64f006e5a0 2023-09-28T04:23:29.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.106+0000 7f64f579b700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f64f0153d10 0x7f64f015af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:50618/0 (socket says 172.21.15.118:50618) 2023-09-28T04:23:29.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.106+0000 7f64f579b700 1 -- 172.21.15.118:0/3904958150 learned_addr learned my addr 172.21.15.118:0/3904958150 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:29.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.106+0000 7f64f5f9c700 1 --2- 172.21.15.118:0/3904958150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64f006e5a0 0x7f64f01653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.107+0000 7f64f5f9c700 1 -- 172.21.15.118:0/3904958150 >> v1:172.21.15.174:6789/0 conn(0x7f64f0153d10 legacy=0x7f64f015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.107+0000 7f64e7fff700 1 -- 172.21.15.118:0/3904958150 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979033344 0 0) 0x7f64f015a510 con 0x7f64f0153d10 2023-09-28T04:23:29.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.107+0000 7f64f5f9c700 1 -- 172.21.15.118:0/3904958150 >> v1:172.21.15.118:6789/0 conn(0x7f64f00c5110 legacy=0x7f64f006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:29.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.107+0000 7f64f5f9c700 1 -- 172.21.15.118:0/3904958150 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f015a790 con 0x7f64f006e5a0 2023-09-28T04:23:29.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.108+0000 7f64f5f9c700 1 --2- 172.21.15.118:0/3904958150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64f006e5a0 0x7f64f01653d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009910 tx=0x7f64e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a42b5808a296818b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.109+0000 7f64e7fff700 1 -- 172.21.15.118:0/3904958150 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e000b820 con 0x7f64f006e5a0 2023-09-28T04:23:29.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.109+0000 7f64e7fff700 1 -- 172.21.15.118:0/3904958150 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e000b980 con 0x7f64f006e5a0 2023-09-28T04:23:29.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.109+0000 7f64e7fff700 1 -- 172.21.15.118:0/3904958150 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e000bd20 con 0x7f64f006e5a0 2023-09-28T04:23:29.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.110+0000 7f64f79ff700 1 -- 172.21.15.118:0/3904958150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64f006e5a0 msgr2=0x7f64f01653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.110+0000 7f64f79ff700 1 --2- 172.21.15.118:0/3904958150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64f006e5a0 0x7f64f01653d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009910 tx=0x7f64e00091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.110+0000 7f64f79ff700 1 -- 172.21.15.118:0/3904958150 shutdown_connections 2023-09-28T04:23:29.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.110+0000 7f64f79ff700 1 --2- 172.21.15.118:0/3904958150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64f006e5a0 0x7f64f01653d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.110+0000 7f64f79ff700 1 -- 172.21.15.118:0/3904958150 >> 172.21.15.118:0/3904958150 conn(0x7f64f0067630 msgr2=0x7f64f0067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.111+0000 7f64f79ff700 1 -- 172.21.15.118:0/3904958150 shutdown_connections 2023-09-28T04:23:29.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.111+0000 7f64f79ff700 1 -- 172.21.15.118:0/3904958150 wait complete. 2023-09-28T04:23:29.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.113+0000 7f64f79ff700 1 Processor -- start 2023-09-28T04:23:29.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.113+0000 7f64f79ff700 1 -- start start 2023-09-28T04:23:29.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.115+0000 7f64f79ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f006e5a0 0x7f64f01446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.115+0000 7f64f79ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64f00c5110 0x7f64f0183d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.115+0000 7f64f79ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64f0153d10 0x7f64f00bd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.115+0000 7f64f79ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f01842b0 con 0x7f64f006e5a0 2023-09-28T04:23:29.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.115+0000 7f64f79ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0144d50 con 0x7f64f0153d10 2023-09-28T04:23:29.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.115+0000 7f64f79ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f00bce30 con 0x7f64f00c5110 2023-09-28T04:23:29.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.116+0000 7f64f4f9a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64f00c5110 0x7f64f0183d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.117+0000 7f64f4f9a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64f00c5110 0x7f64f0183d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:55802/0 (socket says 172.21.15.118:55802) 2023-09-28T04:23:29.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.117+0000 7f64f4f9a700 1 -- 172.21.15.118:0/1765349516 learned_addr learned my addr 172.21.15.118:0/1765349516 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:29.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.117+0000 7f64f579b700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f006e5a0 0x7f64f01446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.117+0000 7f64f4f9a700 1 -- 172.21.15.118:0/1765349516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64f0153d10 msgr2=0x7f64f00bd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.117+0000 7f64f4f9a700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64f0153d10 0x7f64f00bd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.117+0000 7f64f4f9a700 1 -- 172.21.15.118:0/1765349516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f006e5a0 msgr2=0x7f64f01446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.117+0000 7f64f4f9a700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f006e5a0 0x7f64f01446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.117+0000 7f64f4f9a700 1 -- 172.21.15.118:0/1765349516 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e0009420 con 0x7f64f00c5110 2023-09-28T04:23:29.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.118+0000 7f64f4f9a700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64f00c5110 0x7f64f0183d70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f64e800bbe0 tx=0x7f64e8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.120+0000 7f64e57fa700 1 -- 172.21.15.118:0/1765349516 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e80092e0 con 0x7f64f00c5110 2023-09-28T04:23:29.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.120+0000 7f64e57fa700 1 -- 172.21.15.118:0/1765349516 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e800c7a0 con 0x7f64f00c5110 2023-09-28T04:23:29.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.120+0000 7f64e57fa700 1 -- 172.21.15.118:0/1765349516 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e800cb60 con 0x7f64f00c5110 2023-09-28T04:23:29.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.120+0000 7f64f79ff700 1 -- 172.21.15.118:0/1765349516 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f00bc220 con 0x7f64f00c5110 2023-09-28T04:23:29.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.120+0000 7f64f79ff700 1 -- 172.21.15.118:0/1765349516 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f00bc7e0 con 0x7f64f00c5110 2023-09-28T04:23:29.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.122+0000 7f64f579b700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f006e5a0 0x7f64f01446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:29.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.124+0000 7f64e57fa700 1 -- 172.21.15.118:0/1765349516 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f64e8012070 con 0x7f64f00c5110 2023-09-28T04:23:29.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.126+0000 7f64e57fa700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f64d4067480 0x7f64d4069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.126+0000 7f64e57fa700 1 -- 172.21.15.118:0/1765349516 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f64e8084910 con 0x7f64f00c5110 2023-09-28T04:23:29.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.127+0000 7f64f579b700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f64d4067480 0x7f64d4069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.128+0000 7f64f79ff700 1 -- 172.21.15.118:0/1765349516 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d00052b0 con 0x7f64f00c5110 2023-09-28T04:23:29.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.129+0000 7f64f579b700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f64d4067480 0x7f64d4069930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f64ec000c00 tx=0x7f64ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.133+0000 7f64e57fa700 1 -- 172.21.15.118:0/1765349516 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f64e8051830 con 0x7f64f00c5110 2023-09-28T04:23:29.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.177+0000 7f553ffff700 1 Processor -- start 2023-09-28T04:23:29.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.177+0000 7f553ffff700 1 -- start start 2023-09-28T04:23:29.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.179+0000 7f553ffff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5538153dd0 0x7f553815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.180+0000 7f553ffff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55380c82a0 con 0x7f55380adcc0 2023-09-28T04:23:29.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.180+0000 7f553ffff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5538089ad0 con 0x7f55380cc870 2023-09-28T04:23:29.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.180+0000 7f553ffff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553815ac00 con 0x7f5538153dd0 2023-09-28T04:23:29.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.180+0000 7f553e59c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f55380adcc0 0x7f55381645e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47780/0 (socket says 172.21.15.118:47780) 2023-09-28T04:23:29.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.180+0000 7f553e59c700 1 -- 172.21.15.118:0/1762859965 learned_addr learned my addr 172.21.15.118:0/1762859965 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:29.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.180+0000 7f553dd9b700 1 --2- 172.21.15.118:0/1762859965 >> v2:172.21.15.174:3300/0 conn(0x7f5538153dd0 0x7f553815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104915714 0 0) 0x7f55380c82a0 con 0x7f55380adcc0 2023-09-28T04:23:29.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5524003570 con 0x7f55380adcc0 2023-09-28T04:23:29.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014798676 0 0) 0x7f5538089ad0 con 0x7f55380cc870 2023-09-28T04:23:29.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55380c82a0 con 0x7f55380cc870 2023-09-28T04:23:29.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 408588928 0 0) 0x7f5524003570 con 0x7f55380adcc0 2023-09-28T04:23:29.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 >> v2:172.21.15.174:3300/0 conn(0x7f5538153dd0 msgr2=0x7f553815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:29.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 --2- 172.21.15.118:0/1762859965 >> v2:172.21.15.174:3300/0 conn(0x7f5538153dd0 0x7f553815a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 >> v1:172.21.15.174:6789/0 conn(0x7f55380cc870 legacy=0x7f5538068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55380692a0 con 0x7f55380adcc0 2023-09-28T04:23:29.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 605954562 0 0) 0x7f5530001470 con 0x7f55380adcc0 2023-09-28T04:23:29.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 >> v1:172.21.15.118:6789/0 conn(0x7f55380adcc0 legacy=0x7f55381645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 --2- 172.21.15.118:0/1762859965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5524004cd0 0x7f55240050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 --2- 172.21.15.118:0/1762859965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55240037b0 0x7f5524003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 --2- 172.21.15.118:0/1762859965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5524004230 0x7f552400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553815ac00 con 0x7f5524004230 2023-09-28T04:23:29.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552400c1b0 con 0x7f55240037b0 2023-09-28T04:23:29.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.182+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552400c370 con 0x7f5524004cd0 2023-09-28T04:23:29.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.183+0000 7f553e59c700 1 --2- 172.21.15.118:0/1762859965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5524004230 0x7f552400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.183+0000 7f553d59a700 1 --2- 172.21.15.118:0/1762859965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55240037b0 0x7f5524003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.184+0000 7f553e59c700 1 -- 172.21.15.118:0/1762859965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5524004cd0 msgr2=0x7f55240050a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T04:23:29.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.184+0000 7f553e59c700 1 --2- 172.21.15.118:0/1762859965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5524004cd0 0x7f55240050a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.184+0000 7f553e59c700 1 -- 172.21.15.118:0/1762859965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55240037b0 msgr2=0x7f5524003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:29.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.184+0000 7f553e59c700 1 --2- 172.21.15.118:0/1762859965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55240037b0 0x7f5524003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.184+0000 7f553e59c700 1 -- 172.21.15.118:0/1762859965 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55380692a0 con 0x7f5524004230 2023-09-28T04:23:29.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.184+0000 7f553e59c700 1 -- 172.21.15.118:0/1762859965 reap_dead start 2023-09-28T04:23:29.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.184+0000 7f553e59c700 1 --2- 172.21.15.118:0/1762859965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5524004230 0x7f552400ba60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f553000c3e0 tx=0x7f5530001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431129202b028ea4 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.184+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553000cc30 con 0x7f5524004230 2023-09-28T04:23:29.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.184+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553000cdd0 con 0x7f5524004230 2023-09-28T04:23:29.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.184+0000 7f553cd99700 1 -- 172.21.15.118:0/1762859965 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530005b70 con 0x7f5524004230 2023-09-28T04:23:29.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.185+0000 7f553ffff700 1 -- 172.21.15.118:0/1762859965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5524004230 msgr2=0x7f552400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.185+0000 7f553ffff700 1 --2- 172.21.15.118:0/1762859965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5524004230 0x7f552400ba60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f553000c3e0 tx=0x7f5530001e60 comp rx=0 tx=0).stop 2023-09-28T04:23:29.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.186+0000 7f553ffff700 1 -- 172.21.15.118:0/1762859965 shutdown_connections 2023-09-28T04:23:29.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.186+0000 7f553ffff700 1 --2- 172.21.15.118:0/1762859965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5524004230 0x7f552400ba60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.186+0000 7f553ffff700 1 -- 172.21.15.118:0/1762859965 >> 172.21.15.118:0/1762859965 conn(0x7f5538063cc0 msgr2=0x7f55380cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.186+0000 7f42169ff700 1 Processor -- start 2023-09-28T04:23:29.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.186+0000 7f42169ff700 1 -- start start 2023-09-28T04:23:29.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.186+0000 7f553ffff700 1 -- 172.21.15.118:0/1762859965 shutdown_connections 2023-09-28T04:23:29.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.187+0000 7f553ffff700 1 -- 172.21.15.118:0/1762859965 wait complete. 2023-09-28T04:23:29.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.189+0000 7f553ffff700 1 Processor -- start 2023-09-28T04:23:29.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.188+0000 7f42169ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4210068140 0x7f42100c4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.188+0000 7f42169ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42100c3b70 0x7f42100c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.188+0000 7f42169ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f42100c2a00 0x7f4210151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.188+0000 7f42169ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42100c4fb0 con 0x7f4210068140 2023-09-28T04:23:29.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.188+0000 7f42169ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4210155be0 con 0x7f42100c2a00 2023-09-28T04:23:29.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.188+0000 7f42169ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4210154fd0 con 0x7f42100c3b70 2023-09-28T04:23:29.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.191+0000 7f420ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4210068140 0x7f42100c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.191+0000 7f420f7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42100c3b70 0x7f42100c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.191+0000 7f420ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4210068140 0x7f42100c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50942/0 (socket says 172.21.15.118:50942) 2023-09-28T04:23:29.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.191+0000 7f420ffff700 1 -- 172.21.15.118:0/630602158 learned_addr learned my addr 172.21.15.118:0/630602158 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:29.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.192+0000 7f420ffff700 1 -- 172.21.15.118:0/630602158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42100c3b70 msgr2=0x7f42100c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:29.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.192+0000 7f420ffff700 1 --2- 172.21.15.118:0/630602158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42100c3b70 0x7f42100c24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.192+0000 7f420ffff700 1 -- 172.21.15.118:0/630602158 >> v2:172.21.15.174:3300/0 conn(0x7f42100c2a00 msgr2=0x7f4210151b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-28T04:23:29.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.192+0000 7f420ffff700 1 --2- 172.21.15.118:0/630602158 >> v2:172.21.15.174:3300/0 conn(0x7f42100c2a00 0x7f4210151b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.192+0000 7f420ffff700 1 -- 172.21.15.118:0/630602158 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42101552b0 con 0x7f4210068140 2023-09-28T04:23:29.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.189+0000 7febf19ff700 1 Processor -- start 2023-09-28T04:23:29.195 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.189+0000 7febf19ff700 1 -- start start 2023-09-28T04:23:29.195 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.191+0000 7febf19ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7febec153d10 0x7febec15af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.195 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.191+0000 7febf19ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec06ecb0 con 0x7febec0c5110 2023-09-28T04:23:29.195 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.191+0000 7febf19ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec06bf60 con 0x7febec15b4a0 2023-09-28T04:23:29.195 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.191+0000 7febf19ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec06f700 con 0x7febec153d10 2023-09-28T04:23:29.195 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.192+0000 7febeb7fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7febec15b4a0 0x7febec06e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:50648/0 (socket says 172.21.15.118:50648) 2023-09-28T04:23:29.195 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.192+0000 7febeb7fe700 1 -- 172.21.15.118:0/3060306025 learned_addr learned my addr 172.21.15.118:0/3060306025 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:29.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.189+0000 7f553ffff700 1 -- start start 2023-09-28T04:23:29.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.191+0000 7f553ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5524004230 0x7f5538156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.191+0000 7f553ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f553816a720 0x7f55380b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.193+0000 7f553ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55380b07d0 0x7f55380b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.193+0000 7f553ffff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55380c3340 con 0x7f5524004230 2023-09-28T04:23:29.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.193+0000 7f553ffff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553816ac20 con 0x7f553816a720 2023-09-28T04:23:29.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.193+0000 7f553ffff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55380af840 con 0x7f55380b07d0 2023-09-28T04:23:29.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.193+0000 7f420ffff700 1 --2- 172.21.15.118:0/630602158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4210068140 0x7f42100c4490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f42100c5610 tx=0x7f4200009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6c6f5c1456e1e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.193+0000 7f553dd9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5524004230 0x7f5538156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.194+0000 7f553dd9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5524004230 0x7f5538156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50958/0 (socket says 172.21.15.118:50958) 2023-09-28T04:23:29.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.194+0000 7f553dd9b700 1 -- 172.21.15.118:0/2850439559 learned_addr learned my addr 172.21.15.118:0/2850439559 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:29.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.194+0000 7f553e59c700 1 --2- 172.21.15.118:0/2850439559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55380b07d0 0x7f55380b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.194+0000 7f420effd700 1 -- 172.21.15.118:0/630602158 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420000b860 con 0x7f4210068140 2023-09-28T04:23:29.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.194+0000 7f420effd700 1 -- 172.21.15.118:0/630602158 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420000b9c0 con 0x7f4210068140 2023-09-28T04:23:29.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.194+0000 7f420effd700 1 -- 172.21.15.118:0/630602158 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420000bd60 con 0x7f4210068140 2023-09-28T04:23:29.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.195+0000 7f553dd9b700 1 -- 172.21.15.118:0/2850439559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55380b07d0 msgr2=0x7f55380b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.195+0000 7f553dd9b700 1 --2- 172.21.15.118:0/2850439559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55380b07d0 0x7f55380b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.195+0000 7f553dd9b700 1 -- 172.21.15.118:0/2850439559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f553816a720 msgr2=0x7f55380b0290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-28T04:23:29.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.195+0000 7f553dd9b700 1 --2- 172.21.15.118:0/2850439559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f553816a720 0x7f55380b0290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.195+0000 7f553dd9b700 1 -- 172.21.15.118:0/2850439559 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55380afe00 con 0x7f5524004230 2023-09-28T04:23:29.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.195+0000 7f42169ff700 1 -- 172.21.15.118:0/630602158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4210068140 msgr2=0x7f42100c4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.195+0000 7f42169ff700 1 --2- 172.21.15.118:0/630602158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4210068140 0x7f42100c4490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f42100c5610 tx=0x7f4200009250 comp rx=0 tx=0).stop 2023-09-28T04:23:29.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.195+0000 7f42169ff700 1 -- 172.21.15.118:0/630602158 shutdown_connections 2023-09-28T04:23:29.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.195+0000 7f42169ff700 1 --2- 172.21.15.118:0/630602158 >> v2:172.21.15.174:3300/0 conn(0x7f42100c2a00 0x7f4210151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.195+0000 7f42169ff700 1 --2- 172.21.15.118:0/630602158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4210068140 0x7f42100c4490 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.195+0000 7f42169ff700 1 --2- 172.21.15.118:0/630602158 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42100c3b70 0x7f42100c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.195+0000 7f42169ff700 1 -- 172.21.15.118:0/630602158 >> 172.21.15.118:0/630602158 conn(0x7f4210067630 msgr2=0x7f4210067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.196+0000 7febeaffd700 1 --2- 172.21.15.118:0/3060306025 >> v2:172.21.15.174:3300/0 conn(0x7febec153d10 0x7febec15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.197+0000 7febeaffd700 1 -- 172.21.15.118:0/3060306025 >> v1:172.21.15.174:6789/0 conn(0x7febec15b4a0 legacy=0x7febec06e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.197+0000 7febeaffd700 1 -- 172.21.15.118:0/3060306025 >> v1:172.21.15.118:6789/0 conn(0x7febec0c5110 legacy=0x7febec06de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:29.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.197+0000 7febeaffd700 1 -- 172.21.15.118:0/3060306025 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec15a510 con 0x7febec153d10 2023-09-28T04:23:29.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.196+0000 7f553dd9b700 1 --2- 172.21.15.118:0/2850439559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5524004230 0x7f5538156570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5534009fd0 tx=0x7f55340097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.195+0000 7f42169ff700 1 -- 172.21.15.118:0/630602158 shutdown_connections 2023-09-28T04:23:29.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.196+0000 7f42169ff700 1 -- 172.21.15.118:0/630602158 wait complete. 2023-09-28T04:23:29.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.198+0000 7f42169ff700 1 Processor -- start 2023-09-28T04:23:29.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.198+0000 7febeaffd700 1 --2- 172.21.15.118:0/3060306025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febec153d10 0x7febec15af60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7febe4009e60 tx=0x7febe4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca6808b83e8c0d4b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.198+0000 7f42169ff700 1 -- start start 2023-09-28T04:23:29.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.198+0000 7febe9ffb700 1 -- 172.21.15.118:0/3060306025 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400e070 con 0x7febec153d10 2023-09-28T04:23:29.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.199+0000 7febe9ffb700 1 -- 172.21.15.118:0/3060306025 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe400bbf0 con 0x7febec153d10 2023-09-28T04:23:29.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.199+0000 7febe9ffb700 1 -- 172.21.15.118:0/3060306025 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4012430 con 0x7febec153d10 2023-09-28T04:23:29.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7febf19ff700 1 -- 172.21.15.118:0/3060306025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febec153d10 msgr2=0x7febec15af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7febf19ff700 1 --2- 172.21.15.118:0/3060306025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febec153d10 0x7febec15af60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7febe4009e60 tx=0x7febe4009780 comp rx=0 tx=0).stop 2023-09-28T04:23:29.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7f42169ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4210068140 0x7f421013db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7f42169ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42100c2a00 0x7f4210150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7febf19ff700 1 -- 172.21.15.118:0/3060306025 shutdown_connections 2023-09-28T04:23:29.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7febf19ff700 1 --2- 172.21.15.118:0/3060306025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febec153d10 0x7febec15af60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7febf19ff700 1 -- 172.21.15.118:0/3060306025 >> 172.21.15.118:0/3060306025 conn(0x7febec067630 msgr2=0x7febec067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7f42169ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42100c3b70 0x7f42100c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7f42169ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42100becf0 con 0x7f42100c3b70 2023-09-28T04:23:29.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7f42169ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42100c5db0 con 0x7f4210068140 2023-09-28T04:23:29.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7f42169ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421013d840 con 0x7f42100c2a00 2023-09-28T04:23:29.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7f420f7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42100c2a00 0x7f4210150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7febf19ff700 1 -- 172.21.15.118:0/3060306025 shutdown_connections 2023-09-28T04:23:29.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7febf19ff700 1 -- 172.21.15.118:0/3060306025 wait complete. 2023-09-28T04:23:29.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7f420f7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42100c2a00 0x7f4210150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:55818/0 (socket says 172.21.15.118:55818) 2023-09-28T04:23:29.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.200+0000 7f420f7fe700 1 -- 172.21.15.118:0/2564092774 learned_addr learned my addr 172.21.15.118:0/2564092774 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:29.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.201+0000 7f420ffff700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4210068140 0x7f421013db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.201+0000 7f4214f9c700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42100c3b70 0x7f42100c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.202+0000 7f4214f9c700 1 -- 172.21.15.118:0/2564092774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42100c2a00 msgr2=0x7f4210150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.202+0000 7f4214f9c700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42100c2a00 0x7f4210150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.202+0000 7f4214f9c700 1 -- 172.21.15.118:0/2564092774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4210068140 msgr2=0x7f421013db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.202+0000 7f4214f9c700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4210068140 0x7f421013db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.202+0000 7f4214f9c700 1 -- 172.21.15.118:0/2564092774 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42000094f0 con 0x7f42100c3b70 2023-09-28T04:23:29.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.202+0000 7f4214f9c700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42100c3b70 0x7f42100c6240 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f420800bb00 tx=0x7f4208009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.203+0000 7febf19ff700 1 Processor -- start 2023-09-28T04:23:29.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.203+0000 7febf19ff700 1 -- start start 2023-09-28T04:23:29.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.203+0000 7f4207fff700 1 -- 172.21.15.118:0/2564092774 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800c7c0 con 0x7f42100c3b70 2023-09-28T04:23:29.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.203+0000 7f4207fff700 1 -- 172.21.15.118:0/2564092774 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420800c960 con 0x7f42100c3b70 2023-09-28T04:23:29.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.203+0000 7f4207fff700 1 -- 172.21.15.118:0/2564092774 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800cd20 con 0x7f42100c3b70 2023-09-28T04:23:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.203+0000 7f42169ff700 1 -- 172.21.15.118:0/2564092774 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421013d5a0 con 0x7f42100c3b70 2023-09-28T04:23:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.203+0000 7f42169ff700 1 -- 172.21.15.118:0/2564092774 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42100c5a40 con 0x7f42100c3b70 2023-09-28T04:23:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.204+0000 7f552dffb700 1 -- 172.21.15.118:0/2850439559 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534018070 con 0x7f5524004230 2023-09-28T04:23:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.204+0000 7f552dffb700 1 -- 172.21.15.118:0/2850439559 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553400eb70 con 0x7f5524004230 2023-09-28T04:23:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.204+0000 7f552dffb700 1 -- 172.21.15.118:0/2850439559 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534014420 con 0x7f5524004230 2023-09-28T04:23:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.204+0000 7f553ffff700 1 -- 172.21.15.118:0/2850439559 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55380b0c70 con 0x7f5524004230 2023-09-28T04:23:29.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.204+0000 7f553ffff700 1 -- 172.21.15.118:0/2850439559 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55380af000 con 0x7f5524004230 2023-09-28T04:23:29.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.204+0000 7febf19ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febec0c5110 0x7febec1545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.204+0000 7febf19ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febec153d10 0x7febec155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.204+0000 7febf19ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febec15b4a0 0x7febec0c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.204+0000 7febf19ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec0c40b0 con 0x7febec15b4a0 2023-09-28T04:23:29.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.204+0000 7febf19ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec0c3a80 con 0x7febec153d10 2023-09-28T04:23:29.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.204+0000 7febf19ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec144010 con 0x7febec0c5110 2023-09-28T04:23:29.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.205+0000 7febeaffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febec0c5110 0x7febec1545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.205+0000 7febeaffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febec0c5110 0x7febec1545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:55824/0 (socket says 172.21.15.118:55824) 2023-09-28T04:23:29.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.205+0000 7febeaffd700 1 -- 172.21.15.118:0/1094212509 learned_addr learned my addr 172.21.15.118:0/1094212509 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:29.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.205+0000 7febea7fc700 1 --2- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febec153d10 0x7febec155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.205+0000 7febeaffd700 1 -- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febec153d10 msgr2=0x7febec155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.205+0000 7febeaffd700 1 --2- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febec153d10 0x7febec155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.206+0000 7febeaffd700 1 -- 172.21.15.118:0/1094212509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febec15b4a0 msgr2=0x7febec0c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.206+0000 7febeaffd700 1 --2- 172.21.15.118:0/1094212509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febec15b4a0 0x7febec0c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.206+0000 7febeaffd700 1 -- 172.21.15.118:0/1094212509 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe4009a20 con 0x7febec0c5110 2023-09-28T04:23:29.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.206+0000 7febeaffd700 1 --2- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febec0c5110 0x7febec1545f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7febec06d3d0 tx=0x7febe4018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.214 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.207+0000 7febd2ffd700 1 -- 172.21.15.118:0/1094212509 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4012e30 con 0x7febec0c5110 2023-09-28T04:23:29.214 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.207+0000 7febd2ffd700 1 -- 172.21.15.118:0/1094212509 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe401d640 con 0x7febec0c5110 2023-09-28T04:23:29.214 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.207+0000 7febd2ffd700 1 -- 172.21.15.118:0/1094212509 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe401d9e0 con 0x7febec0c5110 2023-09-28T04:23:29.214 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.207+0000 7febf19ff700 1 -- 172.21.15.118:0/1094212509 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec1442f0 con 0x7febec0c5110 2023-09-28T04:23:29.214 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.207+0000 7febf19ff700 1 -- 172.21.15.118:0/1094212509 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec0c4bf0 con 0x7febec0c5110 2023-09-28T04:23:29.214 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.208+0000 7febf19ff700 1 -- 172.21.15.118:0/1094212509 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec0c3f00 con 0x7febec0c5110 2023-09-28T04:23:29.214 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.208+0000 7f552dffb700 1 -- 172.21.15.118:0/2850439559 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5534003020 con 0x7f5524004230 2023-09-28T04:23:29.214 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.210+0000 7f552dffb700 1 --2- 172.21.15.118:0/2850439559 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f551c0674b0 0x7f551c069960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.215 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.210+0000 7f552dffb700 1 -- 172.21.15.118:0/2850439559 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5534084d30 con 0x7f5524004230 2023-09-28T04:23:29.215 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.212+0000 7f553d59a700 1 --2- 172.21.15.118:0/2850439559 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f551c0674b0 0x7f551c069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.215 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.208+0000 7f42169ff700 1 -- 172.21.15.118:0/2564092774 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42100c5f60 con 0x7f42100c3b70 2023-09-28T04:23:29.215 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.212+0000 7f4207fff700 1 -- 172.21.15.118:0/2564092774 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4208014620 con 0x7f42100c3b70 2023-09-28T04:23:29.215 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.213+0000 7f4207fff700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f41f00674b0 0x7f41f0069960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.215 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.213+0000 7f4207fff700 1 -- 172.21.15.118:0/2564092774 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4208086020 con 0x7f42100c3b70 2023-09-28T04:23:29.216 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.213+0000 7f420ffff700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f41f00674b0 0x7f41f0069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.216 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.213+0000 7f553d59a700 1 --2- 172.21.15.118:0/2850439559 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f551c0674b0 0x7f551c069960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f553806a570 tx=0x7f5528009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.216 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.215+0000 7f553ffff700 1 -- 172.21.15.118:0/2850439559 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55180052b0 con 0x7f5524004230 2023-09-28T04:23:29.217 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.215+0000 7febd2ffd700 1 -- 172.21.15.118:0/1094212509 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7febe4024070 con 0x7febec0c5110 2023-09-28T04:23:29.217 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.217+0000 7f420ffff700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f41f00674b0 0x7f41f0069960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f42100c5610 tx=0x7f4200017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.218 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.217+0000 7febd2ffd700 1 --2- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7febd8067480 0x7febd8069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.218 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.217+0000 7febd2ffd700 1 -- 172.21.15.118:0/1094212509 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7febe4087b40 con 0x7febec0c5110 2023-09-28T04:23:29.218 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.218+0000 7febd2ffd700 1 -- 172.21.15.118:0/1094212509 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7febe40b2610 con 0x7febec0c5110 2023-09-28T04:23:29.218 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.218+0000 7febea7fc700 1 --2- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7febd8067480 0x7febd8069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.219 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.218+0000 7febea7fc700 1 --2- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7febd8067480 0x7febd8069930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7febec15bf80 tx=0x7febe0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.219 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.219+0000 7f4207fff700 1 -- 172.21.15.118:0/2564092774 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f42100c5f60 con 0x7f42100c3b70 2023-09-28T04:23:29.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.227+0000 7f552dffb700 1 -- 172.21.15.118:0/2850439559 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f55340556a0 con 0x7f5524004230 2023-09-28T04:23:29.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.230+0000 7f6806fff700 1 Processor -- start 2023-09-28T04:23:29.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.231+0000 7f6806fff700 1 -- start start 2023-09-28T04:23:29.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.233+0000 7f6806fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f68000c4940 0x7f680006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.233+0000 7f6806fff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68000c3140 con 0x7f68000c0db0 2023-09-28T04:23:29.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.233+0000 7f6806fff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68000c3420 con 0x7f68000c1180 2023-09-28T04:23:29.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.233+0000 7f6806fff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68000c3700 con 0x7f68000c4940 2023-09-28T04:23:29.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.234+0000 7f6804d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f68000c0db0 0x7f68000c4230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47804/0 (socket says 172.21.15.118:47804) 2023-09-28T04:23:29.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.234+0000 7f6804d9b700 1 -- 172.21.15.118:0/2080470358 learned_addr learned my addr 172.21.15.118:0/2080470358 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:29.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.234+0000 7f680559c700 1 --2- 172.21.15.118:0/2080470358 >> v2:172.21.15.174:3300/0 conn(0x7f68000c4940 0x7f680006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.235+0000 7f680559c700 1 -- 172.21.15.118:0/2080470358 >> v1:172.21.15.174:6789/0 conn(0x7f68000c1180 legacy=0x7f680015a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.235+0000 7f680559c700 1 -- 172.21.15.118:0/2080470358 >> v1:172.21.15.118:6789/0 conn(0x7f68000c0db0 legacy=0x7f68000c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.235+0000 7f680559c700 1 -- 172.21.15.118:0/2080470358 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6800154e50 con 0x7f68000c4940 2023-09-28T04:23:29.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.236+0000 7f680559c700 1 --2- 172.21.15.118:0/2080470358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68000c4940 0x7f680006df10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f67f00098e0 tx=0x7f67f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdeb11bed00b41ec server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.236+0000 7f67ff7fe700 1 -- 172.21.15.118:0/2080470358 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0009e80 con 0x7f68000c4940 2023-09-28T04:23:29.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.236+0000 7f67ff7fe700 1 -- 172.21.15.118:0/2080470358 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f000b760 con 0x7f68000c4940 2023-09-28T04:23:29.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.237+0000 7f67ff7fe700 1 -- 172.21.15.118:0/2080470358 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f000bb00 con 0x7f68000c4940 2023-09-28T04:23:29.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.237+0000 7f6806fff700 1 -- 172.21.15.118:0/2080470358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68000c4940 msgr2=0x7f680006df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.237+0000 7f6806fff700 1 --2- 172.21.15.118:0/2080470358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68000c4940 0x7f680006df10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f67f00098e0 tx=0x7f67f00091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.239+0000 7f6806fff700 1 -- 172.21.15.118:0/2080470358 shutdown_connections 2023-09-28T04:23:29.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.239+0000 7f6806fff700 1 --2- 172.21.15.118:0/2080470358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68000c4940 0x7f680006df10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.239+0000 7f6806fff700 1 -- 172.21.15.118:0/2080470358 >> 172.21.15.118:0/2080470358 conn(0x7f6800067630 msgr2=0x7f6800067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.240+0000 7f6806fff700 1 -- 172.21.15.118:0/2080470358 shutdown_connections 2023-09-28T04:23:29.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.240+0000 7f6806fff700 1 -- 172.21.15.118:0/2080470358 wait complete. 2023-09-28T04:23:29.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.241+0000 7f8367dff700 1 Processor -- start 2023-09-28T04:23:29.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.241+0000 7f8367dff700 1 -- start start 2023-09-28T04:23:29.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.242+0000 7f6806fff700 1 Processor -- start 2023-09-28T04:23:29.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.243+0000 7f22fa1ff700 1 Processor -- start 2023-09-28T04:23:29.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.243+0000 7f22fa1ff700 1 -- start start 2023-09-28T04:23:29.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.243+0000 7f8367dff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83600c2680 0x7f83600c4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.245 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.243+0000 7f8367dff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83600c4fb0 con 0x7f8360068140 2023-09-28T04:23:29.245 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.243+0000 7f8367dff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8360155be0 con 0x7f8360152250 2023-09-28T04:23:29.245 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.243+0000 7f8367dff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8360154fd0 con 0x7f83600c2680 2023-09-28T04:23:29.245 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.245+0000 7f8365b9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83600c2680 0x7f83600c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.245 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.245+0000 7f8365b9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83600c2680 0x7f83600c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50976/0 (socket says 172.21.15.118:50976) 2023-09-28T04:23:29.245 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.245+0000 7f8365b9b700 1 -- 172.21.15.118:0/1808616974 learned_addr learned my addr 172.21.15.118:0/1808616974 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:29.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.245+0000 7f8365b9b700 1 -- 172.21.15.118:0/1808616974 >> v1:172.21.15.174:6789/0 conn(0x7f8360152250 legacy=0x7f836014b6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-28T04:23:29.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.245+0000 7f8365b9b700 1 -- 172.21.15.118:0/1808616974 >> v1:172.21.15.118:6789/0 conn(0x7f8360068140 legacy=0x7f8360151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:29.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.245+0000 7f22fa1ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f22f40c1c20 0x7f22f4153e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.245+0000 7f22fa1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22f414d230 0x7f22f414d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.245+0000 7f22fa1ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f414dc10 con 0x7f22f40c1850 2023-09-28T04:23:29.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.245+0000 7f22fa1ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f40c5510 con 0x7f22f40c1c20 2023-09-28T04:23:29.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.245+0000 7f22fa1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40c2bd0 con 0x7f22f414d230 2023-09-28T04:23:29.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.245+0000 7f836539a700 1 --1- 172.21.15.118:0/1808616974 >> v1:172.21.15.118:6789/0 conn(0x7f8360068140 0x7f8360151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47820/0 (socket says 172.21.15.118:47820) 2023-09-28T04:23:29.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.246+0000 7f8365b9b700 1 -- 172.21.15.118:0/1808616974 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83601552b0 con 0x7f83600c2680 2023-09-28T04:23:29.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.246+0000 7f22f37fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f22f40c1850 0x7f22f40c24c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47830/0 (socket says 172.21.15.118:47830) 2023-09-28T04:23:29.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.246+0000 7f22f37fe700 1 -- 172.21.15.118:0/2131215105 learned_addr learned my addr 172.21.15.118:0/2131215105 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:29.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.246+0000 7f6806fff700 1 -- start start 2023-09-28T04:23:29.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.247+0000 7f22f2ffd700 1 --2- 172.21.15.118:0/2131215105 >> v2:172.21.15.118:3300/0 conn(0x7f22f40c1c20 0x7f22f4153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.247+0000 7f8365b9b700 1 --2- 172.21.15.118:0/1808616974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83600c2680 0x7f83600c4490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f835c00bc50 tx=0x7f835c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2a7fa42f9c2aac server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.248+0000 7f22f2ffd700 1 -- 172.21.15.118:0/2131215105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22f414d230 msgr2=0x7f22f414d6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-28T04:23:29.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.248+0000 7f22f2ffd700 1 --2- 172.21.15.118:0/2131215105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22f414d230 0x7f22f414d6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.248+0000 7f22f2ffd700 1 -- 172.21.15.118:0/2131215105 >> v1:172.21.15.118:6789/0 conn(0x7f22f40c1850 legacy=0x7f22f40c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.248+0000 7f22f2ffd700 1 -- 172.21.15.118:0/2131215105 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f40bef30 con 0x7f22f40c1c20 2023-09-28T04:23:29.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.248+0000 7f6806fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68000c0db0 0x7f680014dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.248+0000 7f6806fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68000c1180 0x7f68000c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.248+0000 7f6806fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68000c4940 0x7f68000c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.248+0000 7f6806fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680014d700 con 0x7f68000c1180 2023-09-28T04:23:29.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.248+0000 7f6806fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680014f0d0 con 0x7f68000c4940 2023-09-28T04:23:29.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.248+0000 7f6806fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680016e170 con 0x7f68000c0db0 2023-09-28T04:23:29.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.249+0000 7f6804d9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68000c0db0 0x7f680014dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.249+0000 7f6804d9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68000c0db0 0x7f680014dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:55854/0 (socket says 172.21.15.118:55854) 2023-09-28T04:23:29.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.249+0000 7f6804d9b700 1 -- 172.21.15.118:0/1374763621 learned_addr learned my addr 172.21.15.118:0/1374763621 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:29.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.249+0000 7f680559c700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68000c4940 0x7f68000c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.249+0000 7f67fffff700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68000c1180 0x7f68000c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.249+0000 7f22f2ffd700 1 --2- 172.21.15.118:0/2131215105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f40c1c20 0x7f22f4153e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f22e40098e0 tx=0x7f22e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e6c92fefaccea3 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.249+0000 7f6804d9b700 1 -- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68000c4940 msgr2=0x7f68000c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.249+0000 7f6804d9b700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68000c4940 0x7f68000c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.249+0000 7f6804d9b700 1 -- 172.21.15.118:0/1374763621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68000c1180 msgr2=0x7f68000c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.249+0000 7f6804d9b700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68000c1180 0x7f68000c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.249+0000 7f6804d9b700 1 -- 172.21.15.118:0/1374763621 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0009420 con 0x7f68000c0db0 2023-09-28T04:23:29.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.250+0000 7f6804d9b700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68000c0db0 0x7f680014dfb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f67f800cd30 tx=0x7f67f8001ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.250+0000 7f67fcff9700 1 -- 172.21.15.118:0/1374763621 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f800ce90 con 0x7f68000c0db0 2023-09-28T04:23:29.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.250+0000 7f67fcff9700 1 -- 172.21.15.118:0/1374763621 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f800ab30 con 0x7f68000c0db0 2023-09-28T04:23:29.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.250+0000 7f67fcff9700 1 -- 172.21.15.118:0/1374763621 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f80070f0 con 0x7f68000c0db0 2023-09-28T04:23:29.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.250+0000 7f22f27fc700 1 -- 172.21.15.118:0/2131215105 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4009e80 con 0x7f22f40c1c20 2023-09-28T04:23:29.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.250+0000 7f22f27fc700 1 -- 172.21.15.118:0/2131215105 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e400b8f0 con 0x7f22f40c1c20 2023-09-28T04:23:29.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.250+0000 7f22f27fc700 1 -- 172.21.15.118:0/2131215105 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e400bcb0 con 0x7f22f40c1c20 2023-09-28T04:23:29.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.251+0000 7f22fa1ff700 1 -- 172.21.15.118:0/2131215105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f40c1c20 msgr2=0x7f22f4153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.251+0000 7f22fa1ff700 1 --2- 172.21.15.118:0/2131215105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f40c1c20 0x7f22f4153e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f22e40098e0 tx=0x7f22e40091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.251+0000 7f6806fff700 1 -- 172.21.15.118:0/1374763621 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680014eb10 con 0x7f68000c0db0 2023-09-28T04:23:29.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.252+0000 7f6806fff700 1 -- 172.21.15.118:0/1374763621 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680014c5f0 con 0x7f68000c0db0 2023-09-28T04:23:29.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.251+0000 7f22fa1ff700 1 -- 172.21.15.118:0/2131215105 shutdown_connections 2023-09-28T04:23:29.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.251+0000 7f22fa1ff700 1 --2- 172.21.15.118:0/2131215105 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22f414d230 0x7f22f414d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.251+0000 7f22fa1ff700 1 --2- 172.21.15.118:0/2131215105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f40c1c20 0x7f22f4153e70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.251+0000 7f22fa1ff700 1 -- 172.21.15.118:0/2131215105 >> 172.21.15.118:0/2131215105 conn(0x7f22f4067630 msgr2=0x7f22f4067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.252+0000 7f8364b99700 1 -- 172.21.15.118:0/1808616974 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00be60 con 0x7f83600c2680 2023-09-28T04:23:29.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.252+0000 7f8364b99700 1 -- 172.21.15.118:0/1808616974 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c00dd80 con 0x7f83600c2680 2023-09-28T04:23:29.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.252+0000 7f8364b99700 1 -- 172.21.15.118:0/1808616974 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0106a0 con 0x7f83600c2680 2023-09-28T04:23:29.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.253+0000 7f8367dff700 1 -- 172.21.15.118:0/1808616974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83600c2680 msgr2=0x7f83600c4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.253+0000 7f8367dff700 1 --2- 172.21.15.118:0/1808616974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83600c2680 0x7f83600c4490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f835c00bc50 tx=0x7f835c00b4f0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.253+0000 7f6806fff700 1 -- 172.21.15.118:0/1374763621 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68000c5a00 con 0x7f68000c0db0 2023-09-28T04:23:29.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.253+0000 7f22fa1ff700 1 -- 172.21.15.118:0/2131215105 shutdown_connections 2023-09-28T04:23:29.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.254+0000 7f8367dff700 1 -- 172.21.15.118:0/1808616974 shutdown_connections 2023-09-28T04:23:29.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.254+0000 7f8367dff700 1 --2- 172.21.15.118:0/1808616974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83600c2680 0x7f83600c4490 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.254+0000 7f8367dff700 1 -- 172.21.15.118:0/1808616974 >> 172.21.15.118:0/1808616974 conn(0x7f8360067630 msgr2=0x7f8360067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.254+0000 7f22fa1ff700 1 -- 172.21.15.118:0/2131215105 wait complete. 2023-09-28T04:23:29.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.256+0000 7f8367dff700 1 -- 172.21.15.118:0/1808616974 shutdown_connections 2023-09-28T04:23:29.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.256+0000 7f8367dff700 1 -- 172.21.15.118:0/1808616974 wait complete. 2023-09-28T04:23:29.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.259+0000 7f8367dff700 1 Processor -- start 2023-09-28T04:23:29.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.255+0000 7f67fcff9700 1 -- 172.21.15.118:0/1374763621 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f67f80074e0 con 0x7f68000c0db0 2023-09-28T04:23:29.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.257+0000 7f67fcff9700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f67ec067400 0x7f67ec0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.257+0000 7f67fcff9700 1 -- 172.21.15.118:0/1374763621 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f67f80853d0 con 0x7f68000c0db0 2023-09-28T04:23:29.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.259+0000 7f67fcff9700 1 -- 172.21.15.118:0/1374763621 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f67f8052330 con 0x7f68000c0db0 2023-09-28T04:23:29.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.256+0000 7f22fa1ff700 1 Processor -- start 2023-09-28T04:23:29.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.257+0000 7f22fa1ff700 1 -- start start 2023-09-28T04:23:29.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.258+0000 7f22fa1ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f40c1850 0x7f22f406e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.258+0000 7f22fa1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22f40c1c20 0x7f22f40bbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.258+0000 7f22fa1ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f414d230 0x7f22f40c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.258+0000 7f22fa1ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f406d9e0 con 0x7f22f414d230 2023-09-28T04:23:29.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.258+0000 7f22fa1ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40bba40 con 0x7f22f40c1850 2023-09-28T04:23:29.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.258+0000 7f22fa1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40bc410 con 0x7f22f40c1c20 2023-09-28T04:23:29.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.259+0000 7f22f37fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f40c1850 0x7f22f406e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.259+0000 7f22f37fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f40c1850 0x7f22f406e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:57384/0 (socket says 172.21.15.118:57384) 2023-09-28T04:23:29.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.259+0000 7f22f37fe700 1 -- 172.21.15.118:0/1174275504 learned_addr learned my addr 172.21.15.118:0/1174275504 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:29.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.259+0000 7f22f2ffd700 1 --2- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22f40c1c20 0x7f22f40bbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.259+0000 7f22f37fe700 1 -- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22f40c1c20 msgr2=0x7f22f40bbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.259+0000 7f22f37fe700 1 --2- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22f40c1c20 0x7f22f40bbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.259+0000 7f22f37fe700 1 -- 172.21.15.118:0/1174275504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f414d230 msgr2=0x7f22f40c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.259+0000 7f22f37fe700 1 --2- 172.21.15.118:0/1174275504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f414d230 0x7f22f40c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.259+0000 7f22f37fe700 1 -- 172.21.15.118:0/1174275504 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e4009420 con 0x7f22f40c1850 2023-09-28T04:23:29.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.260+0000 7f22f37fe700 1 --2- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f40c1850 0x7f22f406e4b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00c560 tx=0x7f22dc001020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.259+0000 7f8367dff700 1 -- start start 2023-09-28T04:23:29.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.261+0000 7f8367dff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8360068140 0x7f83600c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.261+0000 7f8367dff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83600c2680 0x7f83600c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.261+0000 7f8367dff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8360152250 0x7f836014f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.261+0000 7f8367dff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8360147e50 con 0x7f8360152250 2023-09-28T04:23:29.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.261+0000 7f8367dff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83600c5e70 con 0x7f83600c2680 2023-09-28T04:23:29.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.261+0000 7f8367dff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83600c6090 con 0x7f8360068140 2023-09-28T04:23:29.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.261+0000 7f836539a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83600c2680 0x7f83600c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.261+0000 7f836539a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83600c2680 0x7f83600c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:57398/0 (socket says 172.21.15.118:57398) 2023-09-28T04:23:29.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.261+0000 7f836539a700 1 -- 172.21.15.118:0/2265632807 learned_addr learned my addr 172.21.15.118:0/2265632807 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:29.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.260+0000 7f22eb7fe700 1 -- 172.21.15.118:0/1174275504 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc005b30 con 0x7f22f40c1850 2023-09-28T04:23:29.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.260+0000 7f22eb7fe700 1 -- 172.21.15.118:0/1174275504 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc005cb0 con 0x7f22f40c1850 2023-09-28T04:23:29.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.260+0000 7f22eb7fe700 1 -- 172.21.15.118:0/1174275504 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc007320 con 0x7f22f40c1850 2023-09-28T04:23:29.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.262+0000 7f836539a700 1 -- 172.21.15.118:0/2265632807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8360068140 msgr2=0x7f83600c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.262+0000 7f836539a700 1 --2- 172.21.15.118:0/2265632807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8360068140 0x7f83600c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.262+0000 7f836539a700 1 -- 172.21.15.118:0/2265632807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8360152250 msgr2=0x7f836014f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.262+0000 7f836539a700 1 --2- 172.21.15.118:0/2265632807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8360152250 0x7f836014f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.262+0000 7f836539a700 1 -- 172.21.15.118:0/2265632807 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c00b790 con 0x7f83600c2680 2023-09-28T04:23:29.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.262+0000 7f836539a700 1 --2- 172.21.15.118:0/2265632807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83600c2680 0x7f83600c6850 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f835800cd30 tx=0x7f8358005450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.263+0000 7f8355ffb700 1 -- 172.21.15.118:0/2265632807 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358005df0 con 0x7f83600c2680 2023-09-28T04:23:29.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.263+0000 7f8355ffb700 1 -- 172.21.15.118:0/2265632807 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835800a9f0 con 0x7f83600c2680 2023-09-28T04:23:29.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.263+0000 7f8355ffb700 1 -- 172.21.15.118:0/2265632807 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835800adb0 con 0x7f83600c2680 2023-09-28T04:23:29.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.263+0000 7f8367dff700 1 -- 172.21.15.118:0/2265632807 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83600c6370 con 0x7f83600c2680 2023-09-28T04:23:29.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.263+0000 7f8367dff700 1 -- 172.21.15.118:0/2265632807 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83600c05d0 con 0x7f83600c2680 2023-09-28T04:23:29.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.265+0000 7f67fffff700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f67ec067400 0x7f67ec0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.264+0000 7f22fa1ff700 1 -- 172.21.15.118:0/1174275504 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f40c67d0 con 0x7f22f40c1850 2023-09-28T04:23:29.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.264+0000 7f22fa1ff700 1 -- 172.21.15.118:0/1174275504 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f406dc10 con 0x7f22f40c1850 2023-09-28T04:23:29.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.267+0000 7f8355ffb700 1 -- 172.21.15.118:0/2265632807 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8358007300 con 0x7f83600c2680 2023-09-28T04:23:29.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.269+0000 7f8355ffb700 1 --2- 172.21.15.118:0/2265632807 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8344067480 0x7f8344069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.269+0000 7f8355ffb700 1 -- 172.21.15.118:0/2265632807 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8358084e80 con 0x7f83600c2680 2023-09-28T04:23:29.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.269+0000 7f22fa1ff700 1 -- 172.21.15.118:0/1174275504 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f406ddd0 con 0x7f22f40c1850 2023-09-28T04:23:29.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.270+0000 7f8367dff700 1 -- 172.21.15.118:0/2265632807 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8360152690 con 0x7f83600c2680 2023-09-28T04:23:29.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.269+0000 7f22eb7fe700 1 -- 172.21.15.118:0/1174275504 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f22dc01b3b0 con 0x7f22f40c1850 2023-09-28T04:23:29.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.271+0000 7f67fffff700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f67ec067400 0x7f67ec0698b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f68001519f0 tx=0x7f67f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.271+0000 7f22eb7fe700 1 --2- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f22d4067480 0x7f22d4069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.271+0000 7f22eb7fe700 1 -- 172.21.15.118:0/1174275504 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f22dc084120 con 0x7f22f40c1850 2023-09-28T04:23:29.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.271+0000 7f8365b9b700 1 --2- 172.21.15.118:0/2265632807 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8344067480 0x7f8344069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.272+0000 7f22f2ffd700 1 --2- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f22d4067480 0x7f22d4069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.272+0000 7f8365b9b700 1 --2- 172.21.15.118:0/2265632807 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8344067480 0x7f8344069930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f835c00bc50 tx=0x7f835c01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.272+0000 7f22f2ffd700 1 --2- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f22d4067480 0x7f22d4069930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22e40098e0 tx=0x7f22e4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.275+0000 7f22eb7fe700 1 -- 172.21.15.118:0/1174275504 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f22dc051000 con 0x7f22f40c1850 2023-09-28T04:23:29.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.280+0000 7f8355ffb700 1 -- 172.21.15.118:0/2265632807 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8358051de0 con 0x7f83600c2680 2023-09-28T04:23:29.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.300+0000 7f87b5fff700 1 Processor -- start 2023-09-28T04:23:29.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.300+0000 7f87b5fff700 1 -- start start 2023-09-28T04:23:29.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.302+0000 7f87b5fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87b00c5110 0x7f87b0153df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.302+0000 7f87b5fff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b00c28f0 con 0x7f87b015d9b0 2023-09-28T04:23:29.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.302+0000 7f87b5fff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b0159b70 con 0x7f87b0153a20 2023-09-28T04:23:29.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.302+0000 7f87b5fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b015a950 con 0x7f87b00c5110 2023-09-28T04:23:29.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.304+0000 7f87affff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f87b015d9b0 0x7f87b00c3850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47834/0 (socket says 172.21.15.118:47834) 2023-09-28T04:23:29.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.304+0000 7f87affff700 1 -- 172.21.15.118:0/4286380196 learned_addr learned my addr 172.21.15.118:0/4286380196 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:29.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.305+0000 7f87aeffd700 1 --2- 172.21.15.118:0/4286380196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87b00c5110 0x7f87b0153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.306+0000 7f87aeffd700 1 -- 172.21.15.118:0/4286380196 >> v1:172.21.15.174:6789/0 conn(0x7f87b0153a20 legacy=0x7f87b00c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.306+0000 7f87aeffd700 1 -- 172.21.15.118:0/4286380196 >> v1:172.21.15.118:6789/0 conn(0x7f87b015d9b0 legacy=0x7f87b00c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.306+0000 7f87aeffd700 1 -- 172.21.15.118:0/4286380196 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b0159dd0 con 0x7f87b00c5110 2023-09-28T04:23:29.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.307+0000 7f87aeffd700 1 --2- 172.21.15.118:0/4286380196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87b00c5110 0x7f87b0153df0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f87a0009910 tx=0x7f87a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a704a5c5a82eb419 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.307+0000 7f87ae7fc700 1 -- 172.21.15.118:0/4286380196 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0009eb0 con 0x7f87b00c5110 2023-09-28T04:23:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.307+0000 7f87ae7fc700 1 -- 172.21.15.118:0/4286380196 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a000b760 con 0x7f87b00c5110 2023-09-28T04:23:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.307+0000 7f87ae7fc700 1 -- 172.21.15.118:0/4286380196 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a000bb00 con 0x7f87b00c5110 2023-09-28T04:23:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.308+0000 7f87b5fff700 1 -- 172.21.15.118:0/4286380196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87b00c5110 msgr2=0x7f87b0153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.308+0000 7f87b5fff700 1 --2- 172.21.15.118:0/4286380196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87b00c5110 0x7f87b0153df0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f87a0009910 tx=0x7f87a00091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.309+0000 7f87b5fff700 1 -- 172.21.15.118:0/4286380196 shutdown_connections 2023-09-28T04:23:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.309+0000 7f87b5fff700 1 --2- 172.21.15.118:0/4286380196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87b00c5110 0x7f87b0153df0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.309+0000 7f87b5fff700 1 -- 172.21.15.118:0/4286380196 >> 172.21.15.118:0/4286380196 conn(0x7f87b0067630 msgr2=0x7f87b0067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.309+0000 7f87b5fff700 1 -- 172.21.15.118:0/4286380196 shutdown_connections 2023-09-28T04:23:29.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.309+0000 7f87b5fff700 1 -- 172.21.15.118:0/4286380196 wait complete. 2023-09-28T04:23:29.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.311+0000 7f87b5fff700 1 Processor -- start 2023-09-28T04:23:29.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.312+0000 7f87b5fff700 1 -- start start 2023-09-28T04:23:29.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.313+0000 7f87b5fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87b00c5110 0x7f87b00c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.313+0000 7f87b5fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87b0153a20 0x7f87b014bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.313+0000 7f87b5fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87b015d9b0 0x7f87b014c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.313+0000 7f87b5fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b0169a10 con 0x7f87b0153a20 2023-09-28T04:23:29.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.313+0000 7f87b5fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b016d030 con 0x7f87b015d9b0 2023-09-28T04:23:29.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.313+0000 7f87b5fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b016d310 con 0x7f87b00c5110 2023-09-28T04:23:29.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.317+0000 7f87aeffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87b0153a20 0x7f87b014bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.317+0000 7f87aeffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87b0153a20 0x7f87b014bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51032/0 (socket says 172.21.15.118:51032) 2023-09-28T04:23:29.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.317+0000 7f87aeffd700 1 -- 172.21.15.118:0/1631555911 learned_addr learned my addr 172.21.15.118:0/1631555911 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:29.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.318+0000 7f87aeffd700 1 -- 172.21.15.118:0/1631555911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87b00c5110 msgr2=0x7f87b00c81e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-28T04:23:29.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.318+0000 7f87aeffd700 1 --2- 172.21.15.118:0/1631555911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87b00c5110 0x7f87b00c81e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.318+0000 7f87aeffd700 1 -- 172.21.15.118:0/1631555911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87b015d9b0 msgr2=0x7f87b014c210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-28T04:23:29.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.318+0000 7f87aeffd700 1 --2- 172.21.15.118:0/1631555911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87b015d9b0 0x7f87b014c210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.318+0000 7f87aeffd700 1 -- 172.21.15.118:0/1631555911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a0009420 con 0x7f87b0153a20 2023-09-28T04:23:29.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.318+0000 7f87aeffd700 1 --2- 172.21.15.118:0/1631555911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87b0153a20 0x7f87b014bcd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f87a00093f0 tx=0x7f87a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.319+0000 7f87977fe700 1 -- 172.21.15.118:0/1631555911 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0011df0 con 0x7f87b0153a20 2023-09-28T04:23:29.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.319+0000 7f87977fe700 1 -- 172.21.15.118:0/1631555911 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a001d430 con 0x7f87b0153a20 2023-09-28T04:23:29.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.319+0000 7f87977fe700 1 -- 172.21.15.118:0/1631555911 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a001d7b0 con 0x7f87b0153a20 2023-09-28T04:23:29.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.319+0000 7f87b5fff700 1 -- 172.21.15.118:0/1631555911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b016d5f0 con 0x7f87b0153a20 2023-09-28T04:23:29.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.319+0000 7f87b5fff700 1 -- 172.21.15.118:0/1631555911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b016dbb0 con 0x7f87b0153a20 2023-09-28T04:23:29.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.324+0000 7f87977fe700 1 -- 172.21.15.118:0/1631555911 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f87a001dba0 con 0x7f87b0153a20 2023-09-28T04:23:29.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.325+0000 7f87b5fff700 1 -- 172.21.15.118:0/1631555911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b0071980 con 0x7f87b0153a20 2023-09-28T04:23:29.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.327+0000 7f87977fe700 1 --2- 172.21.15.118:0/1631555911 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f879c0674b0 0x7f879c069960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.327+0000 7f87977fe700 1 -- 172.21.15.118:0/1631555911 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f87a0086860 con 0x7f87b0153a20 2023-09-28T04:23:29.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.338+0000 7f87af7fe700 1 --2- 172.21.15.118:0/1631555911 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f879c0674b0 0x7f879c069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.338+0000 7f87977fe700 1 -- 172.21.15.118:0/1631555911 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f87a0053780 con 0x7f87b0153a20 2023-09-28T04:23:29.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.388+0000 7f87af7fe700 1 --2- 172.21.15.118:0/1631555911 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f879c0674b0 0x7f879c069960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f87a8001d40 tx=0x7f87a8007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.555 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.554+0000 7f64f79ff700 1 -- 172.21.15.118:0/1765349516 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f64d0005560 con 0x7f64f00c5110 2023-09-28T04:23:29.558 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2023-09-28T04:23:29.559 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.555+0000 7f64e57fa700 1 -- 172.21.15.118:0/1765349516 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f64e8054e50 con 0x7f64f00c5110 2023-09-28T04:23:29.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.559+0000 7f64f79ff700 1 -- 172.21.15.118:0/1765349516 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f64d4067480 msgr2=0x7f64d4069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.559+0000 7f64f79ff700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f64d4067480 0x7f64d4069930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f64ec000c00 tx=0x7f64ec009040 comp rx=0 tx=0).stop 2023-09-28T04:23:29.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.559+0000 7f64f79ff700 1 -- 172.21.15.118:0/1765349516 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64f00c5110 msgr2=0x7f64f0183d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.559+0000 7f64f79ff700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64f00c5110 0x7f64f0183d70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f64e800bbe0 tx=0x7f64e8009840 comp rx=0 tx=0).stop 2023-09-28T04:23:29.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.560+0000 7f64f79ff700 1 -- 172.21.15.118:0/1765349516 shutdown_connections 2023-09-28T04:23:29.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.560+0000 7f64f79ff700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f64d4067480 0x7f64d4069930 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.560+0000 7f64f79ff700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64f0153d10 0x7f64f00bd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.560+0000 7f64f79ff700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f006e5a0 0x7f64f01446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.560+0000 7f64f79ff700 1 --2- 172.21.15.118:0/1765349516 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64f00c5110 0x7f64f0183d70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.560+0000 7f64f79ff700 1 -- 172.21.15.118:0/1765349516 >> 172.21.15.118:0/1765349516 conn(0x7f64f0067630 msgr2=0x7f64f015c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.560+0000 7f64f79ff700 1 -- 172.21.15.118:0/1765349516 shutdown_connections 2023-09-28T04:23:29.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.560+0000 7f64f79ff700 1 -- 172.21.15.118:0/1765349516 wait complete. 2023-09-28T04:23:29.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-09-28T04:23:29.591 DEBUG:teuthology.parallel:result is None 2023-09-28T04:23:29.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.644+0000 7f42169ff700 1 -- 172.21.15.118:0/2564092774 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f42100c5f60 con 0x7f42100c3b70 2023-09-28T04:23:29.645 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2023-09-28T04:23:29.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.645+0000 7f4207fff700 1 -- 172.21.15.118:0/2564092774 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42100c5f60 con 0x7f42100c3b70 2023-09-28T04:23:29.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.645+0000 7f22fa1ff700 1 -- 172.21.15.118:0/1174275504 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f22f4071980 con 0x7f22f40c1850 2023-09-28T04:23:29.646 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2023-09-28T04:23:29.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.646+0000 7f22eb7fe700 1 -- 172.21.15.118:0/1174275504 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22dc054620 con 0x7f22f40c1850 2023-09-28T04:23:29.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.648+0000 7f42169ff700 1 -- 172.21.15.118:0/2564092774 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f41f00674b0 msgr2=0x7f41f0069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.648+0000 7f42169ff700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f41f00674b0 0x7f41f0069960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f42100c5610 tx=0x7f4200017000 comp rx=0 tx=0).stop 2023-09-28T04:23:29.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.648+0000 7f42169ff700 1 -- 172.21.15.118:0/2564092774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42100c3b70 msgr2=0x7f42100c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.648+0000 7f42169ff700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42100c3b70 0x7f42100c6240 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f420800bb00 tx=0x7f4208009780 comp rx=0 tx=0).stop 2023-09-28T04:23:29.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f22fa1ff700 1 -- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f22d4067480 msgr2=0x7f22d4069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f22fa1ff700 1 --2- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f22d4067480 0x7f22d4069930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22e40098e0 tx=0x7f22e4017000 comp rx=0 tx=0).stop 2023-09-28T04:23:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f22fa1ff700 1 -- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f40c1850 msgr2=0x7f22f406e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f22fa1ff700 1 --2- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f40c1850 0x7f22f406e4b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00c560 tx=0x7f22dc001020 comp rx=0 tx=0).stop 2023-09-28T04:23:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f42169ff700 1 -- 172.21.15.118:0/2564092774 shutdown_connections 2023-09-28T04:23:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f42169ff700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f41f00674b0 0x7f41f0069960 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f42169ff700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42100c3b70 0x7f42100c6240 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f42169ff700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4210068140 0x7f421013db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f42169ff700 1 --2- 172.21.15.118:0/2564092774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42100c2a00 0x7f4210150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f42169ff700 1 -- 172.21.15.118:0/2564092774 >> 172.21.15.118:0/2564092774 conn(0x7f4210067630 msgr2=0x7f421013ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f22fa1ff700 1 -- 172.21.15.118:0/1174275504 shutdown_connections 2023-09-28T04:23:29.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f22fa1ff700 1 --2- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f22d4067480 0x7f22d4069930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f22fa1ff700 1 --2- 172.21.15.118:0/1174275504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f414d230 0x7f22f40c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f22fa1ff700 1 --2- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22f40c1850 0x7f22f406e4b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f22fa1ff700 1 --2- 172.21.15.118:0/1174275504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22f40c1c20 0x7f22f40bbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f22fa1ff700 1 -- 172.21.15.118:0/1174275504 >> 172.21.15.118:0/1174275504 conn(0x7f22f4067630 msgr2=0x7f22f4070720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f42169ff700 1 -- 172.21.15.118:0/2564092774 shutdown_connections 2023-09-28T04:23:29.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f22fa1ff700 1 -- 172.21.15.118:0/1174275504 shutdown_connections 2023-09-28T04:23:29.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f22fa1ff700 1 -- 172.21.15.118:0/1174275504 wait complete. 2023-09-28T04:23:29.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.649+0000 7f42169ff700 1 -- 172.21.15.118:0/2564092774 wait complete. 2023-09-28T04:23:29.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.656+0000 7febf19ff700 1 -- 172.21.15.118:0/1094212509 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7febec071980 con 0x7febec0c5110 2023-09-28T04:23:29.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.657+0000 7febd2ffd700 1 -- 172.21.15.118:0/1094212509 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7febe4054aa0 con 0x7febec0c5110 2023-09-28T04:23:29.658 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2023-09-28T04:23:29.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.661+0000 7febf19ff700 1 -- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7febd8067480 msgr2=0x7febd8069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.661+0000 7febf19ff700 1 --2- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7febd8067480 0x7febd8069930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7febec15bf80 tx=0x7febe0009040 comp rx=0 tx=0).stop 2023-09-28T04:23:29.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.661+0000 7febf19ff700 1 -- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febec0c5110 msgr2=0x7febec1545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.661+0000 7febf19ff700 1 --2- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febec0c5110 0x7febec1545f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7febec06d3d0 tx=0x7febe4018000 comp rx=0 tx=0).stop 2023-09-28T04:23:29.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.661+0000 7f553ffff700 1 -- 172.21.15.118:0/2850439559 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5518005560 con 0x7f5524004230 2023-09-28T04:23:29.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.661+0000 7febf19ff700 1 -- 172.21.15.118:0/1094212509 shutdown_connections 2023-09-28T04:23:29.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.661+0000 7febf19ff700 1 --2- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7febd8067480 0x7febd8069930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.661+0000 7febf19ff700 1 --2- 172.21.15.118:0/1094212509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febec15b4a0 0x7febec0c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.661+0000 7febf19ff700 1 --2- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7febec0c5110 0x7febec1545f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.661+0000 7febf19ff700 1 --2- 172.21.15.118:0/1094212509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febec153d10 0x7febec155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.661+0000 7febf19ff700 1 -- 172.21.15.118:0/1094212509 >> 172.21.15.118:0/1094212509 conn(0x7febec067630 msgr2=0x7febec0c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.662+0000 7febf19ff700 1 -- 172.21.15.118:0/1094212509 shutdown_connections 2023-09-28T04:23:29.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.662+0000 7febf19ff700 1 -- 172.21.15.118:0/1094212509 wait complete. 2023-09-28T04:23:29.663 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2023-09-28T04:23:29.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.661+0000 7f552dffb700 1 -- 172.21.15.118:0/2850439559 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5534009900 con 0x7f5524004230 2023-09-28T04:23:29.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.664+0000 7f553ffff700 1 -- 172.21.15.118:0/2850439559 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f551c0674b0 msgr2=0x7f551c069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.664+0000 7f553ffff700 1 --2- 172.21.15.118:0/2850439559 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f551c0674b0 0x7f551c069960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f553806a570 tx=0x7f5528009040 comp rx=0 tx=0).stop 2023-09-28T04:23:29.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.664+0000 7f553ffff700 1 -- 172.21.15.118:0/2850439559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5524004230 msgr2=0x7f5538156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.664+0000 7f553ffff700 1 --2- 172.21.15.118:0/2850439559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5524004230 0x7f5538156570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5534009fd0 tx=0x7f55340097c0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.665+0000 7f553ffff700 1 -- 172.21.15.118:0/2850439559 shutdown_connections 2023-09-28T04:23:29.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.665+0000 7f553ffff700 1 --2- 172.21.15.118:0/2850439559 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f551c0674b0 0x7f551c069960 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.665+0000 7f553ffff700 1 --2- 172.21.15.118:0/2850439559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55380b07d0 0x7f55380b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.665+0000 7f553ffff700 1 --2- 172.21.15.118:0/2850439559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5524004230 0x7f5538156570 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.665+0000 7f553ffff700 1 --2- 172.21.15.118:0/2850439559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f553816a720 0x7f55380b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.665+0000 7f553ffff700 1 -- 172.21.15.118:0/2850439559 >> 172.21.15.118:0/2850439559 conn(0x7f5538063cc0 msgr2=0x7f55381588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.666+0000 7f553ffff700 1 -- 172.21.15.118:0/2850439559 shutdown_connections 2023-09-28T04:23:29.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.666+0000 7f553ffff700 1 -- 172.21.15.118:0/2850439559 wait complete. 2023-09-28T04:23:29.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-09-28T04:23:29.675 DEBUG:teuthology.parallel:result is None 2023-09-28T04:23:29.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-09-28T04:23:29.682 DEBUG:teuthology.parallel:result is None 2023-09-28T04:23:29.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-09-28T04:23:29.686 DEBUG:teuthology.parallel:result is None 2023-09-28T04:23:29.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.689+0000 7f6806fff700 1 -- 172.21.15.118:0/1374763621 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6800071980 con 0x7f68000c0db0 2023-09-28T04:23:29.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-09-28T04:23:29.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.689+0000 7f67fcff9700 1 -- 172.21.15.118:0/1374763621 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67f8055950 con 0x7f68000c0db0 2023-09-28T04:23:29.690 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2023-09-28T04:23:29.690 DEBUG:teuthology.parallel:result is None 2023-09-28T04:23:29.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.692+0000 7f6806fff700 1 -- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f67ec067400 msgr2=0x7f67ec0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.692+0000 7f6806fff700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f67ec067400 0x7f67ec0698b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f68001519f0 tx=0x7f67f4009040 comp rx=0 tx=0).stop 2023-09-28T04:23:29.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.692+0000 7f6806fff700 1 -- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68000c0db0 msgr2=0x7f680014dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.692+0000 7f6806fff700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68000c0db0 0x7f680014dfb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f67f800cd30 tx=0x7f67f8001ac0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.692+0000 7f6806fff700 1 -- 172.21.15.118:0/1374763621 shutdown_connections 2023-09-28T04:23:29.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.693+0000 7f6806fff700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f67ec067400 0x7f67ec0698b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.693+0000 7f6806fff700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68000c4940 0x7f68000c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.693+0000 7f6806fff700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f68000c0db0 0x7f680014dfb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.693+0000 7f6806fff700 1 --2- 172.21.15.118:0/1374763621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68000c1180 0x7f68000c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.693+0000 7f6806fff700 1 -- 172.21.15.118:0/1374763621 >> 172.21.15.118:0/1374763621 conn(0x7f6800067630 msgr2=0x7f6800153970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.693+0000 7f6806fff700 1 -- 172.21.15.118:0/1374763621 shutdown_connections 2023-09-28T04:23:29.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.693+0000 7f6806fff700 1 -- 172.21.15.118:0/1374763621 wait complete. 2023-09-28T04:23:29.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.697+0000 7f8367dff700 1 -- 172.21.15.118:0/2265632807 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8360071980 con 0x7f83600c2680 2023-09-28T04:23:29.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.698+0000 7f8355ffb700 1 -- 172.21.15.118:0/2265632807 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8358055400 con 0x7f83600c2680 2023-09-28T04:23:29.698 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2023-09-28T04:23:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.702+0000 7f8367dff700 1 -- 172.21.15.118:0/2265632807 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8344067480 msgr2=0x7f8344069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.702+0000 7f8367dff700 1 --2- 172.21.15.118:0/2265632807 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8344067480 0x7f8344069930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f835c00bc50 tx=0x7f835c01a000 comp rx=0 tx=0).stop 2023-09-28T04:23:29.703 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.702+0000 7f8367dff700 1 -- 172.21.15.118:0/2265632807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83600c2680 msgr2=0x7f83600c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.702+0000 7f8367dff700 1 --2- 172.21.15.118:0/2265632807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83600c2680 0x7f83600c6850 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f835800cd30 tx=0x7f8358005450 comp rx=0 tx=0).stop 2023-09-28T04:23:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.702+0000 7f8367dff700 1 -- 172.21.15.118:0/2265632807 shutdown_connections 2023-09-28T04:23:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.702+0000 7f8367dff700 1 --2- 172.21.15.118:0/2265632807 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8344067480 0x7f8344069930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.702+0000 7f8367dff700 1 --2- 172.21.15.118:0/2265632807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8360152250 0x7f836014f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.702+0000 7f8367dff700 1 --2- 172.21.15.118:0/2265632807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8360068140 0x7f83600c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.702+0000 7f8367dff700 1 --2- 172.21.15.118:0/2265632807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83600c2680 0x7f83600c6850 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.702+0000 7f8367dff700 1 -- 172.21.15.118:0/2265632807 >> 172.21.15.118:0/2265632807 conn(0x7f8360067630 msgr2=0x7f83600c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.702+0000 7f8367dff700 1 -- 172.21.15.118:0/2265632807 shutdown_connections 2023-09-28T04:23:29.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.702+0000 7f8367dff700 1 -- 172.21.15.118:0/2265632807 wait complete. 2023-09-28T04:23:29.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-09-28T04:23:29.719 DEBUG:teuthology.parallel:result is None 2023-09-28T04:23:29.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-09-28T04:23:29.725 DEBUG:teuthology.parallel:result is None 2023-09-28T04:23:29.734 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.734+0000 7f87b5fff700 1 -- 172.21.15.118:0/1631555911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f87b0071980 con 0x7f87b0153a20 2023-09-28T04:23:29.735 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.735+0000 7f87977fe700 1 -- 172.21.15.118:0/1631555911 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f87a0056da0 con 0x7f87b0153a20 2023-09-28T04:23:29.735 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2023-09-28T04:23:29.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.737+0000 7f87b5fff700 1 -- 172.21.15.118:0/1631555911 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f879c0674b0 msgr2=0x7f879c069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.737+0000 7f87b5fff700 1 --2- 172.21.15.118:0/1631555911 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f879c0674b0 0x7f879c069960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f87a8001d40 tx=0x7f87a8007de0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.737+0000 7f87b5fff700 1 -- 172.21.15.118:0/1631555911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87b0153a20 msgr2=0x7f87b014bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.737+0000 7f87b5fff700 1 --2- 172.21.15.118:0/1631555911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87b0153a20 0x7f87b014bcd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f87a00093f0 tx=0x7f87a0017000 comp rx=0 tx=0).stop 2023-09-28T04:23:29.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.737+0000 7f87b5fff700 1 -- 172.21.15.118:0/1631555911 shutdown_connections 2023-09-28T04:23:29.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.737+0000 7f87b5fff700 1 --2- 172.21.15.118:0/1631555911 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f879c0674b0 0x7f879c069960 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.737+0000 7f87b5fff700 1 --2- 172.21.15.118:0/1631555911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87b015d9b0 0x7f87b014c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.737+0000 7f87b5fff700 1 --2- 172.21.15.118:0/1631555911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87b00c5110 0x7f87b00c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.737+0000 7f87b5fff700 1 --2- 172.21.15.118:0/1631555911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87b0153a20 0x7f87b014bcd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.737+0000 7f87b5fff700 1 -- 172.21.15.118:0/1631555911 >> 172.21.15.118:0/1631555911 conn(0x7f87b0067630 msgr2=0x7f87b0157680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.737+0000 7f87b5fff700 1 -- 172.21.15.118:0/1631555911 shutdown_connections 2023-09-28T04:23:29.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.737+0000 7f87b5fff700 1 -- 172.21.15.118:0/1631555911 wait complete. 2023-09-28T04:23:29.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-09-28T04:23:29.755 DEBUG:teuthology.parallel:result is None 2023-09-28T04:23:29.755 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-28T04:23:29.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T04:23:29.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.983+0000 7f771c7ff700 1 Processor -- start 2023-09-28T04:23:29.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.983+0000 7f771c7ff700 1 -- start start 2023-09-28T04:23:29.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.984+0000 7f771c7ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f771414fa90 0x7f7714156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.984+0000 7f771c7ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f77140c84c0 0x7f7714068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.984+0000 7f771c7ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77140c8030 con 0x7f771414fe60 2023-09-28T04:23:29.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.984+0000 7f771c7ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77140c7180 con 0x7f77140c84c0 2023-09-28T04:23:29.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.984+0000 7f771c7ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77140c7420 con 0x7f771414fa90 2023-09-28T04:23:29.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.984+0000 7f771a59b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f771414fa90 0x7f7714156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.984+0000 7f771ad9c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f77140c84c0 0x7f7714068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.984+0000 7f7719d9a700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f771414fe60 0x7f77140cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:50670/0 (socket says 172.21.15.118:50670) 2023-09-28T04:23:29.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.984+0000 7f7719d9a700 1 -- 172.21.15.118:0/200941127 learned_addr learned my addr 172.21.15.118:0/200941127 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:29.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.985+0000 7f7719599700 1 -- 172.21.15.118:0/200941127 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415399099 0 0) 0x7f77140c8030 con 0x7f771414fe60 2023-09-28T04:23:29.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.985+0000 7f7719599700 1 -- 172.21.15.118:0/200941127 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7700003570 con 0x7f771414fe60 2023-09-28T04:23:29.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.985+0000 7f771a59b700 1 -- 172.21.15.118:0/200941127 >> v2:172.21.15.174:3300/0 conn(0x7f77140c84c0 msgr2=0x7f7714068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:29.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.985+0000 7f771a59b700 1 --2- 172.21.15.118:0/200941127 >> v2:172.21.15.174:3300/0 conn(0x7f77140c84c0 0x7f7714068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.985+0000 7f771a59b700 1 -- 172.21.15.118:0/200941127 >> v1:172.21.15.174:6789/0 conn(0x7f771414fe60 legacy=0x7f77140cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.985+0000 7f771a59b700 1 -- 172.21.15.118:0/200941127 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77140c7700 con 0x7f771414fa90 2023-09-28T04:23:29.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.985+0000 7f771ad9c700 1 --2- 172.21.15.118:0/200941127 >> v2:172.21.15.174:3300/0 conn(0x7f77140c84c0 0x7f7714068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:29.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.985+0000 7f771a59b700 1 --2- 172.21.15.118:0/200941127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f771414fa90 0x7f7714156430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f77100098e0 tx=0x7f77100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f5cfd5866864960 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.985+0000 7f7719599700 1 -- 172.21.15.118:0/200941127 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710011630 con 0x7f771414fa90 2023-09-28T04:23:29.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.985+0000 7f7719599700 1 -- 172.21.15.118:0/200941127 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7710011790 con 0x7f771414fa90 2023-09-28T04:23:29.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.985+0000 7f7719599700 1 -- 172.21.15.118:0/200941127 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710011b30 con 0x7f771414fa90 2023-09-28T04:23:29.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.986+0000 7f771c7ff700 1 -- 172.21.15.118:0/200941127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f771414fa90 msgr2=0x7f7714156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.986+0000 7f771c7ff700 1 --2- 172.21.15.118:0/200941127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f771414fa90 0x7f7714156430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f77100098e0 tx=0x7f77100091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.986+0000 7f771c7ff700 1 -- 172.21.15.118:0/200941127 shutdown_connections 2023-09-28T04:23:29.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.986+0000 7f771c7ff700 1 --2- 172.21.15.118:0/200941127 >> v2:172.21.15.174:3300/0 conn(0x7f77140c84c0 0x7f7714068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.986+0000 7f771c7ff700 1 --2- 172.21.15.118:0/200941127 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f771414fa90 0x7f7714156430 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.986+0000 7f771c7ff700 1 -- 172.21.15.118:0/200941127 >> 172.21.15.118:0/200941127 conn(0x7f7714063cd0 msgr2=0x7f77140cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:29.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.986+0000 7f771c7ff700 1 -- 172.21.15.118:0/200941127 shutdown_connections 2023-09-28T04:23:29.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.986+0000 7f771c7ff700 1 -- 172.21.15.118:0/200941127 wait complete. 2023-09-28T04:23:29.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.987+0000 7f771c7ff700 1 Processor -- start 2023-09-28T04:23:29.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.988+0000 7f771c7ff700 1 -- start start 2023-09-28T04:23:29.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.988+0000 7f771c7ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77140c84c0 0x7f77140c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.988+0000 7f771c7ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f771414fa90 0x7f7714152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.988+0000 7f771c7ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f771414fe60 0x7f7714168db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.988+0000 7f771c7ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7714169bb0 con 0x7f771414fa90 2023-09-28T04:23:29.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.989+0000 7f771c7ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77140c5690 con 0x7f771414fe60 2023-09-28T04:23:29.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.989+0000 7f771c7ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77140c4a10 con 0x7f77140c84c0 2023-09-28T04:23:29.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.989+0000 7f7719d9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f771414fa90 0x7f7714152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.989+0000 7f7719d9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f771414fa90 0x7f7714152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51042/0 (socket says 172.21.15.118:51042) 2023-09-28T04:23:29.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.989+0000 7f7719d9a700 1 -- 172.21.15.118:0/3645159258 learned_addr learned my addr 172.21.15.118:0/3645159258 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:29.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.989+0000 7f771a59b700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77140c84c0 0x7f77140c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.989+0000 7f771ad9c700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f771414fe60 0x7f7714168db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.989+0000 7f7719d9a700 1 -- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77140c84c0 msgr2=0x7f77140c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.989+0000 7f7719d9a700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77140c84c0 0x7f77140c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.989+0000 7f7719d9a700 1 -- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f771414fe60 msgr2=0x7f7714168db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:29.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.989+0000 7f7719d9a700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f771414fe60 0x7f7714168db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:29.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.989+0000 7f7719d9a700 1 -- 172.21.15.118:0/3645159258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009a20 con 0x7f771414fa90 2023-09-28T04:23:29.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.989+0000 7f7719d9a700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f771414fa90 0x7f7714152ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f770400c590 tx=0x7f7704007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.990+0000 7f770a7fc700 1 -- 172.21.15.118:0/3645159258 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7704005c00 con 0x7f771414fa90 2023-09-28T04:23:29.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.990+0000 7f770a7fc700 1 -- 172.21.15.118:0/3645159258 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7704005d60 con 0x7f771414fa90 2023-09-28T04:23:29.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.990+0000 7f771c7ff700 1 -- 172.21.15.118:0/3645159258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7710009420 con 0x7f771414fa90 2023-09-28T04:23:29.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.990+0000 7f770a7fc700 1 -- 172.21.15.118:0/3645159258 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7704007300 con 0x7f771414fa90 2023-09-28T04:23:29.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.990+0000 7f771c7ff700 1 -- 172.21.15.118:0/3645159258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77140c5320 con 0x7f771414fa90 2023-09-28T04:23:29.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.991+0000 7f771c7ff700 1 -- 172.21.15.118:0/3645159258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7714071980 con 0x7f771414fa90 2023-09-28T04:23:29.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.992+0000 7f770a7fc700 1 -- 172.21.15.118:0/3645159258 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f770401b3b0 con 0x7f771414fa90 2023-09-28T04:23:29.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.992+0000 7f770a7fc700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f76f8067360 0x7f76f8069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:29.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.993+0000 7f770a7fc700 1 -- 172.21.15.118:0/3645159258 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f77040840a0 con 0x7f771414fa90 2023-09-28T04:23:29.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.993+0000 7f771a59b700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f76f8067360 0x7f76f8069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:29.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.993+0000 7f771a59b700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f76f8067360 0x7f76f8069810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f77100091e0 tx=0x7f7710017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:29.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:29.997+0000 7f770a7fc700 1 -- 172.21.15.118:0/3645159258 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7704050fc0 con 0x7f771414fa90 2023-09-28T04:23:30.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.182+0000 7f771c7ff700 1 -- 172.21.15.118:0/3645159258 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77140c57d0 con 0x7f76f8067360 2023-09-28T04:23:30.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.191+0000 7f770a7fc700 1 -- 172.21.15.118:0/3645159258 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284744 (secure 0 0 0) 0x7f77140c57d0 con 0x7f76f8067360 2023-09-28T04:23:30.195 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:30.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.195+0000 7f771c7ff700 1 -- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f76f8067360 msgr2=0x7f76f8069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:30.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.195+0000 7f771c7ff700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f76f8067360 0x7f76f8069810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f77100091e0 tx=0x7f7710017000 comp rx=0 tx=0).stop 2023-09-28T04:23:30.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.195+0000 7f771c7ff700 1 -- 172.21.15.118:0/3645159258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f771414fa90 msgr2=0x7f7714152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:30.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.195+0000 7f771c7ff700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f771414fa90 0x7f7714152ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f770400c590 tx=0x7f7704007dd0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.195+0000 7f771c7ff700 1 -- 172.21.15.118:0/3645159258 shutdown_connections 2023-09-28T04:23:30.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.195+0000 7f771c7ff700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f76f8067360 0x7f76f8069810 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.195+0000 7f771c7ff700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f771414fe60 0x7f7714168db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.195+0000 7f771c7ff700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77140c84c0 0x7f77140c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.195+0000 7f771c7ff700 1 --2- 172.21.15.118:0/3645159258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f771414fa90 0x7f7714152ca0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.195+0000 7f771c7ff700 1 -- 172.21.15.118:0/3645159258 >> 172.21.15.118:0/3645159258 conn(0x7f7714063cd0 msgr2=0x7f771414bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:30.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.195+0000 7f771c7ff700 1 -- 172.21.15.118:0/3645159258 shutdown_connections 2023-09-28T04:23:30.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.195+0000 7f771c7ff700 1 -- 172.21.15.118:0/3645159258 wait complete. 2023-09-28T04:23:30.198 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-09-28T04:23:30.213 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-09-28T04:23:28.527013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68192,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":66240,"kb_avail":754906528,"statfs":{"total":773094113280,"available":773024284672,"internally_reserved":0,"allocated":1933312,"data_stored":1819180,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":67829760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002658"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401799+0000","last_change":"2023-09-28T04:23:18.400475+0000","last_active":"2023-09-28T04:23:18.401799+0000","last_peered":"2023-09-28T04:23:18.401799+0000","last_clean":"2023-09-28T04:23:18.401799+0000","last_became_active":"2023-09-28T04:23:18.400107+0000","last_became_peered":"2023-09-28T04:23:18.400107+0000","last_unstale":"2023-09-28T04:23:18.401799+0000","last_undegraded":"2023-09-28T04:23:18.401799+0000","last_fullsized":"2023-09-28T04:23:18.401799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:44.340279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391569+0000","last_change":"2023-09-28T04:23:18.385136+0000","last_active":"2023-09-28T04:23:18.391569+0000","last_peered":"2023-09-28T04:23:18.391569+0000","last_clean":"2023-09-28T04:23:18.391569+0000","last_became_active":"2023-09-28T04:23:18.384789+0000","last_became_peered":"2023-09-28T04:23:18.384789+0000","last_unstale":"2023-09-28T04:23:18.391569+0000","last_undegraded":"2023-09-28T04:23:18.391569+0000","last_fullsized":"2023-09-28T04:23:18.391569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397939+0000","last_change":"2023-09-28T04:23:18.393700+0000","last_active":"2023-09-28T04:23:18.397939+0000","last_peered":"2023-09-28T04:23:18.397939+0000","last_clean":"2023-09-28T04:23:18.397939+0000","last_became_active":"2023-09-28T04:23:18.390599+0000","last_became_peered":"2023-09-28T04:23:18.390599+0000","last_unstale":"2023-09-28T04:23:18.397939+0000","last_undegraded":"2023-09-28T04:23:18.397939+0000","last_fullsized":"2023-09-28T04:23:18.397939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:43:19.782618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392953+0000","last_change":"2023-09-28T04:23:18.390865+0000","last_active":"2023-09-28T04:23:18.392953+0000","last_peered":"2023-09-28T04:23:18.392953+0000","last_clean":"2023-09-28T04:23:18.392953+0000","last_became_active":"2023-09-28T04:23:18.390607+0000","last_became_peered":"2023-09-28T04:23:18.390607+0000","last_unstale":"2023-09-28T04:23:18.392953+0000","last_undegraded":"2023-09-28T04:23:18.392953+0000","last_fullsized":"2023-09-28T04:23:18.392953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.405585+0000","last_change":"2023-09-28T04:23:18.404215+0000","last_active":"2023-09-28T04:23:18.405585+0000","last_peered":"2023-09-28T04:23:18.405585+0000","last_clean":"2023-09-28T04:23:18.405585+0000","last_became_active":"2023-09-28T04:23:18.403960+0000","last_became_peered":"2023-09-28T04:23:18.403960+0000","last_unstale":"2023-09-28T04:23:18.405585+0000","last_undegraded":"2023-09-28T04:23:18.405585+0000","last_fullsized":"2023-09-28T04:23:18.405585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397969+0000","last_change":"2023-09-28T04:23:18.393987+0000","last_active":"2023-09-28T04:23:18.397969+0000","last_peered":"2023-09-28T04:23:18.397969+0000","last_clean":"2023-09-28T04:23:18.397969+0000","last_became_active":"2023-09-28T04:23:18.390575+0000","last_became_peered":"2023-09-28T04:23:18.390575+0000","last_unstale":"2023-09-28T04:23:18.397969+0000","last_undegraded":"2023-09-28T04:23:18.397969+0000","last_fullsized":"2023-09-28T04:23:18.397969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:24:51.659204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400984+0000","last_change":"2023-09-28T04:23:18.396733+0000","last_active":"2023-09-28T04:23:18.400984+0000","last_peered":"2023-09-28T04:23:18.400984+0000","last_clean":"2023-09-28T04:23:18.400984+0000","last_became_active":"2023-09-28T04:23:18.396038+0000","last_became_peered":"2023-09-28T04:23:18.396038+0000","last_unstale":"2023-09-28T04:23:18.400984+0000","last_undegraded":"2023-09-28T04:23:18.400984+0000","last_fullsized":"2023-09-28T04:23:18.400984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391542+0000","last_change":"2023-09-28T04:23:18.388208+0000","last_active":"2023-09-28T04:23:18.391542+0000","last_peered":"2023-09-28T04:23:18.391542+0000","last_clean":"2023-09-28T04:23:18.391542+0000","last_became_active":"2023-09-28T04:23:18.387260+0000","last_became_peered":"2023-09-28T04:23:18.387260+0000","last_unstale":"2023-09-28T04:23:18.391542+0000","last_undegraded":"2023-09-28T04:23:18.391542+0000","last_fullsized":"2023-09-28T04:23:18.391542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.405212+0000","last_change":"2023-09-28T04:23:18.403803+0000","last_active":"2023-09-28T04:23:18.405212+0000","last_peered":"2023-09-28T04:23:18.405212+0000","last_clean":"2023-09-28T04:23:18.405212+0000","last_became_active":"2023-09-28T04:23:18.403565+0000","last_became_peered":"2023-09-28T04:23:18.403565+0000","last_unstale":"2023-09-28T04:23:18.405212+0000","last_undegraded":"2023-09-28T04:23:18.405212+0000","last_fullsized":"2023-09-28T04:23:18.405212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397774+0000","last_change":"2023-09-28T04:23:18.392418+0000","last_active":"2023-09-28T04:23:18.397774+0000","last_peered":"2023-09-28T04:23:18.397774+0000","last_clean":"2023-09-28T04:23:18.397774+0000","last_became_active":"2023-09-28T04:23:18.390911+0000","last_became_peered":"2023-09-28T04:23:18.390911+0000","last_unstale":"2023-09-28T04:23:18.397774+0000","last_undegraded":"2023-09-28T04:23:18.397774+0000","last_fullsized":"2023-09-28T04:23:18.397774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397957+0000","last_change":"2023-09-28T04:23:18.393845+0000","last_active":"2023-09-28T04:23:18.397957+0000","last_peered":"2023-09-28T04:23:18.397957+0000","last_clean":"2023-09-28T04:23:18.397957+0000","last_became_active":"2023-09-28T04:23:18.393524+0000","last_became_peered":"2023-09-28T04:23:18.393524+0000","last_unstale":"2023-09-28T04:23:18.397957+0000","last_undegraded":"2023-09-28T04:23:18.397957+0000","last_fullsized":"2023-09-28T04:23:18.397957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:27:39.596054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390755+0000","last_change":"2023-09-28T04:23:18.385250+0000","last_active":"2023-09-28T04:23:18.390755+0000","last_peered":"2023-09-28T04:23:18.390755+0000","last_clean":"2023-09-28T04:23:18.390755+0000","last_became_active":"2023-09-28T04:23:18.384986+0000","last_became_peered":"2023-09-28T04:23:18.384986+0000","last_unstale":"2023-09-28T04:23:18.390755+0000","last_undegraded":"2023-09-28T04:23:18.390755+0000","last_fullsized":"2023-09-28T04:23:18.390755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:15.500469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404651+0000","last_change":"2023-09-28T04:23:18.402417+0000","last_active":"2023-09-28T04:23:18.404651+0000","last_peered":"2023-09-28T04:23:18.404651+0000","last_clean":"2023-09-28T04:23:18.404651+0000","last_became_active":"2023-09-28T04:23:18.402161+0000","last_became_peered":"2023-09-28T04:23:18.402161+0000","last_unstale":"2023-09-28T04:23:18.404651+0000","last_undegraded":"2023-09-28T04:23:18.404651+0000","last_fullsized":"2023-09-28T04:23:18.404651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:50.909915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391345+0000","last_change":"2023-09-28T04:23:18.387808+0000","last_active":"2023-09-28T04:23:18.391345+0000","last_peered":"2023-09-28T04:23:18.391345+0000","last_clean":"2023-09-28T04:23:18.391345+0000","last_became_active":"2023-09-28T04:23:18.387471+0000","last_became_peered":"2023-09-28T04:23:18.387471+0000","last_unstale":"2023-09-28T04:23:18.391345+0000","last_undegraded":"2023-09-28T04:23:18.391345+0000","last_fullsized":"2023-09-28T04:23:18.391345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401004+0000","last_change":"2023-09-28T04:23:18.396945+0000","last_active":"2023-09-28T04:23:18.401004+0000","last_peered":"2023-09-28T04:23:18.401004+0000","last_clean":"2023-09-28T04:23:18.401004+0000","last_became_active":"2023-09-28T04:23:18.396395+0000","last_became_peered":"2023-09-28T04:23:18.396395+0000","last_unstale":"2023-09-28T04:23:18.401004+0000","last_undegraded":"2023-09-28T04:23:18.401004+0000","last_fullsized":"2023-09-28T04:23:18.401004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397971+0000","last_change":"2023-09-28T04:23:18.393975+0000","last_active":"2023-09-28T04:23:18.397971+0000","last_peered":"2023-09-28T04:23:18.397971+0000","last_clean":"2023-09-28T04:23:18.397971+0000","last_became_active":"2023-09-28T04:23:18.393683+0000","last_became_peered":"2023-09-28T04:23:18.393683+0000","last_unstale":"2023-09-28T04:23:18.397971+0000","last_undegraded":"2023-09-28T04:23:18.397971+0000","last_fullsized":"2023-09-28T04:23:18.397971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:06:40.927453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404561+0000","last_change":"2023-09-28T04:23:18.402518+0000","last_active":"2023-09-28T04:23:18.404561+0000","last_peered":"2023-09-28T04:23:18.404561+0000","last_clean":"2023-09-28T04:23:18.404561+0000","last_became_active":"2023-09-28T04:23:18.402275+0000","last_became_peered":"2023-09-28T04:23:18.402275+0000","last_unstale":"2023-09-28T04:23:18.404561+0000","last_undegraded":"2023-09-28T04:23:18.404561+0000","last_fullsized":"2023-09-28T04:23:18.404561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400750+0000","last_change":"2023-09-28T04:23:18.395032+0000","last_active":"2023-09-28T04:23:18.400750+0000","last_peered":"2023-09-28T04:23:18.400750+0000","last_clean":"2023-09-28T04:23:18.400750+0000","last_became_active":"2023-09-28T04:23:18.390678+0000","last_became_peered":"2023-09-28T04:23:18.390678+0000","last_unstale":"2023-09-28T04:23:18.400750+0000","last_undegraded":"2023-09-28T04:23:18.400750+0000","last_fullsized":"2023-09-28T04:23:18.400750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390373+0000","last_change":"2023-09-28T04:23:18.385209+0000","last_active":"2023-09-28T04:23:18.390373+0000","last_peered":"2023-09-28T04:23:18.390373+0000","last_clean":"2023-09-28T04:23:18.390373+0000","last_became_active":"2023-09-28T04:23:18.384916+0000","last_became_peered":"2023-09-28T04:23:18.384916+0000","last_unstale":"2023-09-28T04:23:18.390373+0000","last_undegraded":"2023-09-28T04:23:18.390373+0000","last_fullsized":"2023-09-28T04:23:18.390373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:06.937552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397758+0000","last_change":"2023-09-28T04:23:18.386692+0000","last_active":"2023-09-28T04:23:18.397758+0000","last_peered":"2023-09-28T04:23:18.397758+0000","last_clean":"2023-09-28T04:23:18.397758+0000","last_became_active":"2023-09-28T04:23:18.385805+0000","last_became_peered":"2023-09-28T04:23:18.385805+0000","last_unstale":"2023-09-28T04:23:18.397758+0000","last_undegraded":"2023-09-28T04:23:18.397758+0000","last_fullsized":"2023-09-28T04:23:18.397758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:52:07.899487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401120+0000","last_change":"2023-09-28T04:23:18.400497+0000","last_active":"2023-09-28T04:23:18.401120+0000","last_peered":"2023-09-28T04:23:18.401120+0000","last_clean":"2023-09-28T04:23:18.401120+0000","last_became_active":"2023-09-28T04:23:18.400230+0000","last_became_peered":"2023-09-28T04:23:18.400230+0000","last_unstale":"2023-09-28T04:23:18.401120+0000","last_undegraded":"2023-09-28T04:23:18.401120+0000","last_fullsized":"2023-09-28T04:23:18.401120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399068+0000","last_change":"2023-09-28T04:23:18.391683+0000","last_active":"2023-09-28T04:23:18.399068+0000","last_peered":"2023-09-28T04:23:18.399068+0000","last_clean":"2023-09-28T04:23:18.399068+0000","last_became_active":"2023-09-28T04:23:18.391373+0000","last_became_peered":"2023-09-28T04:23:18.391373+0000","last_unstale":"2023-09-28T04:23:18.399068+0000","last_undegraded":"2023-09-28T04:23:18.399068+0000","last_fullsized":"2023-09-28T04:23:18.399068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402238+0000","last_change":"2023-09-28T04:23:18.393381+0000","last_active":"2023-09-28T04:23:18.402238+0000","last_peered":"2023-09-28T04:23:18.402238+0000","last_clean":"2023-09-28T04:23:18.402238+0000","last_became_active":"2023-09-28T04:23:18.392723+0000","last_became_peered":"2023-09-28T04:23:18.392723+0000","last_unstale":"2023-09-28T04:23:18.402238+0000","last_undegraded":"2023-09-28T04:23:18.402238+0000","last_fullsized":"2023-09-28T04:23:18.402238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.403069+0000","last_change":"2023-09-28T04:23:18.402467+0000","last_active":"2023-09-28T04:23:18.403069+0000","last_peered":"2023-09-28T04:23:18.403069+0000","last_clean":"2023-09-28T04:23:18.403069+0000","last_became_active":"2023-09-28T04:23:18.402197+0000","last_became_peered":"2023-09-28T04:23:18.402197+0000","last_unstale":"2023-09-28T04:23:18.403069+0000","last_undegraded":"2023-09-28T04:23:18.403069+0000","last_fullsized":"2023-09-28T04:23:18.403069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.396757+0000","last_change":"2023-09-28T04:23:18.389242+0000","last_active":"2023-09-28T04:23:18.396757+0000","last_peered":"2023-09-28T04:23:18.396757+0000","last_clean":"2023-09-28T04:23:18.396757+0000","last_became_active":"2023-09-28T04:23:18.388936+0000","last_became_peered":"2023-09-28T04:23:18.388936+0000","last_unstale":"2023-09-28T04:23:18.396757+0000","last_undegraded":"2023-09-28T04:23:18.396757+0000","last_fullsized":"2023-09-28T04:23:18.396757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:19.108476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395209+0000","last_change":"2023-09-28T04:23:18.388941+0000","last_active":"2023-09-28T04:23:18.395209+0000","last_peered":"2023-09-28T04:23:18.395209+0000","last_clean":"2023-09-28T04:23:18.395209+0000","last_became_active":"2023-09-28T04:23:18.388682+0000","last_became_peered":"2023-09-28T04:23:18.388682+0000","last_unstale":"2023-09-28T04:23:18.395209+0000","last_undegraded":"2023-09-28T04:23:18.395209+0000","last_fullsized":"2023-09-28T04:23:18.395209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395293+0000","last_change":"2023-09-28T04:23:18.391753+0000","last_active":"2023-09-28T04:23:18.395293+0000","last_peered":"2023-09-28T04:23:18.395293+0000","last_clean":"2023-09-28T04:23:18.395293+0000","last_became_active":"2023-09-28T04:23:18.391031+0000","last_became_peered":"2023-09-28T04:23:18.391031+0000","last_unstale":"2023-09-28T04:23:18.395293+0000","last_undegraded":"2023-09-28T04:23:18.395293+0000","last_fullsized":"2023-09-28T04:23:18.395293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377252+0000","last_change":"2023-09-28T04:23:17.914158+0000","last_active":"2023-09-28T04:23:19.377252+0000","last_peered":"2023-09-28T04:23:19.377252+0000","last_clean":"2023-09-28T04:23:19.377252+0000","last_became_active":"2023-09-28T04:23:17.913941+0000","last_became_peered":"2023-09-28T04:23:17.913941+0000","last_unstale":"2023-09-28T04:23:19.377252+0000","last_undegraded":"2023-09-28T04:23:19.377252+0000","last_fullsized":"2023-09-28T04:23:19.377252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401811+0000","last_change":"2023-09-28T04:23:18.390288+0000","last_active":"2023-09-28T04:23:18.401811+0000","last_peered":"2023-09-28T04:23:18.401811+0000","last_clean":"2023-09-28T04:23:18.401811+0000","last_became_active":"2023-09-28T04:23:18.390030+0000","last_became_peered":"2023-09-28T04:23:18.390030+0000","last_unstale":"2023-09-28T04:23:18.401811+0000","last_undegraded":"2023-09-28T04:23:18.401811+0000","last_fullsized":"2023-09-28T04:23:18.401811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377746+0000","last_change":"2023-09-28T04:23:17.914311+0000","last_active":"2023-09-28T04:23:18.377746+0000","last_peered":"2023-09-28T04:23:18.377746+0000","last_clean":"2023-09-28T04:23:18.377746+0000","last_became_active":"2023-09-28T04:23:17.913950+0000","last_became_peered":"2023-09-28T04:23:17.913950+0000","last_unstale":"2023-09-28T04:23:18.377746+0000","last_undegraded":"2023-09-28T04:23:18.377746+0000","last_fullsized":"2023-09-28T04:23:18.377746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399162+0000","last_change":"2023-09-28T04:23:18.393402+0000","last_active":"2023-09-28T04:23:18.399162+0000","last_peered":"2023-09-28T04:23:18.399162+0000","last_clean":"2023-09-28T04:23:18.399162+0000","last_became_active":"2023-09-28T04:23:18.393106+0000","last_became_peered":"2023-09-28T04:23:18.393106+0000","last_unstale":"2023-09-28T04:23:18.399162+0000","last_undegraded":"2023-09-28T04:23:18.399162+0000","last_fullsized":"2023-09-28T04:23:18.399162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.376291+0000","last_change":"2023-09-28T04:23:17.911104+0000","last_active":"2023-09-28T04:23:18.376291+0000","last_peered":"2023-09-28T04:23:18.376291+0000","last_clean":"2023-09-28T04:23:18.376291+0000","last_became_active":"2023-09-28T04:23:17.910766+0000","last_became_peered":"2023-09-28T04:23:17.910766+0000","last_unstale":"2023-09-28T04:23:18.376291+0000","last_undegraded":"2023-09-28T04:23:18.376291+0000","last_fullsized":"2023-09-28T04:23:18.376291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391763+0000","last_change":"2023-09-28T04:23:18.388098+0000","last_active":"2023-09-28T04:23:18.391763+0000","last_peered":"2023-09-28T04:23:18.391763+0000","last_clean":"2023-09-28T04:23:18.391763+0000","last_became_active":"2023-09-28T04:23:18.387581+0000","last_became_peered":"2023-09-28T04:23:18.387581+0000","last_unstale":"2023-09-28T04:23:18.391763+0000","last_undegraded":"2023-09-28T04:23:18.391763+0000","last_fullsized":"2023-09-28T04:23:18.391763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:11.090984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.387809+0000","last_change":"2023-09-28T04:23:17.917921+0000","last_active":"2023-09-28T04:23:18.387809+0000","last_peered":"2023-09-28T04:23:18.387809+0000","last_clean":"2023-09-28T04:23:18.387809+0000","last_became_active":"2023-09-28T04:23:17.917596+0000","last_became_peered":"2023-09-28T04:23:17.917596+0000","last_unstale":"2023-09-28T04:23:18.387809+0000","last_undegraded":"2023-09-28T04:23:18.387809+0000","last_fullsized":"2023-09-28T04:23:18.387809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402470+0000","last_change":"2023-09-28T04:23:18.394460+0000","last_active":"2023-09-28T04:23:18.402470+0000","last_peered":"2023-09-28T04:23:18.402470+0000","last_clean":"2023-09-28T04:23:18.402470+0000","last_became_active":"2023-09-28T04:23:18.391773+0000","last_became_peered":"2023-09-28T04:23:18.391773+0000","last_unstale":"2023-09-28T04:23:18.402470+0000","last_undegraded":"2023-09-28T04:23:18.402470+0000","last_fullsized":"2023-09-28T04:23:18.402470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379691+0000","last_change":"2023-09-28T04:23:17.908875+0000","last_active":"2023-09-28T04:23:18.379691+0000","last_peered":"2023-09-28T04:23:18.379691+0000","last_clean":"2023-09-28T04:23:18.379691+0000","last_became_active":"2023-09-28T04:23:17.908599+0000","last_became_peered":"2023-09-28T04:23:17.908599+0000","last_unstale":"2023-09-28T04:23:18.379691+0000","last_undegraded":"2023-09-28T04:23:18.379691+0000","last_fullsized":"2023-09-28T04:23:18.379691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402255+0000","last_change":"2023-09-28T04:23:18.393856+0000","last_active":"2023-09-28T04:23:18.402255+0000","last_peered":"2023-09-28T04:23:18.402255+0000","last_clean":"2023-09-28T04:23:18.402255+0000","last_became_active":"2023-09-28T04:23:18.393631+0000","last_became_peered":"2023-09-28T04:23:18.393631+0000","last_unstale":"2023-09-28T04:23:18.402255+0000","last_undegraded":"2023-09-28T04:23:18.402255+0000","last_fullsized":"2023-09-28T04:23:18.402255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.384618+0000","last_change":"2023-09-28T04:23:17.911594+0000","last_active":"2023-09-28T04:23:23.384618+0000","last_peered":"2023-09-28T04:23:23.384618+0000","last_clean":"2023-09-28T04:23:23.384618+0000","last_became_active":"2023-09-28T04:23:17.911361+0000","last_became_peered":"2023-09-28T04:23:17.911361+0000","last_unstale":"2023-09-28T04:23:23.384618+0000","last_undegraded":"2023-09-28T04:23:23.384618+0000","last_fullsized":"2023-09-28T04:23:23.384618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.394029+0000","last_change":"2023-09-28T04:23:18.387908+0000","last_active":"2023-09-28T04:23:18.394029+0000","last_peered":"2023-09-28T04:23:18.394029+0000","last_clean":"2023-09-28T04:23:18.394029+0000","last_became_active":"2023-09-28T04:23:18.387672+0000","last_became_peered":"2023-09-28T04:23:18.387672+0000","last_unstale":"2023-09-28T04:23:18.394029+0000","last_undegraded":"2023-09-28T04:23:18.394029+0000","last_fullsized":"2023-09-28T04:23:18.394029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.385837+0000","last_change":"2023-09-28T04:23:17.904974+0000","last_active":"2023-09-28T04:23:23.385837+0000","last_peered":"2023-09-28T04:23:23.385837+0000","last_clean":"2023-09-28T04:23:23.385837+0000","last_became_active":"2023-09-28T04:23:17.904734+0000","last_became_peered":"2023-09-28T04:23:17.904734+0000","last_unstale":"2023-09-28T04:23:23.385837+0000","last_undegraded":"2023-09-28T04:23:23.385837+0000","last_fullsized":"2023-09-28T04:23:23.385837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397872+0000","last_change":"2023-09-28T04:23:18.389128+0000","last_active":"2023-09-28T04:23:18.397872+0000","last_peered":"2023-09-28T04:23:18.397872+0000","last_clean":"2023-09-28T04:23:18.397872+0000","last_became_active":"2023-09-28T04:23:18.388871+0000","last_became_peered":"2023-09-28T04:23:18.388871+0000","last_unstale":"2023-09-28T04:23:18.397872+0000","last_undegraded":"2023-09-28T04:23:18.397872+0000","last_fullsized":"2023-09-28T04:23:18.397872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:33:50.957431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.384549+0000","last_change":"2023-09-28T04:23:17.910343+0000","last_active":"2023-09-28T04:23:23.384549+0000","last_peered":"2023-09-28T04:23:23.384549+0000","last_clean":"2023-09-28T04:23:23.384549+0000","last_became_active":"2023-09-28T04:23:17.909981+0000","last_became_peered":"2023-09-28T04:23:17.909981+0000","last_unstale":"2023-09-28T04:23:23.384549+0000","last_undegraded":"2023-09-28T04:23:23.384549+0000","last_fullsized":"2023-09-28T04:23:23.384549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:11.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402619+0000","last_change":"2023-09-28T04:23:18.391696+0000","last_active":"2023-09-28T04:23:18.402619+0000","last_peered":"2023-09-28T04:23:18.402619+0000","last_clean":"2023-09-28T04:23:18.402619+0000","last_became_active":"2023-09-28T04:23:18.391441+0000","last_became_peered":"2023-09-28T04:23:18.391441+0000","last_unstale":"2023-09-28T04:23:18.402619+0000","last_undegraded":"2023-09-28T04:23:18.402619+0000","last_fullsized":"2023-09-28T04:23:18.402619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388573+0000","last_change":"2023-09-28T04:23:17.916730+0000","last_active":"2023-09-28T04:23:18.388573+0000","last_peered":"2023-09-28T04:23:18.388573+0000","last_clean":"2023-09-28T04:23:18.388573+0000","last_became_active":"2023-09-28T04:23:17.916424+0000","last_became_peered":"2023-09-28T04:23:17.916424+0000","last_unstale":"2023-09-28T04:23:18.388573+0000","last_undegraded":"2023-09-28T04:23:18.388573+0000","last_fullsized":"2023-09-28T04:23:18.388573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392344+0000","last_change":"2023-09-28T04:23:18.391510+0000","last_active":"2023-09-28T04:23:18.392344+0000","last_peered":"2023-09-28T04:23:18.392344+0000","last_clean":"2023-09-28T04:23:18.392344+0000","last_became_active":"2023-09-28T04:23:18.390613+0000","last_became_peered":"2023-09-28T04:23:18.390613+0000","last_unstale":"2023-09-28T04:23:18.392344+0000","last_undegraded":"2023-09-28T04:23:18.392344+0000","last_fullsized":"2023-09-28T04:23:18.392344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386635+0000","last_change":"2023-09-28T04:23:17.910760+0000","last_active":"2023-09-28T04:23:18.386635+0000","last_peered":"2023-09-28T04:23:18.386635+0000","last_clean":"2023-09-28T04:23:18.386635+0000","last_became_active":"2023-09-28T04:23:17.910457+0000","last_became_peered":"2023-09-28T04:23:17.910457+0000","last_unstale":"2023-09-28T04:23:18.386635+0000","last_undegraded":"2023-09-28T04:23:18.386635+0000","last_fullsized":"2023-09-28T04:23:18.386635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:10.087083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404516+0000","last_change":"2023-09-28T04:23:18.402823+0000","last_active":"2023-09-28T04:23:18.404516+0000","last_peered":"2023-09-28T04:23:18.404516+0000","last_clean":"2023-09-28T04:23:18.404516+0000","last_became_active":"2023-09-28T04:23:18.402559+0000","last_became_peered":"2023-09-28T04:23:18.402559+0000","last_unstale":"2023-09-28T04:23:18.404516+0000","last_undegraded":"2023-09-28T04:23:18.404516+0000","last_fullsized":"2023-09-28T04:23:18.404516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.385101+0000","last_change":"2023-09-28T04:23:17.910972+0000","last_active":"2023-09-28T04:23:23.385101+0000","last_peered":"2023-09-28T04:23:23.385101+0000","last_clean":"2023-09-28T04:23:23.385101+0000","last_became_active":"2023-09-28T04:23:17.910650+0000","last_became_peered":"2023-09-28T04:23:17.910650+0000","last_unstale":"2023-09-28T04:23:23.385101+0000","last_undegraded":"2023-09-28T04:23:23.385101+0000","last_fullsized":"2023-09-28T04:23:23.385101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:03:36.553513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402556+0000","last_change":"2023-09-28T04:23:18.395424+0000","last_active":"2023-09-28T04:23:18.402556+0000","last_peered":"2023-09-28T04:23:18.402556+0000","last_clean":"2023-09-28T04:23:18.402556+0000","last_became_active":"2023-09-28T04:23:18.394721+0000","last_became_peered":"2023-09-28T04:23:18.394721+0000","last_unstale":"2023-09-28T04:23:18.402556+0000","last_undegraded":"2023-09-28T04:23:18.402556+0000","last_fullsized":"2023-09-28T04:23:18.402556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.173007+0000","last_change":"2023-09-28T04:23:17.907642+0000","last_active":"2023-09-28T04:23:20.173007+0000","last_peered":"2023-09-28T04:23:20.173007+0000","last_clean":"2023-09-28T04:23:20.173007+0000","last_became_active":"2023-09-28T04:23:17.907331+0000","last_became_peered":"2023-09-28T04:23:17.907331+0000","last_unstale":"2023-09-28T04:23:20.173007+0000","last_undegraded":"2023-09-28T04:23:20.173007+0000","last_fullsized":"2023-09-28T04:23:20.173007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.393277+0000","last_change":"2023-09-28T04:23:18.390910+0000","last_active":"2023-09-28T04:23:18.393277+0000","last_peered":"2023-09-28T04:23:18.393277+0000","last_clean":"2023-09-28T04:23:18.393277+0000","last_became_active":"2023-09-28T04:23:18.390633+0000","last_became_peered":"2023-09-28T04:23:18.390633+0000","last_unstale":"2023-09-28T04:23:18.393277+0000","last_undegraded":"2023-09-28T04:23:18.393277+0000","last_fullsized":"2023-09-28T04:23:18.393277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.383758+0000","last_change":"2023-09-28T04:23:17.906320+0000","last_active":"2023-09-28T04:23:23.383758+0000","last_peered":"2023-09-28T04:23:23.383758+0000","last_clean":"2023-09-28T04:23:23.383758+0000","last_became_active":"2023-09-28T04:23:17.906036+0000","last_became_peered":"2023-09-28T04:23:17.906036+0000","last_unstale":"2023-09-28T04:23:23.383758+0000","last_undegraded":"2023-09-28T04:23:23.383758+0000","last_fullsized":"2023-09-28T04:23:23.383758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397773+0000","last_change":"2023-09-28T04:23:18.386196+0000","last_active":"2023-09-28T04:23:18.397773+0000","last_peered":"2023-09-28T04:23:18.397773+0000","last_clean":"2023-09-28T04:23:18.397773+0000","last_became_active":"2023-09-28T04:23:18.385693+0000","last_became_peered":"2023-09-28T04:23:18.385693+0000","last_unstale":"2023-09-28T04:23:18.397773+0000","last_undegraded":"2023-09-28T04:23:18.397773+0000","last_fullsized":"2023-09-28T04:23:18.397773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172978+0000","last_change":"2023-09-28T04:23:17.908768+0000","last_active":"2023-09-28T04:23:20.172978+0000","last_peered":"2023-09-28T04:23:20.172978+0000","last_clean":"2023-09-28T04:23:20.172978+0000","last_became_active":"2023-09-28T04:23:17.908493+0000","last_became_peered":"2023-09-28T04:23:17.908493+0000","last_unstale":"2023-09-28T04:23:20.172978+0000","last_undegraded":"2023-09-28T04:23:20.172978+0000","last_fullsized":"2023-09-28T04:23:20.172978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388563+0000","last_change":"2023-09-28T04:23:18.385404+0000","last_active":"2023-09-28T04:23:18.388563+0000","last_peered":"2023-09-28T04:23:18.388563+0000","last_clean":"2023-09-28T04:23:18.388563+0000","last_became_active":"2023-09-28T04:23:18.385112+0000","last_became_peered":"2023-09-28T04:23:18.385112+0000","last_unstale":"2023-09-28T04:23:18.388563+0000","last_undegraded":"2023-09-28T04:23:18.388563+0000","last_fullsized":"2023-09-28T04:23:18.388563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:06.331056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378811+0000","last_change":"2023-09-28T04:23:17.898518+0000","last_active":"2023-09-28T04:23:18.378811+0000","last_peered":"2023-09-28T04:23:18.378811+0000","last_clean":"2023-09-28T04:23:18.378811+0000","last_became_active":"2023-09-28T04:23:17.898232+0000","last_became_peered":"2023-09-28T04:23:17.898232+0000","last_unstale":"2023-09-28T04:23:18.378811+0000","last_undegraded":"2023-09-28T04:23:18.378811+0000","last_fullsized":"2023-09-28T04:23:18.378811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399188+0000","last_change":"2023-09-28T04:23:18.392206+0000","last_active":"2023-09-28T04:23:18.399188+0000","last_peered":"2023-09-28T04:23:18.399188+0000","last_clean":"2023-09-28T04:23:18.399188+0000","last_became_active":"2023-09-28T04:23:18.391963+0000","last_became_peered":"2023-09-28T04:23:18.391963+0000","last_unstale":"2023-09-28T04:23:18.399188+0000","last_undegraded":"2023-09-28T04:23:18.399188+0000","last_fullsized":"2023-09-28T04:23:18.399188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.381142+0000","last_change":"2023-09-28T04:23:17.905390+0000","last_active":"2023-09-28T04:23:23.381142+0000","last_peered":"2023-09-28T04:23:23.381142+0000","last_clean":"2023-09-28T04:23:23.381142+0000","last_became_active":"2023-09-28T04:23:17.905089+0000","last_became_peered":"2023-09-28T04:23:17.905089+0000","last_unstale":"2023-09-28T04:23:23.381142+0000","last_undegraded":"2023-09-28T04:23:23.381142+0000","last_fullsized":"2023-09-28T04:23:23.381142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401474+0000","last_change":"2023-09-28T04:23:18.400110+0000","last_active":"2023-09-28T04:23:18.401474+0000","last_peered":"2023-09-28T04:23:18.401474+0000","last_clean":"2023-09-28T04:23:18.401474+0000","last_became_active":"2023-09-28T04:23:18.399839+0000","last_became_peered":"2023-09-28T04:23:18.399839+0000","last_unstale":"2023-09-28T04:23:18.401474+0000","last_undegraded":"2023-09-28T04:23:18.401474+0000","last_fullsized":"2023-09-28T04:23:18.401474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377378+0000","last_change":"2023-09-28T04:23:17.912734+0000","last_active":"2023-09-28T04:23:18.377378+0000","last_peered":"2023-09-28T04:23:18.377378+0000","last_clean":"2023-09-28T04:23:18.377378+0000","last_became_active":"2023-09-28T04:23:17.912560+0000","last_became_peered":"2023-09-28T04:23:17.912560+0000","last_unstale":"2023-09-28T04:23:18.377378+0000","last_undegraded":"2023-09-28T04:23:18.377378+0000","last_fullsized":"2023-09-28T04:23:18.377378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397919+0000","last_change":"2023-09-28T04:23:18.393554+0000","last_active":"2023-09-28T04:23:18.397919+0000","last_peered":"2023-09-28T04:23:18.397919+0000","last_clean":"2023-09-28T04:23:18.397919+0000","last_became_active":"2023-09-28T04:23:18.390268+0000","last_became_peered":"2023-09-28T04:23:18.390268+0000","last_unstale":"2023-09-28T04:23:18.397919+0000","last_undegraded":"2023-09-28T04:23:18.397919+0000","last_fullsized":"2023-09-28T04:23:18.397919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.381608+0000","last_change":"2023-09-28T04:23:17.911218+0000","last_active":"2023-09-28T04:23:18.381608+0000","last_peered":"2023-09-28T04:23:18.381608+0000","last_clean":"2023-09-28T04:23:18.381608+0000","last_became_active":"2023-09-28T04:23:17.910887+0000","last_became_peered":"2023-09-28T04:23:17.910887+0000","last_unstale":"2023-09-28T04:23:18.381608+0000","last_undegraded":"2023-09-28T04:23:18.381608+0000","last_fullsized":"2023-09-28T04:23:18.381608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397818+0000","last_change":"2023-09-28T04:23:18.387932+0000","last_active":"2023-09-28T04:23:18.397818+0000","last_peered":"2023-09-28T04:23:18.397818+0000","last_clean":"2023-09-28T04:23:18.397818+0000","last_became_active":"2023-09-28T04:23:18.387667+0000","last_became_peered":"2023-09-28T04:23:18.387667+0000","last_unstale":"2023-09-28T04:23:18.397818+0000","last_undegraded":"2023-09-28T04:23:18.397818+0000","last_fullsized":"2023-09-28T04:23:18.397818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:46:23.383130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.376247+0000","last_change":"2023-09-28T04:23:17.911764+0000","last_active":"2023-09-28T04:23:18.376247+0000","last_peered":"2023-09-28T04:23:18.376247+0000","last_clean":"2023-09-28T04:23:18.376247+0000","last_became_active":"2023-09-28T04:23:17.911458+0000","last_became_peered":"2023-09-28T04:23:17.911458+0000","last_unstale":"2023-09-28T04:23:18.376247+0000","last_undegraded":"2023-09-28T04:23:18.376247+0000","last_fullsized":"2023-09-28T04:23:18.376247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402635+0000","last_change":"2023-09-28T04:23:18.400278+0000","last_active":"2023-09-28T04:23:18.402635+0000","last_peered":"2023-09-28T04:23:18.402635+0000","last_clean":"2023-09-28T04:23:18.402635+0000","last_became_active":"2023-09-28T04:23:18.399957+0000","last_became_peered":"2023-09-28T04:23:18.399957+0000","last_unstale":"2023-09-28T04:23:18.402635+0000","last_undegraded":"2023-09-28T04:23:18.402635+0000","last_fullsized":"2023-09-28T04:23:18.402635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:01:52.295558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377068+0000","last_change":"2023-09-28T04:23:13.017727+0000","last_active":"2023-09-28T04:23:18.377068+0000","last_peered":"2023-09-28T04:23:18.377068+0000","last_clean":"2023-09-28T04:23:18.377068+0000","last_became_active":"2023-09-28T04:23:13.017362+0000","last_became_peered":"2023-09-28T04:23:13.017362+0000","last_unstale":"2023-09-28T04:23:18.377068+0000","last_undegraded":"2023-09-28T04:23:18.377068+0000","last_fullsized":"2023-09-28T04:23:18.377068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.382209+0000","last_change":"2023-09-28T04:23:17.899128+0000","last_active":"2023-09-28T04:23:18.382209+0000","last_peered":"2023-09-28T04:23:18.382209+0000","last_clean":"2023-09-28T04:23:18.382209+0000","last_became_active":"2023-09-28T04:23:17.898878+0000","last_became_peered":"2023-09-28T04:23:17.898878+0000","last_unstale":"2023-09-28T04:23:18.382209+0000","last_undegraded":"2023-09-28T04:23:18.382209+0000","last_fullsized":"2023-09-28T04:23:18.382209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388439+0000","last_change":"2023-09-28T04:23:18.384565+0000","last_active":"2023-09-28T04:23:18.388439+0000","last_peered":"2023-09-28T04:23:18.388439+0000","last_clean":"2023-09-28T04:23:18.388439+0000","last_became_active":"2023-09-28T04:23:18.383969+0000","last_became_peered":"2023-09-28T04:23:18.383969+0000","last_unstale":"2023-09-28T04:23:18.388439+0000","last_undegraded":"2023-09-28T04:23:18.388439+0000","last_fullsized":"2023-09-28T04:23:18.388439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379488+0000","last_change":"2023-09-28T04:23:12.604091+0000","last_active":"2023-09-28T04:23:18.379488+0000","last_peered":"2023-09-28T04:23:18.379488+0000","last_clean":"2023-09-28T04:23:18.379488+0000","last_became_active":"2023-09-28T04:23:12.603804+0000","last_became_peered":"2023-09-28T04:23:12.603804+0000","last_unstale":"2023-09-28T04:23:18.379488+0000","last_undegraded":"2023-09-28T04:23:18.379488+0000","last_fullsized":"2023-09-28T04:23:18.379488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.382008+0000","last_change":"2023-09-28T04:23:17.918999+0000","last_active":"2023-09-28T04:23:18.382008+0000","last_peered":"2023-09-28T04:23:18.382008+0000","last_clean":"2023-09-28T04:23:18.382008+0000","last_became_active":"2023-09-28T04:23:17.918740+0000","last_became_peered":"2023-09-28T04:23:17.918740+0000","last_unstale":"2023-09-28T04:23:18.382008+0000","last_undegraded":"2023-09-28T04:23:18.382008+0000","last_fullsized":"2023-09-28T04:23:18.382008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395808+0000","last_change":"2023-09-28T04:23:18.389350+0000","last_active":"2023-09-28T04:23:18.395808+0000","last_peered":"2023-09-28T04:23:18.395808+0000","last_clean":"2023-09-28T04:23:18.395808+0000","last_became_active":"2023-09-28T04:23:18.389059+0000","last_became_peered":"2023-09-28T04:23:18.389059+0000","last_unstale":"2023-09-28T04:23:18.395808+0000","last_undegraded":"2023-09-28T04:23:18.395808+0000","last_fullsized":"2023-09-28T04:23:18.395808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378640+0000","last_change":"2023-09-28T04:23:12.602100+0000","last_active":"2023-09-28T04:23:18.378640+0000","last_peered":"2023-09-28T04:23:18.378640+0000","last_clean":"2023-09-28T04:23:18.378640+0000","last_became_active":"2023-09-28T04:23:12.601652+0000","last_became_peered":"2023-09-28T04:23:12.601652+0000","last_unstale":"2023-09-28T04:23:18.378640+0000","last_undegraded":"2023-09-28T04:23:18.378640+0000","last_fullsized":"2023-09-28T04:23:18.378640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:37:16.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.376176+0000","last_change":"2023-09-28T04:23:17.911566+0000","last_active":"2023-09-28T04:23:18.376176+0000","last_peered":"2023-09-28T04:23:18.376176+0000","last_clean":"2023-09-28T04:23:18.376176+0000","last_became_active":"2023-09-28T04:23:17.911308+0000","last_became_peered":"2023-09-28T04:23:17.911308+0000","last_unstale":"2023-09-28T04:23:18.376176+0000","last_undegraded":"2023-09-28T04:23:18.376176+0000","last_fullsized":"2023-09-28T04:23:18.376176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395489+0000","last_change":"2023-09-28T04:23:18.388204+0000","last_active":"2023-09-28T04:23:18.395489+0000","last_peered":"2023-09-28T04:23:18.395489+0000","last_clean":"2023-09-28T04:23:18.395489+0000","last_became_active":"2023-09-28T04:23:18.387945+0000","last_became_peered":"2023-09-28T04:23:18.387945+0000","last_unstale":"2023-09-28T04:23:18.395489+0000","last_undegraded":"2023-09-28T04:23:18.395489+0000","last_fullsized":"2023-09-28T04:23:18.395489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378668+0000","last_change":"2023-09-28T04:23:12.604212+0000","last_active":"2023-09-28T04:23:18.378668+0000","last_peered":"2023-09-28T04:23:18.378668+0000","last_clean":"2023-09-28T04:23:18.378668+0000","last_became_active":"2023-09-28T04:23:12.603930+0000","last_became_peered":"2023-09-28T04:23:12.603930+0000","last_unstale":"2023-09-28T04:23:18.378668+0000","last_undegraded":"2023-09-28T04:23:18.378668+0000","last_fullsized":"2023-09-28T04:23:18.378668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386718+0000","last_change":"2023-09-28T04:23:11.608534+0000","last_active":"2023-09-28T04:23:18.386718+0000","last_peered":"2023-09-28T04:23:18.386718+0000","last_clean":"2023-09-28T04:23:18.386718+0000","last_became_active":"2023-09-28T04:23:11.608249+0000","last_became_peered":"2023-09-28T04:23:11.608249+0000","last_unstale":"2023-09-28T04:23:18.386718+0000","last_undegraded":"2023-09-28T04:23:18.386718+0000","last_fullsized":"2023-09-28T04:23:18.386718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_clean_scrub_stamp":"2023-09-28T04:23:10.587579+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:10.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.375491+0000","last_change":"2023-09-28T04:23:17.902709+0000","last_active":"2023-09-28T04:23:18.375491+0000","last_peered":"2023-09-28T04:23:18.375491+0000","last_clean":"2023-09-28T04:23:18.375491+0000","last_became_active":"2023-09-28T04:23:17.902341+0000","last_became_peered":"2023-09-28T04:23:17.902341+0000","last_unstale":"2023-09-28T04:23:18.375491+0000","last_undegraded":"2023-09-28T04:23:18.375491+0000","last_fullsized":"2023-09-28T04:23:18.375491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392913+0000","last_change":"2023-09-28T04:23:18.389982+0000","last_active":"2023-09-28T04:23:18.392913+0000","last_peered":"2023-09-28T04:23:18.392913+0000","last_clean":"2023-09-28T04:23:18.392913+0000","last_became_active":"2023-09-28T04:23:18.389692+0000","last_became_peered":"2023-09-28T04:23:18.389692+0000","last_unstale":"2023-09-28T04:23:18.392913+0000","last_undegraded":"2023-09-28T04:23:18.392913+0000","last_fullsized":"2023-09-28T04:23:18.392913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386996+0000","last_change":"2023-09-28T04:23:12.605908+0000","last_active":"2023-09-28T04:23:18.386996+0000","last_peered":"2023-09-28T04:23:18.386996+0000","last_clean":"2023-09-28T04:23:18.386996+0000","last_became_active":"2023-09-28T04:23:12.605668+0000","last_became_peered":"2023-09-28T04:23:12.605668+0000","last_unstale":"2023-09-28T04:23:18.386996+0000","last_undegraded":"2023-09-28T04:23:18.386996+0000","last_fullsized":"2023-09-28T04:23:18.386996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.387785+0000","last_change":"2023-09-28T04:23:17.918410+0000","last_active":"2023-09-28T04:23:18.387785+0000","last_peered":"2023-09-28T04:23:18.387785+0000","last_clean":"2023-09-28T04:23:18.387785+0000","last_became_active":"2023-09-28T04:23:17.918130+0000","last_became_peered":"2023-09-28T04:23:17.918130+0000","last_unstale":"2023-09-28T04:23:18.387785+0000","last_undegraded":"2023-09-28T04:23:18.387785+0000","last_fullsized":"2023-09-28T04:23:18.387785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399143+0000","last_change":"2023-09-28T04:23:18.391987+0000","last_active":"2023-09-28T04:23:18.399143+0000","last_peered":"2023-09-28T04:23:18.399143+0000","last_clean":"2023-09-28T04:23:18.399143+0000","last_became_active":"2023-09-28T04:23:18.391709+0000","last_became_peered":"2023-09-28T04:23:18.391709+0000","last_unstale":"2023-09-28T04:23:18.399143+0000","last_undegraded":"2023-09-28T04:23:18.399143+0000","last_fullsized":"2023-09-28T04:23:18.399143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386509+0000","last_change":"2023-09-28T04:23:13.017715+0000","last_active":"2023-09-28T04:23:18.386509+0000","last_peered":"2023-09-28T04:23:18.386509+0000","last_clean":"2023-09-28T04:23:18.386509+0000","last_became_active":"2023-09-28T04:23:13.017398+0000","last_became_peered":"2023-09-28T04:23:13.017398+0000","last_unstale":"2023-09-28T04:23:18.386509+0000","last_undegraded":"2023-09-28T04:23:18.386509+0000","last_fullsized":"2023-09-28T04:23:18.386509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:37:41.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377174+0000","last_change":"2023-09-28T04:23:17.912291+0000","last_active":"2023-09-28T04:23:18.377174+0000","last_peered":"2023-09-28T04:23:18.377174+0000","last_clean":"2023-09-28T04:23:18.377174+0000","last_became_active":"2023-09-28T04:23:17.912023+0000","last_became_peered":"2023-09-28T04:23:17.912023+0000","last_unstale":"2023-09-28T04:23:18.377174+0000","last_undegraded":"2023-09-28T04:23:18.377174+0000","last_fullsized":"2023-09-28T04:23:18.377174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399280+0000","last_change":"2023-09-28T04:23:18.396451+0000","last_active":"2023-09-28T04:23:18.399280+0000","last_peered":"2023-09-28T04:23:18.399280+0000","last_clean":"2023-09-28T04:23:18.399280+0000","last_became_active":"2023-09-28T04:23:18.396190+0000","last_became_peered":"2023-09-28T04:23:18.396190+0000","last_unstale":"2023-09-28T04:23:18.399280+0000","last_undegraded":"2023-09-28T04:23:18.399280+0000","last_fullsized":"2023-09-28T04:23:18.399280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.383619+0000","last_change":"2023-09-28T04:23:17.904739+0000","last_active":"2023-09-28T04:23:23.383619+0000","last_peered":"2023-09-28T04:23:23.383619+0000","last_clean":"2023-09-28T04:23:23.383619+0000","last_became_active":"2023-09-28T04:23:17.903844+0000","last_became_peered":"2023-09-28T04:23:17.903844+0000","last_unstale":"2023-09-28T04:23:23.383619+0000","last_undegraded":"2023-09-28T04:23:23.383619+0000","last_fullsized":"2023-09-28T04:23:23.383619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377634+0000","last_change":"2023-09-28T04:23:12.606496+0000","last_active":"2023-09-28T04:23:18.377634+0000","last_peered":"2023-09-28T04:23:18.377634+0000","last_clean":"2023-09-28T04:23:18.377634+0000","last_became_active":"2023-09-28T04:23:12.606143+0000","last_became_peered":"2023-09-28T04:23:12.606143+0000","last_unstale":"2023-09-28T04:23:18.377634+0000","last_undegraded":"2023-09-28T04:23:18.377634+0000","last_fullsized":"2023-09-28T04:23:18.377634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402487+0000","last_change":"2023-09-28T04:23:18.396153+0000","last_active":"2023-09-28T04:23:18.402487+0000","last_peered":"2023-09-28T04:23:18.402487+0000","last_clean":"2023-09-28T04:23:18.402487+0000","last_became_active":"2023-09-28T04:23:18.392092+0000","last_became_peered":"2023-09-28T04:23:18.392092+0000","last_unstale":"2023-09-28T04:23:18.402487+0000","last_undegraded":"2023-09-28T04:23:18.402487+0000","last_fullsized":"2023-09-28T04:23:18.402487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379277+0000","last_change":"2023-09-28T04:23:12.606390+0000","last_active":"2023-09-28T04:23:18.379277+0000","last_peered":"2023-09-28T04:23:18.379277+0000","last_clean":"2023-09-28T04:23:18.379277+0000","last_became_active":"2023-09-28T04:23:12.605965+0000","last_became_peered":"2023-09-28T04:23:12.605965+0000","last_unstale":"2023-09-28T04:23:18.379277+0000","last_undegraded":"2023-09-28T04:23:18.379277+0000","last_fullsized":"2023-09-28T04:23:18.379277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:11.833839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388779+0000","last_change":"2023-09-28T04:23:17.915114+0000","last_active":"2023-09-28T04:23:18.388779+0000","last_peered":"2023-09-28T04:23:18.388779+0000","last_clean":"2023-09-28T04:23:18.388779+0000","last_became_active":"2023-09-28T04:23:17.914697+0000","last_became_peered":"2023-09-28T04:23:17.914697+0000","last_unstale":"2023-09-28T04:23:18.388779+0000","last_undegraded":"2023-09-28T04:23:18.388779+0000","last_fullsized":"2023-09-28T04:23:18.388779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397753+0000","last_change":"2023-09-28T04:23:18.386681+0000","last_active":"2023-09-28T04:23:18.397753+0000","last_peered":"2023-09-28T04:23:18.397753+0000","last_clean":"2023-09-28T04:23:18.397753+0000","last_became_active":"2023-09-28T04:23:18.386380+0000","last_became_peered":"2023-09-28T04:23:18.386380+0000","last_unstale":"2023-09-28T04:23:18.397753+0000","last_undegraded":"2023-09-28T04:23:18.397753+0000","last_fullsized":"2023-09-28T04:23:18.397753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172558+0000","last_change":"2023-09-28T04:23:17.918404+0000","last_active":"2023-09-28T04:23:20.172558+0000","last_peered":"2023-09-28T04:23:20.172558+0000","last_clean":"2023-09-28T04:23:20.172558+0000","last_became_active":"2023-09-28T04:23:17.918116+0000","last_became_peered":"2023-09-28T04:23:17.918116+0000","last_unstale":"2023-09-28T04:23:20.172558+0000","last_undegraded":"2023-09-28T04:23:20.172558+0000","last_fullsized":"2023-09-28T04:23:20.172558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390737+0000","last_change":"2023-09-28T04:23:18.385213+0000","last_active":"2023-09-28T04:23:18.390737+0000","last_peered":"2023-09-28T04:23:18.390737+0000","last_clean":"2023-09-28T04:23:18.390737+0000","last_became_active":"2023-09-28T04:23:18.384930+0000","last_became_peered":"2023-09-28T04:23:18.384930+0000","last_unstale":"2023-09-28T04:23:18.390737+0000","last_undegraded":"2023-09-28T04:23:18.390737+0000","last_fullsized":"2023-09-28T04:23:18.390737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:06.681805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.384054+0000","last_change":"2023-09-28T04:23:17.905986+0000","last_active":"2023-09-28T04:23:23.384054+0000","last_peered":"2023-09-28T04:23:23.384054+0000","last_clean":"2023-09-28T04:23:23.384054+0000","last_became_active":"2023-09-28T04:23:17.905667+0000","last_became_peered":"2023-09-28T04:23:17.905667+0000","last_unstale":"2023-09-28T04:23:23.384054+0000","last_undegraded":"2023-09-28T04:23:23.384054+0000","last_fullsized":"2023-09-28T04:23:23.384054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402551+0000","last_change":"2023-09-28T04:23:18.400970+0000","last_active":"2023-09-28T04:23:18.402551+0000","last_peered":"2023-09-28T04:23:18.402551+0000","last_clean":"2023-09-28T04:23:18.402551+0000","last_became_active":"2023-09-28T04:23:18.400683+0000","last_became_peered":"2023-09-28T04:23:18.400683+0000","last_unstale":"2023-09-28T04:23:18.402551+0000","last_undegraded":"2023-09-28T04:23:18.402551+0000","last_fullsized":"2023-09-28T04:23:18.402551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:59:30.982762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.383977+0000","last_change":"2023-09-28T04:23:17.905162+0000","last_active":"2023-09-28T04:23:23.383977+0000","last_peered":"2023-09-28T04:23:23.383977+0000","last_clean":"2023-09-28T04:23:23.383977+0000","last_became_active":"2023-09-28T04:23:17.904895+0000","last_became_peered":"2023-09-28T04:23:17.904895+0000","last_unstale":"2023-09-28T04:23:23.383977+0000","last_undegraded":"2023-09-28T04:23:23.383977+0000","last_fullsized":"2023-09-28T04:23:23.383977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402543+0000","last_change":"2023-09-28T04:23:18.400714+0000","last_active":"2023-09-28T04:23:18.402543+0000","last_peered":"2023-09-28T04:23:18.402543+0000","last_clean":"2023-09-28T04:23:18.402543+0000","last_became_active":"2023-09-28T04:23:18.400410+0000","last_became_peered":"2023-09-28T04:23:18.400410+0000","last_unstale":"2023-09-28T04:23:18.402543+0000","last_undegraded":"2023-09-28T04:23:18.402543+0000","last_fullsized":"2023-09-28T04:23:18.402543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:43:02.603601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376352+0000","last_change":"2023-09-28T04:23:17.905493+0000","last_active":"2023-09-28T04:23:19.376352+0000","last_peered":"2023-09-28T04:23:19.376352+0000","last_clean":"2023-09-28T04:23:19.376352+0000","last_became_active":"2023-09-28T04:23:17.905198+0000","last_became_peered":"2023-09-28T04:23:17.905198+0000","last_unstale":"2023-09-28T04:23:19.376352+0000","last_undegraded":"2023-09-28T04:23:19.376352+0000","last_fullsized":"2023-09-28T04:23:19.376352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402220+0000","last_change":"2023-09-28T04:23:18.393194+0000","last_active":"2023-09-28T04:23:18.402220+0000","last_peered":"2023-09-28T04:23:18.402220+0000","last_clean":"2023-09-28T04:23:18.402220+0000","last_became_active":"2023-09-28T04:23:18.392400+0000","last_became_peered":"2023-09-28T04:23:18.392400+0000","last_unstale":"2023-09-28T04:23:18.402220+0000","last_undegraded":"2023-09-28T04:23:18.402220+0000","last_fullsized":"2023-09-28T04:23:18.402220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.383828+0000","last_change":"2023-09-28T04:23:17.917604+0000","last_active":"2023-09-28T04:23:23.383828+0000","last_peered":"2023-09-28T04:23:23.383828+0000","last_clean":"2023-09-28T04:23:23.383828+0000","last_became_active":"2023-09-28T04:23:17.917266+0000","last_became_peered":"2023-09-28T04:23:17.917266+0000","last_unstale":"2023-09-28T04:23:23.383828+0000","last_undegraded":"2023-09-28T04:23:23.383828+0000","last_fullsized":"2023-09-28T04:23:23.383828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395284+0000","last_change":"2023-09-28T04:23:18.386391+0000","last_active":"2023-09-28T04:23:18.395284+0000","last_peered":"2023-09-28T04:23:18.395284+0000","last_clean":"2023-09-28T04:23:18.395284+0000","last_became_active":"2023-09-28T04:23:18.386051+0000","last_became_peered":"2023-09-28T04:23:18.386051+0000","last_unstale":"2023-09-28T04:23:18.395284+0000","last_undegraded":"2023-09-28T04:23:18.395284+0000","last_fullsized":"2023-09-28T04:23:18.395284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392882+0000","last_change":"2023-09-28T04:23:18.389600+0000","last_active":"2023-09-28T04:23:18.392882+0000","last_peered":"2023-09-28T04:23:18.392882+0000","last_clean":"2023-09-28T04:23:18.392882+0000","last_became_active":"2023-09-28T04:23:18.389280+0000","last_became_peered":"2023-09-28T04:23:18.389280+0000","last_unstale":"2023-09-28T04:23:18.392882+0000","last_undegraded":"2023-09-28T04:23:18.392882+0000","last_fullsized":"2023-09-28T04:23:18.392882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:47.697305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402201+0000","last_change":"2023-09-28T04:23:18.392980+0000","last_active":"2023-09-28T04:23:18.402201+0000","last_peered":"2023-09-28T04:23:18.402201+0000","last_clean":"2023-09-28T04:23:18.402201+0000","last_became_active":"2023-09-28T04:23:18.390929+0000","last_became_peered":"2023-09-28T04:23:18.390929+0000","last_unstale":"2023-09-28T04:23:18.402201+0000","last_undegraded":"2023-09-28T04:23:18.402201+0000","last_fullsized":"2023-09-28T04:23:18.402201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397834+0000","last_change":"2023-09-28T04:23:18.387348+0000","last_active":"2023-09-28T04:23:18.397834+0000","last_peered":"2023-09-28T04:23:18.397834+0000","last_clean":"2023-09-28T04:23:18.397834+0000","last_became_active":"2023-09-28T04:23:18.385870+0000","last_became_peered":"2023-09-28T04:23:18.385870+0000","last_unstale":"2023-09-28T04:23:18.397834+0000","last_undegraded":"2023-09-28T04:23:18.397834+0000","last_fullsized":"2023-09-28T04:23:18.397834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:29:04.985060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402660+0000","last_change":"2023-09-28T04:23:18.392534+0000","last_active":"2023-09-28T04:23:18.402660+0000","last_peered":"2023-09-28T04:23:18.402660+0000","last_clean":"2023-09-28T04:23:18.402660+0000","last_became_active":"2023-09-28T04:23:18.392245+0000","last_became_peered":"2023-09-28T04:23:18.392245+0000","last_unstale":"2023-09-28T04:23:18.402660+0000","last_undegraded":"2023-09-28T04:23:18.402660+0000","last_fullsized":"2023-09-28T04:23:18.402660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395827+0000","last_change":"2023-09-28T04:23:18.391490+0000","last_active":"2023-09-28T04:23:18.395827+0000","last_peered":"2023-09-28T04:23:18.395827+0000","last_clean":"2023-09-28T04:23:18.395827+0000","last_became_active":"2023-09-28T04:23:18.391256+0000","last_became_peered":"2023-09-28T04:23:18.391256+0000","last_unstale":"2023-09-28T04:23:18.395827+0000","last_undegraded":"2023-09-28T04:23:18.395827+0000","last_fullsized":"2023-09-28T04:23:18.395827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:28:43.639301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8952,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362888,"statfs":{"total":96636764160,"available":96627597312,"internally_reserved":0,"allocated":311296,"data_stored":671349,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8348,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363492,"statfs":{"total":96636764160,"available":96628215808,"internally_reserved":0,"allocated":217088,"data_stored":79229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.8159999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9989999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8412,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363428,"statfs":{"total":96636764160,"available":96628150272,"internally_reserved":0,"allocated":217088,"data_stored":79229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8928,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362912,"statfs":{"total":96636764160,"available":96627621888,"internally_reserved":0,"allocated":286720,"data_stored":670151,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8348,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363492,"statfs":{"total":96636764160,"available":96628215808,"internally_reserved":0,"allocated":217088,"data_stored":79229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8416,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363424,"statfs":{"total":96636764160,"available":96628146176,"internally_reserved":0,"allocated":221184,"data_stored":79319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8432,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363408,"statfs":{"total":96636764160,"available":96628129792,"internally_reserved":0,"allocated":237568,"data_stored":80821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8356,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363484,"statfs":{"total":96636764160,"available":96628207616,"internally_reserved":0,"allocated":225280,"data_stored":79853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T04:23:30.219 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T04:23:30.441 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.441+0000 7f3b1adff700 1 Processor -- start 2023-09-28T04:23:30.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.441+0000 7f3b1adff700 1 -- start start 2023-09-28T04:23:30.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.442+0000 7f3b1adff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3b1414f8b0 0x7f3b141557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:30.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.442+0000 7f3b1adff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b1414fc80 0x7f3b140c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:30.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.442+0000 7f3b1adff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b140633d0 con 0x7f3b140676a0 2023-09-28T04:23:30.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.442+0000 7f3b1adff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b140c44b0 con 0x7f3b1414f8b0 2023-09-28T04:23:30.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.442+0000 7f3b1adff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140bbd50 con 0x7f3b1414fc80 2023-09-28T04:23:30.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.443+0000 7f3b18b9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3b1414f8b0 0x7f3b141557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:30.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.443+0000 7f3b13fff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f3b140676a0 0x7f3b140c8350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47838/0 (socket says 172.21.15.118:47838) 2023-09-28T04:23:30.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.443+0000 7f3b13fff700 1 -- 172.21.15.118:0/391482774 learned_addr learned my addr 172.21.15.118:0/391482774 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:30.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.443+0000 7f3b1939c700 1 --2- 172.21.15.118:0/391482774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b1414fc80 0x7f3b140c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:30.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.443+0000 7f3b18b9b700 1 -- 172.21.15.118:0/391482774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b1414fc80 msgr2=0x7f3b140c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:30.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.443+0000 7f3b18b9b700 1 --2- 172.21.15.118:0/391482774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b1414fc80 0x7f3b140c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.445 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.443+0000 7f3b18b9b700 1 -- 172.21.15.118:0/391482774 >> v1:172.21.15.118:6789/0 conn(0x7f3b140676a0 legacy=0x7f3b140c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:30.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.443+0000 7f3b18b9b700 1 -- 172.21.15.118:0/391482774 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b140636b0 con 0x7f3b1414f8b0 2023-09-28T04:23:30.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.443+0000 7f3b137fe700 1 -- 172.21.15.118:0/391482774 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770131580 0 0) 0x7f3b140633d0 con 0x7f3b140676a0 2023-09-28T04:23:30.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.443+0000 7f3b18b9b700 1 --2- 172.21.15.118:0/391482774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b1414f8b0 0x7f3b141557a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b080098d0 tx=0x7f3b08009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af578cef7c700cc7 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:30.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.443+0000 7f3b137fe700 1 -- 172.21.15.118:0/391482774 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08005c10 con 0x7f3b1414f8b0 2023-09-28T04:23:30.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.444+0000 7f3b137fe700 1 -- 172.21.15.118:0/391482774 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b08005d70 con 0x7f3b1414f8b0 2023-09-28T04:23:30.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.444+0000 7f3b137fe700 1 -- 172.21.15.118:0/391482774 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08006280 con 0x7f3b1414f8b0 2023-09-28T04:23:30.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.444+0000 7f3b1adff700 1 -- 172.21.15.118:0/391482774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b1414f8b0 msgr2=0x7f3b141557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:30.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.444+0000 7f3b1adff700 1 --2- 172.21.15.118:0/391482774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b1414f8b0 0x7f3b141557a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b080098d0 tx=0x7f3b08009120 comp rx=0 tx=0).stop 2023-09-28T04:23:30.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.444+0000 7f3b1adff700 1 -- 172.21.15.118:0/391482774 shutdown_connections 2023-09-28T04:23:30.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.444+0000 7f3b1adff700 1 --2- 172.21.15.118:0/391482774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b1414fc80 0x7f3b140c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.444+0000 7f3b1adff700 1 --2- 172.21.15.118:0/391482774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b1414f8b0 0x7f3b141557a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.447 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.444+0000 7f3b1adff700 1 -- 172.21.15.118:0/391482774 >> 172.21.15.118:0/391482774 conn(0x7f3b1406a3b0 msgr2=0x7f3b1406a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:30.447 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.444+0000 7f3b1adff700 1 -- 172.21.15.118:0/391482774 shutdown_connections 2023-09-28T04:23:30.447 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.444+0000 7f3b1adff700 1 -- 172.21.15.118:0/391482774 wait complete. 2023-09-28T04:23:30.447 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.446+0000 7f3b1adff700 1 Processor -- start 2023-09-28T04:23:30.447 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.446+0000 7f3b1adff700 1 -- start start 2023-09-28T04:23:30.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1adff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b140676a0 0x7f3b140bd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:30.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1adff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b1414f8b0 0x7f3b140bc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:30.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1adff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b1414fc80 0x7f3b14151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:30.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1adff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14150ed0 con 0x7f3b1414fc80 2023-09-28T04:23:30.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1adff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14150630 con 0x7f3b1414f8b0 2023-09-28T04:23:30.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1adff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14150910 con 0x7f3b140676a0 2023-09-28T04:23:30.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1939c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b1414fc80 0x7f3b14151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:30.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1939c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b1414fc80 0x7f3b14151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51056/0 (socket says 172.21.15.118:51056) 2023-09-28T04:23:30.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1939c700 1 -- 172.21.15.118:0/7732807 learned_addr learned my addr 172.21.15.118:0/7732807 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:30.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b13fff700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b1414f8b0 0x7f3b140bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:30.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b18b9b700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b140676a0 0x7f3b140bd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:30.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1939c700 1 -- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b140676a0 msgr2=0x7f3b140bd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1939c700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b140676a0 0x7f3b140bd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1939c700 1 -- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b1414f8b0 msgr2=0x7f3b140bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1939c700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b1414f8b0 0x7f3b140bc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b1939c700 1 -- 172.21.15.118:0/7732807 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080093c0 con 0x7f3b1414fc80 2023-09-28T04:23:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.448+0000 7f3b18b9b700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b140676a0 0x7f3b140bd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.449+0000 7f3b1939c700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b1414fc80 0x7f3b14151360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009df0 tx=0x7f3b0c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.449+0000 7f3b10ff9700 1 -- 172.21.15.118:0/7732807 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c00cb50 con 0x7f3b1414fc80 2023-09-28T04:23:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.449+0000 7f3b10ff9700 1 -- 172.21.15.118:0/7732807 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c00f040 con 0x7f3b1414fc80 2023-09-28T04:23:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.449+0000 7f3b10ff9700 1 -- 172.21.15.118:0/7732807 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c014480 con 0x7f3b1414fc80 2023-09-28T04:23:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.449+0000 7f3b1adff700 1 -- 172.21.15.118:0/7732807 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b14152bc0 con 0x7f3b1414fc80 2023-09-28T04:23:30.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.449+0000 7f3b1adff700 1 -- 172.21.15.118:0/7732807 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b140bfdc0 con 0x7f3b1414fc80 2023-09-28T04:23:30.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.450+0000 7f3b1adff700 1 -- 172.21.15.118:0/7732807 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b14071980 con 0x7f3b1414fc80 2023-09-28T04:23:30.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.451+0000 7f3b10ff9700 1 -- 172.21.15.118:0/7732807 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3b0c014830 con 0x7f3b1414fc80 2023-09-28T04:23:30.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.452+0000 7f3b10ff9700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3af8067360 0x7f3af8069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:30.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.452+0000 7f3b10ff9700 1 -- 172.21.15.118:0/7732807 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3b0c085830 con 0x7f3b1414fc80 2023-09-28T04:23:30.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.452+0000 7f3b18b9b700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3af8067360 0x7f3af8069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:30.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.453+0000 7f3b18b9b700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3af8067360 0x7f3af8069810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009160 tx=0x7f3b08016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:30.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.456+0000 7f3b10ff9700 1 -- 172.21.15.118:0/7732807 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3b0c052690 con 0x7f3b1414fc80 2023-09-28T04:23:30.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.646+0000 7f3b1adff700 1 -- 172.21.15.118:0/7732807 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b14150ca0 con 0x7f3af8067360 2023-09-28T04:23:30.655 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.655+0000 7f3b10ff9700 1 -- 172.21.15.118:0/7732807 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284888 (secure 0 0 0) 0x7f3b14150ca0 con 0x7f3af8067360 2023-09-28T04:23:30.659 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:30.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.659+0000 7f3b1adff700 1 -- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3af8067360 msgr2=0x7f3af8069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:30.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.659+0000 7f3b1adff700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3af8067360 0x7f3af8069810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009160 tx=0x7f3b08016000 comp rx=0 tx=0).stop 2023-09-28T04:23:30.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.659+0000 7f3b1adff700 1 -- 172.21.15.118:0/7732807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b1414fc80 msgr2=0x7f3b14151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:30.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.659+0000 7f3b1adff700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b1414fc80 0x7f3b14151360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009df0 tx=0x7f3b0c00b040 comp rx=0 tx=0).stop 2023-09-28T04:23:30.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.659+0000 7f3b1adff700 1 -- 172.21.15.118:0/7732807 shutdown_connections 2023-09-28T04:23:30.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.659+0000 7f3b1adff700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3af8067360 0x7f3af8069810 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.659+0000 7f3b1adff700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b1414fc80 0x7f3b14151360 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.659+0000 7f3b1adff700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b140676a0 0x7f3b140bd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.659+0000 7f3b1adff700 1 --2- 172.21.15.118:0/7732807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b1414f8b0 0x7f3b140bc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.659+0000 7f3b1adff700 1 -- 172.21.15.118:0/7732807 >> 172.21.15.118:0/7732807 conn(0x7f3b1406a3b0 msgr2=0x7f3b140c82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:30.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.659+0000 7f3b1adff700 1 -- 172.21.15.118:0/7732807 shutdown_connections 2023-09-28T04:23:30.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.659+0000 7f3b1adff700 1 -- 172.21.15.118:0/7732807 wait complete. 2023-09-28T04:23:30.662 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-09-28T04:23:30.677 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-09-28T04:23:30.527784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594004,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":243,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68240,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":66240,"kb_avail":754906480,"statfs":{"total":773094113280,"available":773024235520,"internally_reserved":0,"allocated":1982464,"data_stored":1821840,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":67829760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3636,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.153359"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401799+0000","last_change":"2023-09-28T04:23:18.400475+0000","last_active":"2023-09-28T04:23:18.401799+0000","last_peered":"2023-09-28T04:23:18.401799+0000","last_clean":"2023-09-28T04:23:18.401799+0000","last_became_active":"2023-09-28T04:23:18.400107+0000","last_became_peered":"2023-09-28T04:23:18.400107+0000","last_unstale":"2023-09-28T04:23:18.401799+0000","last_undegraded":"2023-09-28T04:23:18.401799+0000","last_fullsized":"2023-09-28T04:23:18.401799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:44.340279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391569+0000","last_change":"2023-09-28T04:23:18.385136+0000","last_active":"2023-09-28T04:23:18.391569+0000","last_peered":"2023-09-28T04:23:18.391569+0000","last_clean":"2023-09-28T04:23:18.391569+0000","last_became_active":"2023-09-28T04:23:18.384789+0000","last_became_peered":"2023-09-28T04:23:18.384789+0000","last_unstale":"2023-09-28T04:23:18.391569+0000","last_undegraded":"2023-09-28T04:23:18.391569+0000","last_fullsized":"2023-09-28T04:23:18.391569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397939+0000","last_change":"2023-09-28T04:23:18.393700+0000","last_active":"2023-09-28T04:23:18.397939+0000","last_peered":"2023-09-28T04:23:18.397939+0000","last_clean":"2023-09-28T04:23:18.397939+0000","last_became_active":"2023-09-28T04:23:18.390599+0000","last_became_peered":"2023-09-28T04:23:18.390599+0000","last_unstale":"2023-09-28T04:23:18.397939+0000","last_undegraded":"2023-09-28T04:23:18.397939+0000","last_fullsized":"2023-09-28T04:23:18.397939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:43:19.782618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392953+0000","last_change":"2023-09-28T04:23:18.390865+0000","last_active":"2023-09-28T04:23:18.392953+0000","last_peered":"2023-09-28T04:23:18.392953+0000","last_clean":"2023-09-28T04:23:18.392953+0000","last_became_active":"2023-09-28T04:23:18.390607+0000","last_became_peered":"2023-09-28T04:23:18.390607+0000","last_unstale":"2023-09-28T04:23:18.392953+0000","last_undegraded":"2023-09-28T04:23:18.392953+0000","last_fullsized":"2023-09-28T04:23:18.392953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.405585+0000","last_change":"2023-09-28T04:23:18.404215+0000","last_active":"2023-09-28T04:23:18.405585+0000","last_peered":"2023-09-28T04:23:18.405585+0000","last_clean":"2023-09-28T04:23:18.405585+0000","last_became_active":"2023-09-28T04:23:18.403960+0000","last_became_peered":"2023-09-28T04:23:18.403960+0000","last_unstale":"2023-09-28T04:23:18.405585+0000","last_undegraded":"2023-09-28T04:23:18.405585+0000","last_fullsized":"2023-09-28T04:23:18.405585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397969+0000","last_change":"2023-09-28T04:23:18.393987+0000","last_active":"2023-09-28T04:23:18.397969+0000","last_peered":"2023-09-28T04:23:18.397969+0000","last_clean":"2023-09-28T04:23:18.397969+0000","last_became_active":"2023-09-28T04:23:18.390575+0000","last_became_peered":"2023-09-28T04:23:18.390575+0000","last_unstale":"2023-09-28T04:23:18.397969+0000","last_undegraded":"2023-09-28T04:23:18.397969+0000","last_fullsized":"2023-09-28T04:23:18.397969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:24:51.659204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400984+0000","last_change":"2023-09-28T04:23:18.396733+0000","last_active":"2023-09-28T04:23:18.400984+0000","last_peered":"2023-09-28T04:23:18.400984+0000","last_clean":"2023-09-28T04:23:18.400984+0000","last_became_active":"2023-09-28T04:23:18.396038+0000","last_became_peered":"2023-09-28T04:23:18.396038+0000","last_unstale":"2023-09-28T04:23:18.400984+0000","last_undegraded":"2023-09-28T04:23:18.400984+0000","last_fullsized":"2023-09-28T04:23:18.400984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391542+0000","last_change":"2023-09-28T04:23:18.388208+0000","last_active":"2023-09-28T04:23:18.391542+0000","last_peered":"2023-09-28T04:23:18.391542+0000","last_clean":"2023-09-28T04:23:18.391542+0000","last_became_active":"2023-09-28T04:23:18.387260+0000","last_became_peered":"2023-09-28T04:23:18.387260+0000","last_unstale":"2023-09-28T04:23:18.391542+0000","last_undegraded":"2023-09-28T04:23:18.391542+0000","last_fullsized":"2023-09-28T04:23:18.391542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.405212+0000","last_change":"2023-09-28T04:23:18.403803+0000","last_active":"2023-09-28T04:23:18.405212+0000","last_peered":"2023-09-28T04:23:18.405212+0000","last_clean":"2023-09-28T04:23:18.405212+0000","last_became_active":"2023-09-28T04:23:18.403565+0000","last_became_peered":"2023-09-28T04:23:18.403565+0000","last_unstale":"2023-09-28T04:23:18.405212+0000","last_undegraded":"2023-09-28T04:23:18.405212+0000","last_fullsized":"2023-09-28T04:23:18.405212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397774+0000","last_change":"2023-09-28T04:23:18.392418+0000","last_active":"2023-09-28T04:23:18.397774+0000","last_peered":"2023-09-28T04:23:18.397774+0000","last_clean":"2023-09-28T04:23:18.397774+0000","last_became_active":"2023-09-28T04:23:18.390911+0000","last_became_peered":"2023-09-28T04:23:18.390911+0000","last_unstale":"2023-09-28T04:23:18.397774+0000","last_undegraded":"2023-09-28T04:23:18.397774+0000","last_fullsized":"2023-09-28T04:23:18.397774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397957+0000","last_change":"2023-09-28T04:23:18.393845+0000","last_active":"2023-09-28T04:23:18.397957+0000","last_peered":"2023-09-28T04:23:18.397957+0000","last_clean":"2023-09-28T04:23:18.397957+0000","last_became_active":"2023-09-28T04:23:18.393524+0000","last_became_peered":"2023-09-28T04:23:18.393524+0000","last_unstale":"2023-09-28T04:23:18.397957+0000","last_undegraded":"2023-09-28T04:23:18.397957+0000","last_fullsized":"2023-09-28T04:23:18.397957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:27:39.596054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390755+0000","last_change":"2023-09-28T04:23:18.385250+0000","last_active":"2023-09-28T04:23:18.390755+0000","last_peered":"2023-09-28T04:23:18.390755+0000","last_clean":"2023-09-28T04:23:18.390755+0000","last_became_active":"2023-09-28T04:23:18.384986+0000","last_became_peered":"2023-09-28T04:23:18.384986+0000","last_unstale":"2023-09-28T04:23:18.390755+0000","last_undegraded":"2023-09-28T04:23:18.390755+0000","last_fullsized":"2023-09-28T04:23:18.390755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:15.500469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404651+0000","last_change":"2023-09-28T04:23:18.402417+0000","last_active":"2023-09-28T04:23:18.404651+0000","last_peered":"2023-09-28T04:23:18.404651+0000","last_clean":"2023-09-28T04:23:18.404651+0000","last_became_active":"2023-09-28T04:23:18.402161+0000","last_became_peered":"2023-09-28T04:23:18.402161+0000","last_unstale":"2023-09-28T04:23:18.404651+0000","last_undegraded":"2023-09-28T04:23:18.404651+0000","last_fullsized":"2023-09-28T04:23:18.404651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:50.909915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391345+0000","last_change":"2023-09-28T04:23:18.387808+0000","last_active":"2023-09-28T04:23:18.391345+0000","last_peered":"2023-09-28T04:23:18.391345+0000","last_clean":"2023-09-28T04:23:18.391345+0000","last_became_active":"2023-09-28T04:23:18.387471+0000","last_became_peered":"2023-09-28T04:23:18.387471+0000","last_unstale":"2023-09-28T04:23:18.391345+0000","last_undegraded":"2023-09-28T04:23:18.391345+0000","last_fullsized":"2023-09-28T04:23:18.391345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401004+0000","last_change":"2023-09-28T04:23:18.396945+0000","last_active":"2023-09-28T04:23:18.401004+0000","last_peered":"2023-09-28T04:23:18.401004+0000","last_clean":"2023-09-28T04:23:18.401004+0000","last_became_active":"2023-09-28T04:23:18.396395+0000","last_became_peered":"2023-09-28T04:23:18.396395+0000","last_unstale":"2023-09-28T04:23:18.401004+0000","last_undegraded":"2023-09-28T04:23:18.401004+0000","last_fullsized":"2023-09-28T04:23:18.401004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397971+0000","last_change":"2023-09-28T04:23:18.393975+0000","last_active":"2023-09-28T04:23:18.397971+0000","last_peered":"2023-09-28T04:23:18.397971+0000","last_clean":"2023-09-28T04:23:18.397971+0000","last_became_active":"2023-09-28T04:23:18.393683+0000","last_became_peered":"2023-09-28T04:23:18.393683+0000","last_unstale":"2023-09-28T04:23:18.397971+0000","last_undegraded":"2023-09-28T04:23:18.397971+0000","last_fullsized":"2023-09-28T04:23:18.397971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:06:40.927453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404561+0000","last_change":"2023-09-28T04:23:18.402518+0000","last_active":"2023-09-28T04:23:18.404561+0000","last_peered":"2023-09-28T04:23:18.404561+0000","last_clean":"2023-09-28T04:23:18.404561+0000","last_became_active":"2023-09-28T04:23:18.402275+0000","last_became_peered":"2023-09-28T04:23:18.402275+0000","last_unstale":"2023-09-28T04:23:18.404561+0000","last_undegraded":"2023-09-28T04:23:18.404561+0000","last_fullsized":"2023-09-28T04:23:18.404561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400750+0000","last_change":"2023-09-28T04:23:18.395032+0000","last_active":"2023-09-28T04:23:18.400750+0000","last_peered":"2023-09-28T04:23:18.400750+0000","last_clean":"2023-09-28T04:23:18.400750+0000","last_became_active":"2023-09-28T04:23:18.390678+0000","last_became_peered":"2023-09-28T04:23:18.390678+0000","last_unstale":"2023-09-28T04:23:18.400750+0000","last_undegraded":"2023-09-28T04:23:18.400750+0000","last_fullsized":"2023-09-28T04:23:18.400750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390373+0000","last_change":"2023-09-28T04:23:18.385209+0000","last_active":"2023-09-28T04:23:18.390373+0000","last_peered":"2023-09-28T04:23:18.390373+0000","last_clean":"2023-09-28T04:23:18.390373+0000","last_became_active":"2023-09-28T04:23:18.384916+0000","last_became_peered":"2023-09-28T04:23:18.384916+0000","last_unstale":"2023-09-28T04:23:18.390373+0000","last_undegraded":"2023-09-28T04:23:18.390373+0000","last_fullsized":"2023-09-28T04:23:18.390373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:06.937552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397758+0000","last_change":"2023-09-28T04:23:18.386692+0000","last_active":"2023-09-28T04:23:18.397758+0000","last_peered":"2023-09-28T04:23:18.397758+0000","last_clean":"2023-09-28T04:23:18.397758+0000","last_became_active":"2023-09-28T04:23:18.385805+0000","last_became_peered":"2023-09-28T04:23:18.385805+0000","last_unstale":"2023-09-28T04:23:18.397758+0000","last_undegraded":"2023-09-28T04:23:18.397758+0000","last_fullsized":"2023-09-28T04:23:18.397758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:52:07.899487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401120+0000","last_change":"2023-09-28T04:23:18.400497+0000","last_active":"2023-09-28T04:23:18.401120+0000","last_peered":"2023-09-28T04:23:18.401120+0000","last_clean":"2023-09-28T04:23:18.401120+0000","last_became_active":"2023-09-28T04:23:18.400230+0000","last_became_peered":"2023-09-28T04:23:18.400230+0000","last_unstale":"2023-09-28T04:23:18.401120+0000","last_undegraded":"2023-09-28T04:23:18.401120+0000","last_fullsized":"2023-09-28T04:23:18.401120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399068+0000","last_change":"2023-09-28T04:23:18.391683+0000","last_active":"2023-09-28T04:23:18.399068+0000","last_peered":"2023-09-28T04:23:18.399068+0000","last_clean":"2023-09-28T04:23:18.399068+0000","last_became_active":"2023-09-28T04:23:18.391373+0000","last_became_peered":"2023-09-28T04:23:18.391373+0000","last_unstale":"2023-09-28T04:23:18.399068+0000","last_undegraded":"2023-09-28T04:23:18.399068+0000","last_fullsized":"2023-09-28T04:23:18.399068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402238+0000","last_change":"2023-09-28T04:23:18.393381+0000","last_active":"2023-09-28T04:23:18.402238+0000","last_peered":"2023-09-28T04:23:18.402238+0000","last_clean":"2023-09-28T04:23:18.402238+0000","last_became_active":"2023-09-28T04:23:18.392723+0000","last_became_peered":"2023-09-28T04:23:18.392723+0000","last_unstale":"2023-09-28T04:23:18.402238+0000","last_undegraded":"2023-09-28T04:23:18.402238+0000","last_fullsized":"2023-09-28T04:23:18.402238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.403069+0000","last_change":"2023-09-28T04:23:18.402467+0000","last_active":"2023-09-28T04:23:18.403069+0000","last_peered":"2023-09-28T04:23:18.403069+0000","last_clean":"2023-09-28T04:23:18.403069+0000","last_became_active":"2023-09-28T04:23:18.402197+0000","last_became_peered":"2023-09-28T04:23:18.402197+0000","last_unstale":"2023-09-28T04:23:18.403069+0000","last_undegraded":"2023-09-28T04:23:18.403069+0000","last_fullsized":"2023-09-28T04:23:18.403069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.396757+0000","last_change":"2023-09-28T04:23:18.389242+0000","last_active":"2023-09-28T04:23:18.396757+0000","last_peered":"2023-09-28T04:23:18.396757+0000","last_clean":"2023-09-28T04:23:18.396757+0000","last_became_active":"2023-09-28T04:23:18.388936+0000","last_became_peered":"2023-09-28T04:23:18.388936+0000","last_unstale":"2023-09-28T04:23:18.396757+0000","last_undegraded":"2023-09-28T04:23:18.396757+0000","last_fullsized":"2023-09-28T04:23:18.396757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:19.108476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395209+0000","last_change":"2023-09-28T04:23:18.388941+0000","last_active":"2023-09-28T04:23:18.395209+0000","last_peered":"2023-09-28T04:23:18.395209+0000","last_clean":"2023-09-28T04:23:18.395209+0000","last_became_active":"2023-09-28T04:23:18.388682+0000","last_became_peered":"2023-09-28T04:23:18.388682+0000","last_unstale":"2023-09-28T04:23:18.395209+0000","last_undegraded":"2023-09-28T04:23:18.395209+0000","last_fullsized":"2023-09-28T04:23:18.395209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395293+0000","last_change":"2023-09-28T04:23:18.391753+0000","last_active":"2023-09-28T04:23:18.395293+0000","last_peered":"2023-09-28T04:23:18.395293+0000","last_clean":"2023-09-28T04:23:18.395293+0000","last_became_active":"2023-09-28T04:23:18.391031+0000","last_became_peered":"2023-09-28T04:23:18.391031+0000","last_unstale":"2023-09-28T04:23:18.395293+0000","last_undegraded":"2023-09-28T04:23:18.395293+0000","last_fullsized":"2023-09-28T04:23:18.395293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377252+0000","last_change":"2023-09-28T04:23:17.914158+0000","last_active":"2023-09-28T04:23:19.377252+0000","last_peered":"2023-09-28T04:23:19.377252+0000","last_clean":"2023-09-28T04:23:19.377252+0000","last_became_active":"2023-09-28T04:23:17.913941+0000","last_became_peered":"2023-09-28T04:23:17.913941+0000","last_unstale":"2023-09-28T04:23:19.377252+0000","last_undegraded":"2023-09-28T04:23:19.377252+0000","last_fullsized":"2023-09-28T04:23:19.377252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401811+0000","last_change":"2023-09-28T04:23:18.390288+0000","last_active":"2023-09-28T04:23:18.401811+0000","last_peered":"2023-09-28T04:23:18.401811+0000","last_clean":"2023-09-28T04:23:18.401811+0000","last_became_active":"2023-09-28T04:23:18.390030+0000","last_became_peered":"2023-09-28T04:23:18.390030+0000","last_unstale":"2023-09-28T04:23:18.401811+0000","last_undegraded":"2023-09-28T04:23:18.401811+0000","last_fullsized":"2023-09-28T04:23:18.401811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377746+0000","last_change":"2023-09-28T04:23:17.914311+0000","last_active":"2023-09-28T04:23:18.377746+0000","last_peered":"2023-09-28T04:23:18.377746+0000","last_clean":"2023-09-28T04:23:18.377746+0000","last_became_active":"2023-09-28T04:23:17.913950+0000","last_became_peered":"2023-09-28T04:23:17.913950+0000","last_unstale":"2023-09-28T04:23:18.377746+0000","last_undegraded":"2023-09-28T04:23:18.377746+0000","last_fullsized":"2023-09-28T04:23:18.377746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399162+0000","last_change":"2023-09-28T04:23:18.393402+0000","last_active":"2023-09-28T04:23:18.399162+0000","last_peered":"2023-09-28T04:23:18.399162+0000","last_clean":"2023-09-28T04:23:18.399162+0000","last_became_active":"2023-09-28T04:23:18.393106+0000","last_became_peered":"2023-09-28T04:23:18.393106+0000","last_unstale":"2023-09-28T04:23:18.399162+0000","last_undegraded":"2023-09-28T04:23:18.399162+0000","last_fullsized":"2023-09-28T04:23:18.399162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.375882+0000","last_change":"2023-09-28T04:23:17.911104+0000","last_active":"2023-09-28T04:23:19.375882+0000","last_peered":"2023-09-28T04:23:19.375882+0000","last_clean":"2023-09-28T04:23:19.375882+0000","last_became_active":"2023-09-28T04:23:17.910766+0000","last_became_peered":"2023-09-28T04:23:17.910766+0000","last_unstale":"2023-09-28T04:23:19.375882+0000","last_undegraded":"2023-09-28T04:23:19.375882+0000","last_fullsized":"2023-09-28T04:23:19.375882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391763+0000","last_change":"2023-09-28T04:23:18.388098+0000","last_active":"2023-09-28T04:23:18.391763+0000","last_peered":"2023-09-28T04:23:18.391763+0000","last_clean":"2023-09-28T04:23:18.391763+0000","last_became_active":"2023-09-28T04:23:18.387581+0000","last_became_peered":"2023-09-28T04:23:18.387581+0000","last_unstale":"2023-09-28T04:23:18.391763+0000","last_undegraded":"2023-09-28T04:23:18.391763+0000","last_fullsized":"2023-09-28T04:23:18.391763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:11.090984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.409275+0000","last_change":"2023-09-28T04:23:17.917921+0000","last_active":"2023-09-28T04:23:28.409275+0000","last_peered":"2023-09-28T04:23:28.409275+0000","last_clean":"2023-09-28T04:23:28.409275+0000","last_became_active":"2023-09-28T04:23:17.917596+0000","last_became_peered":"2023-09-28T04:23:17.917596+0000","last_unstale":"2023-09-28T04:23:28.409275+0000","last_undegraded":"2023-09-28T04:23:28.409275+0000","last_fullsized":"2023-09-28T04:23:28.409275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402470+0000","last_change":"2023-09-28T04:23:18.394460+0000","last_active":"2023-09-28T04:23:18.402470+0000","last_peered":"2023-09-28T04:23:18.402470+0000","last_clean":"2023-09-28T04:23:18.402470+0000","last_became_active":"2023-09-28T04:23:18.391773+0000","last_became_peered":"2023-09-28T04:23:18.391773+0000","last_unstale":"2023-09-28T04:23:18.402470+0000","last_undegraded":"2023-09-28T04:23:18.402470+0000","last_fullsized":"2023-09-28T04:23:18.402470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.408519+0000","last_change":"2023-09-28T04:23:17.908875+0000","last_active":"2023-09-28T04:23:28.408519+0000","last_peered":"2023-09-28T04:23:28.408519+0000","last_clean":"2023-09-28T04:23:28.408519+0000","last_became_active":"2023-09-28T04:23:17.908599+0000","last_became_peered":"2023-09-28T04:23:17.908599+0000","last_unstale":"2023-09-28T04:23:28.408519+0000","last_undegraded":"2023-09-28T04:23:28.408519+0000","last_fullsized":"2023-09-28T04:23:28.408519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402255+0000","last_change":"2023-09-28T04:23:18.393856+0000","last_active":"2023-09-28T04:23:18.402255+0000","last_peered":"2023-09-28T04:23:18.402255+0000","last_clean":"2023-09-28T04:23:18.402255+0000","last_became_active":"2023-09-28T04:23:18.393631+0000","last_became_peered":"2023-09-28T04:23:18.393631+0000","last_unstale":"2023-09-28T04:23:18.402255+0000","last_undegraded":"2023-09-28T04:23:18.402255+0000","last_fullsized":"2023-09-28T04:23:18.402255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.385554+0000","last_change":"2023-09-28T04:23:17.911594+0000","last_active":"2023-09-28T04:23:23.385554+0000","last_peered":"2023-09-28T04:23:23.385554+0000","last_clean":"2023-09-28T04:23:23.385554+0000","last_became_active":"2023-09-28T04:23:17.911361+0000","last_became_peered":"2023-09-28T04:23:17.911361+0000","last_unstale":"2023-09-28T04:23:23.385554+0000","last_undegraded":"2023-09-28T04:23:23.385554+0000","last_fullsized":"2023-09-28T04:23:23.385554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.394029+0000","last_change":"2023-09-28T04:23:18.387908+0000","last_active":"2023-09-28T04:23:18.394029+0000","last_peered":"2023-09-28T04:23:18.394029+0000","last_clean":"2023-09-28T04:23:18.394029+0000","last_became_active":"2023-09-28T04:23:18.387672+0000","last_became_peered":"2023-09-28T04:23:18.387672+0000","last_unstale":"2023-09-28T04:23:18.394029+0000","last_undegraded":"2023-09-28T04:23:18.394029+0000","last_fullsized":"2023-09-28T04:23:18.394029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.408892+0000","last_change":"2023-09-28T04:23:17.904974+0000","last_active":"2023-09-28T04:23:28.408892+0000","last_peered":"2023-09-28T04:23:28.408892+0000","last_clean":"2023-09-28T04:23:28.408892+0000","last_became_active":"2023-09-28T04:23:17.904734+0000","last_became_peered":"2023-09-28T04:23:17.904734+0000","last_unstale":"2023-09-28T04:23:28.408892+0000","last_undegraded":"2023-09-28T04:23:28.408892+0000","last_fullsized":"2023-09-28T04:23:28.408892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397872+0000","last_change":"2023-09-28T04:23:18.389128+0000","last_active":"2023-09-28T04:23:18.397872+0000","last_peered":"2023-09-28T04:23:18.397872+0000","last_clean":"2023-09-28T04:23:18.397872+0000","last_became_active":"2023-09-28T04:23:18.388871+0000","last_became_peered":"2023-09-28T04:23:18.388871+0000","last_unstale":"2023-09-28T04:23:18.397872+0000","last_undegraded":"2023-09-28T04:23:18.397872+0000","last_fullsized":"2023-09-28T04:23:18.397872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:33:50.957431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.413049+0000","last_change":"2023-09-28T04:23:17.910343+0000","last_active":"2023-09-28T04:23:28.413049+0000","last_peered":"2023-09-28T04:23:28.413049+0000","last_clean":"2023-09-28T04:23:28.413049+0000","last_became_active":"2023-09-28T04:23:17.909981+0000","last_became_peered":"2023-09-28T04:23:17.909981+0000","last_unstale":"2023-09-28T04:23:28.413049+0000","last_undegraded":"2023-09-28T04:23:28.413049+0000","last_fullsized":"2023-09-28T04:23:28.413049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:11.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402619+0000","last_change":"2023-09-28T04:23:18.391696+0000","last_active":"2023-09-28T04:23:18.402619+0000","last_peered":"2023-09-28T04:23:18.402619+0000","last_clean":"2023-09-28T04:23:18.402619+0000","last_became_active":"2023-09-28T04:23:18.391441+0000","last_became_peered":"2023-09-28T04:23:18.391441+0000","last_unstale":"2023-09-28T04:23:18.402619+0000","last_undegraded":"2023-09-28T04:23:18.402619+0000","last_fullsized":"2023-09-28T04:23:18.402619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412822+0000","last_change":"2023-09-28T04:23:17.916730+0000","last_active":"2023-09-28T04:23:28.412822+0000","last_peered":"2023-09-28T04:23:28.412822+0000","last_clean":"2023-09-28T04:23:28.412822+0000","last_became_active":"2023-09-28T04:23:17.916424+0000","last_became_peered":"2023-09-28T04:23:17.916424+0000","last_unstale":"2023-09-28T04:23:28.412822+0000","last_undegraded":"2023-09-28T04:23:28.412822+0000","last_fullsized":"2023-09-28T04:23:28.412822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392344+0000","last_change":"2023-09-28T04:23:18.391510+0000","last_active":"2023-09-28T04:23:18.392344+0000","last_peered":"2023-09-28T04:23:18.392344+0000","last_clean":"2023-09-28T04:23:18.392344+0000","last_became_active":"2023-09-28T04:23:18.390613+0000","last_became_peered":"2023-09-28T04:23:18.390613+0000","last_unstale":"2023-09-28T04:23:18.392344+0000","last_undegraded":"2023-09-28T04:23:18.392344+0000","last_fullsized":"2023-09-28T04:23:18.392344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386635+0000","last_change":"2023-09-28T04:23:17.910760+0000","last_active":"2023-09-28T04:23:18.386635+0000","last_peered":"2023-09-28T04:23:18.386635+0000","last_clean":"2023-09-28T04:23:18.386635+0000","last_became_active":"2023-09-28T04:23:17.910457+0000","last_became_peered":"2023-09-28T04:23:17.910457+0000","last_unstale":"2023-09-28T04:23:18.386635+0000","last_undegraded":"2023-09-28T04:23:18.386635+0000","last_fullsized":"2023-09-28T04:23:18.386635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:10.087083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404516+0000","last_change":"2023-09-28T04:23:18.402823+0000","last_active":"2023-09-28T04:23:18.404516+0000","last_peered":"2023-09-28T04:23:18.404516+0000","last_clean":"2023-09-28T04:23:18.404516+0000","last_became_active":"2023-09-28T04:23:18.402559+0000","last_became_peered":"2023-09-28T04:23:18.402559+0000","last_unstale":"2023-09-28T04:23:18.404516+0000","last_undegraded":"2023-09-28T04:23:18.404516+0000","last_fullsized":"2023-09-28T04:23:18.404516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'10","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.410794+0000","last_change":"2023-09-28T04:23:17.910972+0000","last_active":"2023-09-28T04:23:28.410794+0000","last_peered":"2023-09-28T04:23:28.410794+0000","last_clean":"2023-09-28T04:23:28.410794+0000","last_became_active":"2023-09-28T04:23:17.910650+0000","last_became_peered":"2023-09-28T04:23:17.910650+0000","last_unstale":"2023-09-28T04:23:28.410794+0000","last_undegraded":"2023-09-28T04:23:28.410794+0000","last_fullsized":"2023-09-28T04:23:28.410794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:03:36.553513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402556+0000","last_change":"2023-09-28T04:23:18.395424+0000","last_active":"2023-09-28T04:23:18.402556+0000","last_peered":"2023-09-28T04:23:18.402556+0000","last_clean":"2023-09-28T04:23:18.402556+0000","last_became_active":"2023-09-28T04:23:18.394721+0000","last_became_peered":"2023-09-28T04:23:18.394721+0000","last_unstale":"2023-09-28T04:23:18.402556+0000","last_undegraded":"2023-09-28T04:23:18.402556+0000","last_fullsized":"2023-09-28T04:23:18.402556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.173007+0000","last_change":"2023-09-28T04:23:17.907642+0000","last_active":"2023-09-28T04:23:20.173007+0000","last_peered":"2023-09-28T04:23:20.173007+0000","last_clean":"2023-09-28T04:23:20.173007+0000","last_became_active":"2023-09-28T04:23:17.907331+0000","last_became_peered":"2023-09-28T04:23:17.907331+0000","last_unstale":"2023-09-28T04:23:20.173007+0000","last_undegraded":"2023-09-28T04:23:20.173007+0000","last_fullsized":"2023-09-28T04:23:20.173007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.393277+0000","last_change":"2023-09-28T04:23:18.390910+0000","last_active":"2023-09-28T04:23:18.393277+0000","last_peered":"2023-09-28T04:23:18.393277+0000","last_clean":"2023-09-28T04:23:18.393277+0000","last_became_active":"2023-09-28T04:23:18.390633+0000","last_became_peered":"2023-09-28T04:23:18.390633+0000","last_unstale":"2023-09-28T04:23:18.393277+0000","last_undegraded":"2023-09-28T04:23:18.393277+0000","last_fullsized":"2023-09-28T04:23:18.393277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.383758+0000","last_change":"2023-09-28T04:23:17.906320+0000","last_active":"2023-09-28T04:23:23.383758+0000","last_peered":"2023-09-28T04:23:23.383758+0000","last_clean":"2023-09-28T04:23:23.383758+0000","last_became_active":"2023-09-28T04:23:17.906036+0000","last_became_peered":"2023-09-28T04:23:17.906036+0000","last_unstale":"2023-09-28T04:23:23.383758+0000","last_undegraded":"2023-09-28T04:23:23.383758+0000","last_fullsized":"2023-09-28T04:23:23.383758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397773+0000","last_change":"2023-09-28T04:23:18.386196+0000","last_active":"2023-09-28T04:23:18.397773+0000","last_peered":"2023-09-28T04:23:18.397773+0000","last_clean":"2023-09-28T04:23:18.397773+0000","last_became_active":"2023-09-28T04:23:18.385693+0000","last_became_peered":"2023-09-28T04:23:18.385693+0000","last_unstale":"2023-09-28T04:23:18.397773+0000","last_undegraded":"2023-09-28T04:23:18.397773+0000","last_fullsized":"2023-09-28T04:23:18.397773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172978+0000","last_change":"2023-09-28T04:23:17.908768+0000","last_active":"2023-09-28T04:23:20.172978+0000","last_peered":"2023-09-28T04:23:20.172978+0000","last_clean":"2023-09-28T04:23:20.172978+0000","last_became_active":"2023-09-28T04:23:17.908493+0000","last_became_peered":"2023-09-28T04:23:17.908493+0000","last_unstale":"2023-09-28T04:23:20.172978+0000","last_undegraded":"2023-09-28T04:23:20.172978+0000","last_fullsized":"2023-09-28T04:23:20.172978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388563+0000","last_change":"2023-09-28T04:23:18.385404+0000","last_active":"2023-09-28T04:23:18.388563+0000","last_peered":"2023-09-28T04:23:18.388563+0000","last_clean":"2023-09-28T04:23:18.388563+0000","last_became_active":"2023-09-28T04:23:18.385112+0000","last_became_peered":"2023-09-28T04:23:18.385112+0000","last_unstale":"2023-09-28T04:23:18.388563+0000","last_undegraded":"2023-09-28T04:23:18.388563+0000","last_fullsized":"2023-09-28T04:23:18.388563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:06.331056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378811+0000","last_change":"2023-09-28T04:23:17.898518+0000","last_active":"2023-09-28T04:23:18.378811+0000","last_peered":"2023-09-28T04:23:18.378811+0000","last_clean":"2023-09-28T04:23:18.378811+0000","last_became_active":"2023-09-28T04:23:17.898232+0000","last_became_peered":"2023-09-28T04:23:17.898232+0000","last_unstale":"2023-09-28T04:23:18.378811+0000","last_undegraded":"2023-09-28T04:23:18.378811+0000","last_fullsized":"2023-09-28T04:23:18.378811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399188+0000","last_change":"2023-09-28T04:23:18.392206+0000","last_active":"2023-09-28T04:23:18.399188+0000","last_peered":"2023-09-28T04:23:18.399188+0000","last_clean":"2023-09-28T04:23:18.399188+0000","last_became_active":"2023-09-28T04:23:18.391963+0000","last_became_peered":"2023-09-28T04:23:18.391963+0000","last_unstale":"2023-09-28T04:23:18.399188+0000","last_undegraded":"2023-09-28T04:23:18.399188+0000","last_fullsized":"2023-09-28T04:23:18.399188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.410038+0000","last_change":"2023-09-28T04:23:17.905390+0000","last_active":"2023-09-28T04:23:28.410038+0000","last_peered":"2023-09-28T04:23:28.410038+0000","last_clean":"2023-09-28T04:23:28.410038+0000","last_became_active":"2023-09-28T04:23:17.905089+0000","last_became_peered":"2023-09-28T04:23:17.905089+0000","last_unstale":"2023-09-28T04:23:28.410038+0000","last_undegraded":"2023-09-28T04:23:28.410038+0000","last_fullsized":"2023-09-28T04:23:28.410038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401474+0000","last_change":"2023-09-28T04:23:18.400110+0000","last_active":"2023-09-28T04:23:18.401474+0000","last_peered":"2023-09-28T04:23:18.401474+0000","last_clean":"2023-09-28T04:23:18.401474+0000","last_became_active":"2023-09-28T04:23:18.399839+0000","last_became_peered":"2023-09-28T04:23:18.399839+0000","last_unstale":"2023-09-28T04:23:18.401474+0000","last_undegraded":"2023-09-28T04:23:18.401474+0000","last_fullsized":"2023-09-28T04:23:18.401474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377378+0000","last_change":"2023-09-28T04:23:17.912734+0000","last_active":"2023-09-28T04:23:18.377378+0000","last_peered":"2023-09-28T04:23:18.377378+0000","last_clean":"2023-09-28T04:23:18.377378+0000","last_became_active":"2023-09-28T04:23:17.912560+0000","last_became_peered":"2023-09-28T04:23:17.912560+0000","last_unstale":"2023-09-28T04:23:18.377378+0000","last_undegraded":"2023-09-28T04:23:18.377378+0000","last_fullsized":"2023-09-28T04:23:18.377378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397919+0000","last_change":"2023-09-28T04:23:18.393554+0000","last_active":"2023-09-28T04:23:18.397919+0000","last_peered":"2023-09-28T04:23:18.397919+0000","last_clean":"2023-09-28T04:23:18.397919+0000","last_became_active":"2023-09-28T04:23:18.390268+0000","last_became_peered":"2023-09-28T04:23:18.390268+0000","last_unstale":"2023-09-28T04:23:18.397919+0000","last_undegraded":"2023-09-28T04:23:18.397919+0000","last_fullsized":"2023-09-28T04:23:18.397919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412334+0000","last_change":"2023-09-28T04:23:17.911218+0000","last_active":"2023-09-28T04:23:28.412334+0000","last_peered":"2023-09-28T04:23:28.412334+0000","last_clean":"2023-09-28T04:23:28.412334+0000","last_became_active":"2023-09-28T04:23:17.910887+0000","last_became_peered":"2023-09-28T04:23:17.910887+0000","last_unstale":"2023-09-28T04:23:28.412334+0000","last_undegraded":"2023-09-28T04:23:28.412334+0000","last_fullsized":"2023-09-28T04:23:28.412334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397818+0000","last_change":"2023-09-28T04:23:18.387932+0000","last_active":"2023-09-28T04:23:18.397818+0000","last_peered":"2023-09-28T04:23:18.397818+0000","last_clean":"2023-09-28T04:23:18.397818+0000","last_became_active":"2023-09-28T04:23:18.387667+0000","last_became_peered":"2023-09-28T04:23:18.387667+0000","last_unstale":"2023-09-28T04:23:18.397818+0000","last_undegraded":"2023-09-28T04:23:18.397818+0000","last_fullsized":"2023-09-28T04:23:18.397818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:46:23.383130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.410224+0000","last_change":"2023-09-28T04:23:17.911764+0000","last_active":"2023-09-28T04:23:28.410224+0000","last_peered":"2023-09-28T04:23:28.410224+0000","last_clean":"2023-09-28T04:23:28.410224+0000","last_became_active":"2023-09-28T04:23:17.911458+0000","last_became_peered":"2023-09-28T04:23:17.911458+0000","last_unstale":"2023-09-28T04:23:28.410224+0000","last_undegraded":"2023-09-28T04:23:28.410224+0000","last_fullsized":"2023-09-28T04:23:28.410224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402635+0000","last_change":"2023-09-28T04:23:18.400278+0000","last_active":"2023-09-28T04:23:18.402635+0000","last_peered":"2023-09-28T04:23:18.402635+0000","last_clean":"2023-09-28T04:23:18.402635+0000","last_became_active":"2023-09-28T04:23:18.399957+0000","last_became_peered":"2023-09-28T04:23:18.399957+0000","last_unstale":"2023-09-28T04:23:18.402635+0000","last_undegraded":"2023-09-28T04:23:18.402635+0000","last_fullsized":"2023-09-28T04:23:18.402635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:01:52.295558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377068+0000","last_change":"2023-09-28T04:23:13.017727+0000","last_active":"2023-09-28T04:23:18.377068+0000","last_peered":"2023-09-28T04:23:18.377068+0000","last_clean":"2023-09-28T04:23:18.377068+0000","last_became_active":"2023-09-28T04:23:13.017362+0000","last_became_peered":"2023-09-28T04:23:13.017362+0000","last_unstale":"2023-09-28T04:23:18.377068+0000","last_undegraded":"2023-09-28T04:23:18.377068+0000","last_fullsized":"2023-09-28T04:23:18.377068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376624+0000","last_change":"2023-09-28T04:23:17.899128+0000","last_active":"2023-09-28T04:23:19.376624+0000","last_peered":"2023-09-28T04:23:19.376624+0000","last_clean":"2023-09-28T04:23:19.376624+0000","last_became_active":"2023-09-28T04:23:17.898878+0000","last_became_peered":"2023-09-28T04:23:17.898878+0000","last_unstale":"2023-09-28T04:23:19.376624+0000","last_undegraded":"2023-09-28T04:23:19.376624+0000","last_fullsized":"2023-09-28T04:23:19.376624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388439+0000","last_change":"2023-09-28T04:23:18.384565+0000","last_active":"2023-09-28T04:23:18.388439+0000","last_peered":"2023-09-28T04:23:18.388439+0000","last_clean":"2023-09-28T04:23:18.388439+0000","last_became_active":"2023-09-28T04:23:18.383969+0000","last_became_peered":"2023-09-28T04:23:18.383969+0000","last_unstale":"2023-09-28T04:23:18.388439+0000","last_undegraded":"2023-09-28T04:23:18.388439+0000","last_fullsized":"2023-09-28T04:23:18.388439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379488+0000","last_change":"2023-09-28T04:23:12.604091+0000","last_active":"2023-09-28T04:23:18.379488+0000","last_peered":"2023-09-28T04:23:18.379488+0000","last_clean":"2023-09-28T04:23:18.379488+0000","last_became_active":"2023-09-28T04:23:12.603804+0000","last_became_peered":"2023-09-28T04:23:12.603804+0000","last_unstale":"2023-09-28T04:23:18.379488+0000","last_undegraded":"2023-09-28T04:23:18.379488+0000","last_fullsized":"2023-09-28T04:23:18.379488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412365+0000","last_change":"2023-09-28T04:23:17.918999+0000","last_active":"2023-09-28T04:23:28.412365+0000","last_peered":"2023-09-28T04:23:28.412365+0000","last_clean":"2023-09-28T04:23:28.412365+0000","last_became_active":"2023-09-28T04:23:17.918740+0000","last_became_peered":"2023-09-28T04:23:17.918740+0000","last_unstale":"2023-09-28T04:23:28.412365+0000","last_undegraded":"2023-09-28T04:23:28.412365+0000","last_fullsized":"2023-09-28T04:23:28.412365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395808+0000","last_change":"2023-09-28T04:23:18.389350+0000","last_active":"2023-09-28T04:23:18.395808+0000","last_peered":"2023-09-28T04:23:18.395808+0000","last_clean":"2023-09-28T04:23:18.395808+0000","last_became_active":"2023-09-28T04:23:18.389059+0000","last_became_peered":"2023-09-28T04:23:18.389059+0000","last_unstale":"2023-09-28T04:23:18.395808+0000","last_undegraded":"2023-09-28T04:23:18.395808+0000","last_fullsized":"2023-09-28T04:23:18.395808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378640+0000","last_change":"2023-09-28T04:23:12.602100+0000","last_active":"2023-09-28T04:23:18.378640+0000","last_peered":"2023-09-28T04:23:18.378640+0000","last_clean":"2023-09-28T04:23:18.378640+0000","last_became_active":"2023-09-28T04:23:12.601652+0000","last_became_peered":"2023-09-28T04:23:12.601652+0000","last_unstale":"2023-09-28T04:23:18.378640+0000","last_undegraded":"2023-09-28T04:23:18.378640+0000","last_fullsized":"2023-09-28T04:23:18.378640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:37:16.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.450482+0000","last_change":"2023-09-28T04:23:17.911566+0000","last_active":"2023-09-28T04:23:19.450482+0000","last_peered":"2023-09-28T04:23:19.450482+0000","last_clean":"2023-09-28T04:23:19.450482+0000","last_became_active":"2023-09-28T04:23:17.911308+0000","last_became_peered":"2023-09-28T04:23:17.911308+0000","last_unstale":"2023-09-28T04:23:19.450482+0000","last_undegraded":"2023-09-28T04:23:19.450482+0000","last_fullsized":"2023-09-28T04:23:19.450482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395489+0000","last_change":"2023-09-28T04:23:18.388204+0000","last_active":"2023-09-28T04:23:18.395489+0000","last_peered":"2023-09-28T04:23:18.395489+0000","last_clean":"2023-09-28T04:23:18.395489+0000","last_became_active":"2023-09-28T04:23:18.387945+0000","last_became_peered":"2023-09-28T04:23:18.387945+0000","last_unstale":"2023-09-28T04:23:18.395489+0000","last_undegraded":"2023-09-28T04:23:18.395489+0000","last_fullsized":"2023-09-28T04:23:18.395489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378668+0000","last_change":"2023-09-28T04:23:12.604212+0000","last_active":"2023-09-28T04:23:18.378668+0000","last_peered":"2023-09-28T04:23:18.378668+0000","last_clean":"2023-09-28T04:23:18.378668+0000","last_became_active":"2023-09-28T04:23:12.603930+0000","last_became_peered":"2023-09-28T04:23:12.603930+0000","last_unstale":"2023-09-28T04:23:18.378668+0000","last_undegraded":"2023-09-28T04:23:18.378668+0000","last_fullsized":"2023-09-28T04:23:18.378668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386718+0000","last_change":"2023-09-28T04:23:11.608534+0000","last_active":"2023-09-28T04:23:18.386718+0000","last_peered":"2023-09-28T04:23:18.386718+0000","last_clean":"2023-09-28T04:23:18.386718+0000","last_became_active":"2023-09-28T04:23:11.608249+0000","last_became_peered":"2023-09-28T04:23:11.608249+0000","last_unstale":"2023-09-28T04:23:18.386718+0000","last_undegraded":"2023-09-28T04:23:18.386718+0000","last_fullsized":"2023-09-28T04:23:18.386718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_clean_scrub_stamp":"2023-09-28T04:23:10.587579+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:10.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.375491+0000","last_change":"2023-09-28T04:23:17.902709+0000","last_active":"2023-09-28T04:23:18.375491+0000","last_peered":"2023-09-28T04:23:18.375491+0000","last_clean":"2023-09-28T04:23:18.375491+0000","last_became_active":"2023-09-28T04:23:17.902341+0000","last_became_peered":"2023-09-28T04:23:17.902341+0000","last_unstale":"2023-09-28T04:23:18.375491+0000","last_undegraded":"2023-09-28T04:23:18.375491+0000","last_fullsized":"2023-09-28T04:23:18.375491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392913+0000","last_change":"2023-09-28T04:23:18.389982+0000","last_active":"2023-09-28T04:23:18.392913+0000","last_peered":"2023-09-28T04:23:18.392913+0000","last_clean":"2023-09-28T04:23:18.392913+0000","last_became_active":"2023-09-28T04:23:18.389692+0000","last_became_peered":"2023-09-28T04:23:18.389692+0000","last_unstale":"2023-09-28T04:23:18.392913+0000","last_undegraded":"2023-09-28T04:23:18.392913+0000","last_fullsized":"2023-09-28T04:23:18.392913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386996+0000","last_change":"2023-09-28T04:23:12.605908+0000","last_active":"2023-09-28T04:23:18.386996+0000","last_peered":"2023-09-28T04:23:18.386996+0000","last_clean":"2023-09-28T04:23:18.386996+0000","last_became_active":"2023-09-28T04:23:12.605668+0000","last_became_peered":"2023-09-28T04:23:12.605668+0000","last_unstale":"2023-09-28T04:23:18.386996+0000","last_undegraded":"2023-09-28T04:23:18.386996+0000","last_fullsized":"2023-09-28T04:23:18.386996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172039+0000","last_change":"2023-09-28T04:23:17.918410+0000","last_active":"2023-09-28T04:23:20.172039+0000","last_peered":"2023-09-28T04:23:20.172039+0000","last_clean":"2023-09-28T04:23:20.172039+0000","last_became_active":"2023-09-28T04:23:17.918130+0000","last_became_peered":"2023-09-28T04:23:17.918130+0000","last_unstale":"2023-09-28T04:23:20.172039+0000","last_undegraded":"2023-09-28T04:23:20.172039+0000","last_fullsized":"2023-09-28T04:23:20.172039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399143+0000","last_change":"2023-09-28T04:23:18.391987+0000","last_active":"2023-09-28T04:23:18.399143+0000","last_peered":"2023-09-28T04:23:18.399143+0000","last_clean":"2023-09-28T04:23:18.399143+0000","last_became_active":"2023-09-28T04:23:18.391709+0000","last_became_peered":"2023-09-28T04:23:18.391709+0000","last_unstale":"2023-09-28T04:23:18.399143+0000","last_undegraded":"2023-09-28T04:23:18.399143+0000","last_fullsized":"2023-09-28T04:23:18.399143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386509+0000","last_change":"2023-09-28T04:23:13.017715+0000","last_active":"2023-09-28T04:23:18.386509+0000","last_peered":"2023-09-28T04:23:18.386509+0000","last_clean":"2023-09-28T04:23:18.386509+0000","last_became_active":"2023-09-28T04:23:13.017398+0000","last_became_peered":"2023-09-28T04:23:13.017398+0000","last_unstale":"2023-09-28T04:23:18.386509+0000","last_undegraded":"2023-09-28T04:23:18.386509+0000","last_fullsized":"2023-09-28T04:23:18.386509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:37:41.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377174+0000","last_change":"2023-09-28T04:23:17.912291+0000","last_active":"2023-09-28T04:23:18.377174+0000","last_peered":"2023-09-28T04:23:18.377174+0000","last_clean":"2023-09-28T04:23:18.377174+0000","last_became_active":"2023-09-28T04:23:17.912023+0000","last_became_peered":"2023-09-28T04:23:17.912023+0000","last_unstale":"2023-09-28T04:23:18.377174+0000","last_undegraded":"2023-09-28T04:23:18.377174+0000","last_fullsized":"2023-09-28T04:23:18.377174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399280+0000","last_change":"2023-09-28T04:23:18.396451+0000","last_active":"2023-09-28T04:23:18.399280+0000","last_peered":"2023-09-28T04:23:18.399280+0000","last_clean":"2023-09-28T04:23:18.399280+0000","last_became_active":"2023-09-28T04:23:18.396190+0000","last_became_peered":"2023-09-28T04:23:18.396190+0000","last_unstale":"2023-09-28T04:23:18.399280+0000","last_undegraded":"2023-09-28T04:23:18.399280+0000","last_fullsized":"2023-09-28T04:23:18.399280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.408972+0000","last_change":"2023-09-28T04:23:17.904739+0000","last_active":"2023-09-28T04:23:28.408972+0000","last_peered":"2023-09-28T04:23:28.408972+0000","last_clean":"2023-09-28T04:23:28.408972+0000","last_became_active":"2023-09-28T04:23:17.903844+0000","last_became_peered":"2023-09-28T04:23:17.903844+0000","last_unstale":"2023-09-28T04:23:28.408972+0000","last_undegraded":"2023-09-28T04:23:28.408972+0000","last_fullsized":"2023-09-28T04:23:28.408972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377634+0000","last_change":"2023-09-28T04:23:12.606496+0000","last_active":"2023-09-28T04:23:18.377634+0000","last_peered":"2023-09-28T04:23:18.377634+0000","last_clean":"2023-09-28T04:23:18.377634+0000","last_became_active":"2023-09-28T04:23:12.606143+0000","last_became_peered":"2023-09-28T04:23:12.606143+0000","last_unstale":"2023-09-28T04:23:18.377634+0000","last_undegraded":"2023-09-28T04:23:18.377634+0000","last_fullsized":"2023-09-28T04:23:18.377634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402487+0000","last_change":"2023-09-28T04:23:18.396153+0000","last_active":"2023-09-28T04:23:18.402487+0000","last_peered":"2023-09-28T04:23:18.402487+0000","last_clean":"2023-09-28T04:23:18.402487+0000","last_became_active":"2023-09-28T04:23:18.392092+0000","last_became_peered":"2023-09-28T04:23:18.392092+0000","last_unstale":"2023-09-28T04:23:18.402487+0000","last_undegraded":"2023-09-28T04:23:18.402487+0000","last_fullsized":"2023-09-28T04:23:18.402487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379277+0000","last_change":"2023-09-28T04:23:12.606390+0000","last_active":"2023-09-28T04:23:18.379277+0000","last_peered":"2023-09-28T04:23:18.379277+0000","last_clean":"2023-09-28T04:23:18.379277+0000","last_became_active":"2023-09-28T04:23:12.605965+0000","last_became_peered":"2023-09-28T04:23:12.605965+0000","last_unstale":"2023-09-28T04:23:18.379277+0000","last_undegraded":"2023-09-28T04:23:18.379277+0000","last_fullsized":"2023-09-28T04:23:18.379277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:11.833839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172629+0000","last_change":"2023-09-28T04:23:17.915114+0000","last_active":"2023-09-28T04:23:20.172629+0000","last_peered":"2023-09-28T04:23:20.172629+0000","last_clean":"2023-09-28T04:23:20.172629+0000","last_became_active":"2023-09-28T04:23:17.914697+0000","last_became_peered":"2023-09-28T04:23:17.914697+0000","last_unstale":"2023-09-28T04:23:20.172629+0000","last_undegraded":"2023-09-28T04:23:20.172629+0000","last_fullsized":"2023-09-28T04:23:20.172629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397753+0000","last_change":"2023-09-28T04:23:18.386681+0000","last_active":"2023-09-28T04:23:18.397753+0000","last_peered":"2023-09-28T04:23:18.397753+0000","last_clean":"2023-09-28T04:23:18.397753+0000","last_became_active":"2023-09-28T04:23:18.386380+0000","last_became_peered":"2023-09-28T04:23:18.386380+0000","last_unstale":"2023-09-28T04:23:18.397753+0000","last_undegraded":"2023-09-28T04:23:18.397753+0000","last_fullsized":"2023-09-28T04:23:18.397753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"21'5","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412964+0000","last_change":"2023-09-28T04:23:17.918404+0000","last_active":"2023-09-28T04:23:28.412964+0000","last_peered":"2023-09-28T04:23:28.412964+0000","last_clean":"2023-09-28T04:23:28.412964+0000","last_became_active":"2023-09-28T04:23:17.918116+0000","last_became_peered":"2023-09-28T04:23:17.918116+0000","last_unstale":"2023-09-28T04:23:28.412964+0000","last_undegraded":"2023-09-28T04:23:28.412964+0000","last_fullsized":"2023-09-28T04:23:28.412964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390737+0000","last_change":"2023-09-28T04:23:18.385213+0000","last_active":"2023-09-28T04:23:18.390737+0000","last_peered":"2023-09-28T04:23:18.390737+0000","last_clean":"2023-09-28T04:23:18.390737+0000","last_became_active":"2023-09-28T04:23:18.384930+0000","last_became_peered":"2023-09-28T04:23:18.384930+0000","last_unstale":"2023-09-28T04:23:18.390737+0000","last_undegraded":"2023-09-28T04:23:18.390737+0000","last_fullsized":"2023-09-28T04:23:18.390737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:06.681805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.384054+0000","last_change":"2023-09-28T04:23:17.905986+0000","last_active":"2023-09-28T04:23:23.384054+0000","last_peered":"2023-09-28T04:23:23.384054+0000","last_clean":"2023-09-28T04:23:23.384054+0000","last_became_active":"2023-09-28T04:23:17.905667+0000","last_became_peered":"2023-09-28T04:23:17.905667+0000","last_unstale":"2023-09-28T04:23:23.384054+0000","last_undegraded":"2023-09-28T04:23:23.384054+0000","last_fullsized":"2023-09-28T04:23:23.384054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402551+0000","last_change":"2023-09-28T04:23:18.400970+0000","last_active":"2023-09-28T04:23:18.402551+0000","last_peered":"2023-09-28T04:23:18.402551+0000","last_clean":"2023-09-28T04:23:18.402551+0000","last_became_active":"2023-09-28T04:23:18.400683+0000","last_became_peered":"2023-09-28T04:23:18.400683+0000","last_unstale":"2023-09-28T04:23:18.402551+0000","last_undegraded":"2023-09-28T04:23:18.402551+0000","last_fullsized":"2023-09-28T04:23:18.402551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:59:30.982762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.383977+0000","last_change":"2023-09-28T04:23:17.905162+0000","last_active":"2023-09-28T04:23:23.383977+0000","last_peered":"2023-09-28T04:23:23.383977+0000","last_clean":"2023-09-28T04:23:23.383977+0000","last_became_active":"2023-09-28T04:23:17.904895+0000","last_became_peered":"2023-09-28T04:23:17.904895+0000","last_unstale":"2023-09-28T04:23:23.383977+0000","last_undegraded":"2023-09-28T04:23:23.383977+0000","last_fullsized":"2023-09-28T04:23:23.383977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402543+0000","last_change":"2023-09-28T04:23:18.400714+0000","last_active":"2023-09-28T04:23:18.402543+0000","last_peered":"2023-09-28T04:23:18.402543+0000","last_clean":"2023-09-28T04:23:18.402543+0000","last_became_active":"2023-09-28T04:23:18.400410+0000","last_became_peered":"2023-09-28T04:23:18.400410+0000","last_unstale":"2023-09-28T04:23:18.402543+0000","last_undegraded":"2023-09-28T04:23:18.402543+0000","last_fullsized":"2023-09-28T04:23:18.402543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:43:02.603601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376352+0000","last_change":"2023-09-28T04:23:17.905493+0000","last_active":"2023-09-28T04:23:19.376352+0000","last_peered":"2023-09-28T04:23:19.376352+0000","last_clean":"2023-09-28T04:23:19.376352+0000","last_became_active":"2023-09-28T04:23:17.905198+0000","last_became_peered":"2023-09-28T04:23:17.905198+0000","last_unstale":"2023-09-28T04:23:19.376352+0000","last_undegraded":"2023-09-28T04:23:19.376352+0000","last_fullsized":"2023-09-28T04:23:19.376352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402220+0000","last_change":"2023-09-28T04:23:18.393194+0000","last_active":"2023-09-28T04:23:18.402220+0000","last_peered":"2023-09-28T04:23:18.402220+0000","last_clean":"2023-09-28T04:23:18.402220+0000","last_became_active":"2023-09-28T04:23:18.392400+0000","last_became_peered":"2023-09-28T04:23:18.392400+0000","last_unstale":"2023-09-28T04:23:18.402220+0000","last_undegraded":"2023-09-28T04:23:18.402220+0000","last_fullsized":"2023-09-28T04:23:18.402220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.383828+0000","last_change":"2023-09-28T04:23:17.917604+0000","last_active":"2023-09-28T04:23:23.383828+0000","last_peered":"2023-09-28T04:23:23.383828+0000","last_clean":"2023-09-28T04:23:23.383828+0000","last_became_active":"2023-09-28T04:23:17.917266+0000","last_became_peered":"2023-09-28T04:23:17.917266+0000","last_unstale":"2023-09-28T04:23:23.383828+0000","last_undegraded":"2023-09-28T04:23:23.383828+0000","last_fullsized":"2023-09-28T04:23:23.383828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395284+0000","last_change":"2023-09-28T04:23:18.386391+0000","last_active":"2023-09-28T04:23:18.395284+0000","last_peered":"2023-09-28T04:23:18.395284+0000","last_clean":"2023-09-28T04:23:18.395284+0000","last_became_active":"2023-09-28T04:23:18.386051+0000","last_became_peered":"2023-09-28T04:23:18.386051+0000","last_unstale":"2023-09-28T04:23:18.395284+0000","last_undegraded":"2023-09-28T04:23:18.395284+0000","last_fullsized":"2023-09-28T04:23:18.395284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392882+0000","last_change":"2023-09-28T04:23:18.389600+0000","last_active":"2023-09-28T04:23:18.392882+0000","last_peered":"2023-09-28T04:23:18.392882+0000","last_clean":"2023-09-28T04:23:18.392882+0000","last_became_active":"2023-09-28T04:23:18.389280+0000","last_became_peered":"2023-09-28T04:23:18.389280+0000","last_unstale":"2023-09-28T04:23:18.392882+0000","last_undegraded":"2023-09-28T04:23:18.392882+0000","last_fullsized":"2023-09-28T04:23:18.392882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:47.697305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402201+0000","last_change":"2023-09-28T04:23:18.392980+0000","last_active":"2023-09-28T04:23:18.402201+0000","last_peered":"2023-09-28T04:23:18.402201+0000","last_clean":"2023-09-28T04:23:18.402201+0000","last_became_active":"2023-09-28T04:23:18.390929+0000","last_became_peered":"2023-09-28T04:23:18.390929+0000","last_unstale":"2023-09-28T04:23:18.402201+0000","last_undegraded":"2023-09-28T04:23:18.402201+0000","last_fullsized":"2023-09-28T04:23:18.402201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397834+0000","last_change":"2023-09-28T04:23:18.387348+0000","last_active":"2023-09-28T04:23:18.397834+0000","last_peered":"2023-09-28T04:23:18.397834+0000","last_clean":"2023-09-28T04:23:18.397834+0000","last_became_active":"2023-09-28T04:23:18.385870+0000","last_became_peered":"2023-09-28T04:23:18.385870+0000","last_unstale":"2023-09-28T04:23:18.397834+0000","last_undegraded":"2023-09-28T04:23:18.397834+0000","last_fullsized":"2023-09-28T04:23:18.397834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:29:04.985060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402660+0000","last_change":"2023-09-28T04:23:18.392534+0000","last_active":"2023-09-28T04:23:18.402660+0000","last_peered":"2023-09-28T04:23:18.402660+0000","last_clean":"2023-09-28T04:23:18.402660+0000","last_became_active":"2023-09-28T04:23:18.392245+0000","last_became_peered":"2023-09-28T04:23:18.392245+0000","last_unstale":"2023-09-28T04:23:18.402660+0000","last_undegraded":"2023-09-28T04:23:18.402660+0000","last_fullsized":"2023-09-28T04:23:18.402660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395827+0000","last_change":"2023-09-28T04:23:18.391490+0000","last_active":"2023-09-28T04:23:18.395827+0000","last_peered":"2023-09-28T04:23:18.395827+0000","last_clean":"2023-09-28T04:23:18.395827+0000","last_became_active":"2023-09-28T04:23:18.391256+0000","last_became_peered":"2023-09-28T04:23:18.391256+0000","last_unstale":"2023-09-28T04:23:18.395827+0000","last_undegraded":"2023-09-28T04:23:18.395827+0000","last_fullsized":"2023-09-28T04:23:18.395827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:28:43.639301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3636,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8956,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362884,"statfs":{"total":96636764160,"available":96627593216,"internally_reserved":0,"allocated":315392,"data_stored":671903,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8348,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363492,"statfs":{"total":96636764160,"available":96628215808,"internally_reserved":0,"allocated":217088,"data_stored":79229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.8159999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9989999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8412,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363428,"statfs":{"total":96636764160,"available":96628150272,"internally_reserved":0,"allocated":217088,"data_stored":79229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8940,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362900,"statfs":{"total":96636764160,"available":96627609600,"internally_reserved":0,"allocated":299008,"data_stored":670815,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8352,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363488,"statfs":{"total":96636764160,"available":96628211712,"internally_reserved":0,"allocated":221184,"data_stored":79319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8424,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363416,"statfs":{"total":96636764160,"available":96628137984,"internally_reserved":0,"allocated":229376,"data_stored":79895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8444,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363396,"statfs":{"total":96636764160,"available":96628117504,"internally_reserved":0,"allocated":249856,"data_stored":81485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8364,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363476,"statfs":{"total":96636764160,"available":96628199424,"internally_reserved":0,"allocated":233472,"data_stored":79965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T04:23:30.682 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-28T04:23:30.683 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-28T04:23:30.683 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-28T04:23:30.683 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-28T04:23:30.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.904+0000 7f17279ff700 1 Processor -- start 2023-09-28T04:23:30.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.904+0000 7f17279ff700 1 -- start start 2023-09-28T04:23:30.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.905+0000 7f17279ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f172014f8b0 0x7f17201557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:30.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.905+0000 7f17279ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f172014fc80 0x7f17200c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:30.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.905+0000 7f17279ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17200633d0 con 0x7f17200676a0 2023-09-28T04:23:30.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.905+0000 7f17279ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17200c44b0 con 0x7f172014f8b0 2023-09-28T04:23:30.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.905+0000 7f17279ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17200bbd50 con 0x7f172014fc80 2023-09-28T04:23:30.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.906+0000 7f1725f9c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f172014fc80 0x7f17200c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:30.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.906+0000 7f172579b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f172014f8b0 0x7f17201557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:30.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.906+0000 7f1724f9a700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f17200676a0 0x7f17200c8350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:50682/0 (socket says 172.21.15.118:50682) 2023-09-28T04:23:30.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.906+0000 7f1724f9a700 1 -- 172.21.15.118:0/4280482292 learned_addr learned my addr 172.21.15.118:0/4280482292 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:30.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.906+0000 7f1725f9c700 1 -- 172.21.15.118:0/4280482292 >> v2:172.21.15.174:3300/0 conn(0x7f172014f8b0 msgr2=0x7f17201557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:30.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.906+0000 7f1725f9c700 1 --2- 172.21.15.118:0/4280482292 >> v2:172.21.15.174:3300/0 conn(0x7f172014f8b0 0x7f17201557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.906+0000 7f1725f9c700 1 -- 172.21.15.118:0/4280482292 >> v1:172.21.15.174:6789/0 conn(0x7f17200676a0 legacy=0x7f17200c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:30.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.906+0000 7f1725f9c700 1 -- 172.21.15.118:0/4280482292 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17200636b0 con 0x7f172014fc80 2023-09-28T04:23:30.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.906+0000 7f172579b700 1 --2- 172.21.15.118:0/4280482292 >> v2:172.21.15.174:3300/0 conn(0x7f172014f8b0 0x7f17201557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:30.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.906+0000 7f1725f9c700 1 --2- 172.21.15.118:0/4280482292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f172014fc80 0x7f17200c8fa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1718009e60 tx=0x7f1718009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=934fa79257c8ca7f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:30.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.906+0000 7f1717fff700 1 -- 172.21.15.118:0/4280482292 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800e070 con 0x7f172014fc80 2023-09-28T04:23:30.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.906+0000 7f1717fff700 1 -- 172.21.15.118:0/4280482292 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800bb60 con 0x7f172014fc80 2023-09-28T04:23:30.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.906+0000 7f1717fff700 1 -- 172.21.15.118:0/4280482292 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718012430 con 0x7f172014fc80 2023-09-28T04:23:30.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.907+0000 7f17279ff700 1 -- 172.21.15.118:0/4280482292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f172014fc80 msgr2=0x7f17200c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:30.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.907+0000 7f17279ff700 1 --2- 172.21.15.118:0/4280482292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f172014fc80 0x7f17200c8fa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1718009e60 tx=0x7f1718009780 comp rx=0 tx=0).stop 2023-09-28T04:23:30.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.907+0000 7f17279ff700 1 -- 172.21.15.118:0/4280482292 shutdown_connections 2023-09-28T04:23:30.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.907+0000 7f17279ff700 1 --2- 172.21.15.118:0/4280482292 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f172014fc80 0x7f17200c8fa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.907+0000 7f17279ff700 1 --2- 172.21.15.118:0/4280482292 >> v2:172.21.15.174:3300/0 conn(0x7f172014f8b0 0x7f17201557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.907+0000 7f17279ff700 1 -- 172.21.15.118:0/4280482292 >> 172.21.15.118:0/4280482292 conn(0x7f172006a3b0 msgr2=0x7f172006a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:30.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.907+0000 7f17279ff700 1 -- 172.21.15.118:0/4280482292 shutdown_connections 2023-09-28T04:23:30.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.907+0000 7f17279ff700 1 -- 172.21.15.118:0/4280482292 wait complete. 2023-09-28T04:23:30.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.909+0000 7f17279ff700 1 Processor -- start 2023-09-28T04:23:30.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.909+0000 7f17279ff700 1 -- start start 2023-09-28T04:23:30.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f17279ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17200676a0 0x7f17200c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:30.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f17279ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f172014f8b0 0x7f17200c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:30.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f17279ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f172014fc80 0x7f17200be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:30.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f17279ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1720156550 con 0x7f172014fc80 2023-09-28T04:23:30.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f17279ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17201663e0 con 0x7f172014f8b0 2023-09-28T04:23:30.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f17279ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17200bbac0 con 0x7f17200676a0 2023-09-28T04:23:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f1725f9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f172014fc80 0x7f17200be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f1725f9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f172014fc80 0x7f17200be1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51072/0 (socket says 172.21.15.118:51072) 2023-09-28T04:23:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f1725f9c700 1 -- 172.21.15.118:0/2378460647 learned_addr learned my addr 172.21.15.118:0/2378460647 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f172579b700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17200676a0 0x7f17200c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f1724f9a700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f172014f8b0 0x7f17200c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f1725f9c700 1 -- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17200676a0 msgr2=0x7f17200c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f1725f9c700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17200676a0 0x7f17200c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f1725f9c700 1 -- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f172014f8b0 msgr2=0x7f17200c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f1725f9c700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f172014f8b0 0x7f17200c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.910+0000 7f1725f9c700 1 -- 172.21.15.118:0/2378460647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c0093c0 con 0x7f172014fc80 2023-09-28T04:23:30.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.911+0000 7f1725f9c700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f172014fc80 0x7f17200be1c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17201533a0 tx=0x7f1718019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:30.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.911+0000 7f17157fa700 1 -- 172.21.15.118:0/2378460647 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718012ea0 con 0x7f172014fc80 2023-09-28T04:23:30.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.911+0000 7f17157fa700 1 -- 172.21.15.118:0/2378460647 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718027470 con 0x7f172014fc80 2023-09-28T04:23:30.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.911+0000 7f17157fa700 1 -- 172.21.15.118:0/2378460647 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718027810 con 0x7f172014fc80 2023-09-28T04:23:30.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.911+0000 7f17279ff700 1 -- 172.21.15.118:0/2378460647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1718009a20 con 0x7f172014fc80 2023-09-28T04:23:30.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.911+0000 7f17279ff700 1 -- 172.21.15.118:0/2378460647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17200c6b90 con 0x7f172014fc80 2023-09-28T04:23:30.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.912+0000 7f17279ff700 1 -- 172.21.15.118:0/2378460647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1720068ef0 con 0x7f172014fc80 2023-09-28T04:23:30.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.913+0000 7f17157fa700 1 -- 172.21.15.118:0/2378460647 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1718024070 con 0x7f172014fc80 2023-09-28T04:23:30.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.914+0000 7f17157fa700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1704067330 0x7f17040697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:30.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.914+0000 7f17157fa700 1 -- 172.21.15.118:0/2378460647 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f17180875c0 con 0x7f172014fc80 2023-09-28T04:23:30.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.914+0000 7f172579b700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1704067330 0x7f17040697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:30.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.915+0000 7f172579b700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1704067330 0x7f17040697e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f171c009f30 tx=0x7f171c009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:30.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:30.918+0000 7f17157fa700 1 -- 172.21.15.118:0/2378460647 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1718054420 con 0x7f172014fc80 2023-09-28T04:23:31.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.151+0000 7f17279ff700 1 -- 172.21.15.118:0/2378460647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1720071980 con 0x7f172014fc80 2023-09-28T04:23:31.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.151+0000 7f17157fa700 1 -- 172.21.15.118:0/2378460647 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1718057a40 con 0x7f172014fc80 2023-09-28T04:23:31.152 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:31.152 INFO:teuthology.orchestra.run.smithi118.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-28T04:23:31.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.153+0000 7f17279ff700 1 -- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1704067330 msgr2=0x7f17040697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.153+0000 7f17279ff700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1704067330 0x7f17040697e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f171c009f30 tx=0x7f171c009120 comp rx=0 tx=0).stop 2023-09-28T04:23:31.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.153+0000 7f17279ff700 1 -- 172.21.15.118:0/2378460647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f172014fc80 msgr2=0x7f17200be1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.153+0000 7f17279ff700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f172014fc80 0x7f17200be1c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17201533a0 tx=0x7f1718019000 comp rx=0 tx=0).stop 2023-09-28T04:23:31.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.154+0000 7f17279ff700 1 -- 172.21.15.118:0/2378460647 shutdown_connections 2023-09-28T04:23:31.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.154+0000 7f17279ff700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1704067330 0x7f17040697e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.154+0000 7f17279ff700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f172014fc80 0x7f17200be1c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.154+0000 7f17279ff700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17200676a0 0x7f17200c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.154+0000 7f17279ff700 1 --2- 172.21.15.118:0/2378460647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f172014f8b0 0x7f17200c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.154+0000 7f17279ff700 1 -- 172.21.15.118:0/2378460647 >> 172.21.15.118:0/2378460647 conn(0x7f172006a3b0 msgr2=0x7f1720070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:31.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.154+0000 7f17279ff700 1 -- 172.21.15.118:0/2378460647 shutdown_connections 2023-09-28T04:23:31.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.154+0000 7f17279ff700 1 -- 172.21.15.118:0/2378460647 wait complete. 2023-09-28T04:23:31.172 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-28T04:23:31.172 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:31.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.360+0000 7fd91d1ff700 1 Processor -- start 2023-09-28T04:23:31.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.360+0000 7fd91d1ff700 1 -- start start 2023-09-28T04:23:31.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.361+0000 7fd91d1ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd91814fa90 0x7fd918156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:31.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.361+0000 7fd91d1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91814fe60 0x7fd918068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:31.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.361+0000 7fd91d1ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9180c8030 con 0x7fd9180c84c0 2023-09-28T04:23:31.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.361+0000 7fd91d1ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9180c7180 con 0x7fd91814fa90 2023-09-28T04:23:31.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.361+0000 7fd91d1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180c7420 con 0x7fd91814fe60 2023-09-28T04:23:31.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.361+0000 7fd916d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd91814fa90 0x7fd918156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:31.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.361+0000 7fd916d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd91814fa90 0x7fd918156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51080/0 (socket says 172.21.15.118:51080) 2023-09-28T04:23:31.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.361+0000 7fd916d9d700 1 -- 172.21.15.118:0/554129646 learned_addr learned my addr 172.21.15.118:0/554129646 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:31.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.361+0000 7fd91659c700 1 --2- 172.21.15.118:0/554129646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91814fe60 0x7fd918068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:31.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.362+0000 7fd916d9d700 1 -- 172.21.15.118:0/554129646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91814fe60 msgr2=0x7fd918068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:31.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.362+0000 7fd916d9d700 1 --2- 172.21.15.118:0/554129646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91814fe60 0x7fd918068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.362+0000 7fd915d9b700 1 -- 172.21.15.118:0/554129646 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338863614 0 0) 0x7fd9180c8030 con 0x7fd9180c84c0 2023-09-28T04:23:31.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.362+0000 7fd916d9d700 1 -- 172.21.15.118:0/554129646 >> v1:172.21.15.174:6789/0 conn(0x7fd9180c84c0 legacy=0x7fd9180cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.362+0000 7fd916d9d700 1 -- 172.21.15.118:0/554129646 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9180c7700 con 0x7fd91814fa90 2023-09-28T04:23:31.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.362+0000 7fd916d9d700 1 --2- 172.21.15.118:0/554129646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91814fa90 0x7fd918156430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd9080099b0 tx=0x7fd908009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5af01b6927ab066 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:31.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.362+0000 7fd915d9b700 1 -- 172.21.15.118:0/554129646 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908009ea0 con 0x7fd91814fa90 2023-09-28T04:23:31.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.362+0000 7fd915d9b700 1 -- 172.21.15.118:0/554129646 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90800b860 con 0x7fd91814fa90 2023-09-28T04:23:31.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.362+0000 7fd915d9b700 1 -- 172.21.15.118:0/554129646 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90800bc00 con 0x7fd91814fa90 2023-09-28T04:23:31.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.363+0000 7fd91d1ff700 1 -- 172.21.15.118:0/554129646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91814fa90 msgr2=0x7fd918156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.363+0000 7fd91d1ff700 1 --2- 172.21.15.118:0/554129646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91814fa90 0x7fd918156430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd9080099b0 tx=0x7fd908009250 comp rx=0 tx=0).stop 2023-09-28T04:23:31.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.363+0000 7fd91d1ff700 1 -- 172.21.15.118:0/554129646 shutdown_connections 2023-09-28T04:23:31.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.363+0000 7fd91d1ff700 1 --2- 172.21.15.118:0/554129646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91814fa90 0x7fd918156430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.363+0000 7fd91d1ff700 1 --2- 172.21.15.118:0/554129646 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91814fe60 0x7fd918068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.363+0000 7fd91d1ff700 1 -- 172.21.15.118:0/554129646 >> 172.21.15.118:0/554129646 conn(0x7fd918063cd0 msgr2=0x7fd9180cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:31.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.363+0000 7fd91d1ff700 1 -- 172.21.15.118:0/554129646 shutdown_connections 2023-09-28T04:23:31.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.363+0000 7fd91d1ff700 1 -- 172.21.15.118:0/554129646 wait complete. 2023-09-28T04:23:31.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.364+0000 7fd91d1ff700 1 Processor -- start 2023-09-28T04:23:31.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.364+0000 7fd91d1ff700 1 -- start start 2023-09-28T04:23:31.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.365+0000 7fd91d1ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9180c84c0 0x7fd918168de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:31.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.365+0000 7fd91d1ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91814fa90 0x7fd9180c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:31.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.365+0000 7fd91d1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91814fe60 0x7fd918152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:31.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.365+0000 7fd91d1ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd918169d30 con 0x7fd91814fa90 2023-09-28T04:23:31.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.365+0000 7fd91d1ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180c3750 con 0x7fd9180c84c0 2023-09-28T04:23:31.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.365+0000 7fd91d1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91814e480 con 0x7fd91814fe60 2023-09-28T04:23:31.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.365+0000 7fd91659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91814fa90 0x7fd9180c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:31.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd91659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91814fa90 0x7fd9180c3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51092/0 (socket says 172.21.15.118:51092) 2023-09-28T04:23:31.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd91659c700 1 -- 172.21.15.118:0/2512594035 learned_addr learned my addr 172.21.15.118:0/2512594035 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:31.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd916d9d700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9180c84c0 0x7fd918168de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:31.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd91759e700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91814fe60 0x7fd918152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:31.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd91659c700 1 -- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91814fe60 msgr2=0x7fd918152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd91659c700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91814fe60 0x7fd918152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd91659c700 1 -- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9180c84c0 msgr2=0x7fd918168de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd91659c700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9180c84c0 0x7fd918168de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd91659c700 1 -- 172.21.15.118:0/2512594035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9080094f0 con 0x7fd91814fa90 2023-09-28T04:23:31.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd91659c700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91814fa90 0x7fd9180c3be0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00e900 tx=0x7fd90c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:31.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd8feffd700 1 -- 172.21.15.118:0/2512594035 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c013680 con 0x7fd91814fa90 2023-09-28T04:23:31.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd8feffd700 1 -- 172.21.15.118:0/2512594035 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c0137e0 con 0x7fd91814fa90 2023-09-28T04:23:31.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd91d1ff700 1 -- 172.21.15.118:0/2512594035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9180c4120 con 0x7fd91814fa90 2023-09-28T04:23:31.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.366+0000 7fd8feffd700 1 -- 172.21.15.118:0/2512594035 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c013ba0 con 0x7fd91814fa90 2023-09-28T04:23:31.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.367+0000 7fd91d1ff700 1 -- 172.21.15.118:0/2512594035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd918169770 con 0x7fd91814fa90 2023-09-28T04:23:31.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.367+0000 7fd91d1ff700 1 -- 172.21.15.118:0/2512594035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9180c38e0 con 0x7fd91814fa90 2023-09-28T04:23:31.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.369+0000 7fd8feffd700 1 -- 172.21.15.118:0/2512594035 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd90c00c410 con 0x7fd91814fa90 2023-09-28T04:23:31.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.369+0000 7fd8feffd700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd904067360 0x7fd904069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:31.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.369+0000 7fd8feffd700 1 -- 172.21.15.118:0/2512594035 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd90c084d20 con 0x7fd91814fa90 2023-09-28T04:23:31.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.370+0000 7fd916d9d700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd904067360 0x7fd904069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:31.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.370+0000 7fd916d9d700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd904067360 0x7fd904069810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd9080099b0 tx=0x7fd908017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:31.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.373+0000 7fd8feffd700 1 -- 172.21.15.118:0/2512594035 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd90c051b80 con 0x7fd91814fa90 2023-09-28T04:23:31.568 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.568+0000 7fd91d1ff700 1 -- 172.21.15.118:0/2512594035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd918071980 con 0x7fd91814fa90 2023-09-28T04:23:31.569 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.569+0000 7fd8feffd700 1 -- 172.21.15.118:0/2512594035 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fd90c0551a0 con 0x7fd91814fa90 2023-09-28T04:23:31.569 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:31.570 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:19.371938+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T04:23:10.586895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T04:23:10.697802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T04:23:16.491417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T04:23:17.349188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:07.142219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.951857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.911133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.882482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.688096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.764671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.767264+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.763816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:31.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.571+0000 7fd91d1ff700 1 -- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd904067360 msgr2=0x7fd904069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.571+0000 7fd91d1ff700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd904067360 0x7fd904069810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd9080099b0 tx=0x7fd908017000 comp rx=0 tx=0).stop 2023-09-28T04:23:31.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.571+0000 7fd91d1ff700 1 -- 172.21.15.118:0/2512594035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91814fa90 msgr2=0x7fd9180c3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.571+0000 7fd91d1ff700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91814fa90 0x7fd9180c3be0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00e900 tx=0x7fd90c0091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.571+0000 7fd91d1ff700 1 -- 172.21.15.118:0/2512594035 shutdown_connections 2023-09-28T04:23:31.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.571+0000 7fd91d1ff700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd904067360 0x7fd904069810 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.571+0000 7fd91d1ff700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91814fe60 0x7fd918152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.571+0000 7fd91d1ff700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9180c84c0 0x7fd918168de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.571+0000 7fd91d1ff700 1 --2- 172.21.15.118:0/2512594035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91814fa90 0x7fd9180c3be0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.571+0000 7fd91d1ff700 1 -- 172.21.15.118:0/2512594035 >> 172.21.15.118:0/2512594035 conn(0x7fd918063cd0 msgr2=0x7fd9181557c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:31.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.571+0000 7fd91d1ff700 1 -- 172.21.15.118:0/2512594035 shutdown_connections 2023-09-28T04:23:31.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.571+0000 7fd91d1ff700 1 -- 172.21.15.118:0/2512594035 wait complete. 2023-09-28T04:23:31.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-28T04:23:10.586895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-28T04:23:10.697802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-28T04:23:16.491417+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-28T04:23:17.349188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-28T04:23:31.589 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-28T04:23:31.782 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.781+0000 7f6b6d5ff700 1 Processor -- start 2023-09-28T04:23:31.782 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.781+0000 7f6b6d5ff700 1 -- start start 2023-09-28T04:23:31.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.782+0000 7f6b6d5ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b6814fe60 0x7f6b68156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:31.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.782+0000 7f6b6d5ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6b680c84c0 0x7f6b68068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:31.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.782+0000 7f6b6d5ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b680c8030 con 0x7f6b6814fa90 2023-09-28T04:23:31.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.782+0000 7f6b6d5ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b680c7180 con 0x7f6b680c84c0 2023-09-28T04:23:31.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.782+0000 7f6b6d5ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b680c7420 con 0x7f6b6814fe60 2023-09-28T04:23:31.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.783+0000 7f6b667fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b6814fe60 0x7f6b68156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:31.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.783+0000 7f6b677fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6b680c84c0 0x7f6b68068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:31.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.783+0000 7f6b66ffd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f6b6814fa90 0x7f6b680cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:50704/0 (socket says 172.21.15.118:50704) 2023-09-28T04:23:31.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.783+0000 7f6b66ffd700 1 -- 172.21.15.118:0/488484778 learned_addr learned my addr 172.21.15.118:0/488484778 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:31.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.783+0000 7f6b667fc700 1 -- 172.21.15.118:0/488484778 >> v2:172.21.15.174:3300/0 conn(0x7f6b680c84c0 msgr2=0x7f6b68068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:31.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.783+0000 7f6b667fc700 1 --2- 172.21.15.118:0/488484778 >> v2:172.21.15.174:3300/0 conn(0x7f6b680c84c0 0x7f6b68068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.783+0000 7f6b65ffb700 1 -- 172.21.15.118:0/488484778 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267309976 0 0) 0x7f6b680c8030 con 0x7f6b6814fa90 2023-09-28T04:23:31.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.783+0000 7f6b667fc700 1 -- 172.21.15.118:0/488484778 >> v1:172.21.15.174:6789/0 conn(0x7f6b6814fa90 legacy=0x7f6b680cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.783+0000 7f6b667fc700 1 -- 172.21.15.118:0/488484778 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680c7700 con 0x7f6b6814fe60 2023-09-28T04:23:31.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.783+0000 7f6b677fe700 1 --2- 172.21.15.118:0/488484778 >> v2:172.21.15.174:3300/0 conn(0x7f6b680c84c0 0x7f6b68068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:31.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.783+0000 7f6b667fc700 1 --2- 172.21.15.118:0/488484778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b6814fe60 0x7f6b68156430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0098e0 tx=0x7f6b5c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4754e45a8f65a16d server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:31.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.784+0000 7f6b65ffb700 1 -- 172.21.15.118:0/488484778 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00b640 con 0x7f6b6814fe60 2023-09-28T04:23:31.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.784+0000 7f6b65ffb700 1 -- 172.21.15.118:0/488484778 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c00b7a0 con 0x7f6b6814fe60 2023-09-28T04:23:31.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.784+0000 7f6b65ffb700 1 -- 172.21.15.118:0/488484778 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00bb40 con 0x7f6b6814fe60 2023-09-28T04:23:31.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.784+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/488484778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b6814fe60 msgr2=0x7f6b68156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.784+0000 7f6b6d5ff700 1 --2- 172.21.15.118:0/488484778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b6814fe60 0x7f6b68156430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0098e0 tx=0x7f6b5c0091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.784+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/488484778 shutdown_connections 2023-09-28T04:23:31.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.784+0000 7f6b6d5ff700 1 --2- 172.21.15.118:0/488484778 >> v2:172.21.15.174:3300/0 conn(0x7f6b680c84c0 0x7f6b68068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.784+0000 7f6b6d5ff700 1 --2- 172.21.15.118:0/488484778 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b6814fe60 0x7f6b68156430 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.784+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/488484778 >> 172.21.15.118:0/488484778 conn(0x7f6b68063cd0 msgr2=0x7f6b680cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:31.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.784+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/488484778 shutdown_connections 2023-09-28T04:23:31.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.784+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/488484778 wait complete. 2023-09-28T04:23:31.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.786+0000 7f6b6d5ff700 1 Processor -- start 2023-09-28T04:23:31.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.786+0000 7f6b6d5ff700 1 -- start start 2023-09-28T04:23:31.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b6d5ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b680c84c0 0x7f6b681510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b6d5ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b6814fa90 0x7f6b68151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b6d5ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b6814fe60 0x7f6b68169200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b6d5ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68150c30 con 0x7f6b680c84c0 2023-09-28T04:23:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b6d5ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b680c6e50 con 0x7f6b6814fa90 2023-09-28T04:23:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b6d5ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68150340 con 0x7f6b6814fe60 2023-09-28T04:23:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b66ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b680c84c0 0x7f6b681510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b66ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b680c84c0 0x7f6b681510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51100/0 (socket says 172.21.15.118:51100) 2023-09-28T04:23:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b66ffd700 1 -- 172.21.15.118:0/502973864 learned_addr learned my addr 172.21.15.118:0/502973864 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b677fe700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b6814fe60 0x7f6b68169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b667fc700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b6814fa90 0x7f6b68151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b66ffd700 1 -- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b6814fe60 msgr2=0x7f6b68169200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b66ffd700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b6814fe60 0x7f6b68169200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b66ffd700 1 -- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b6814fa90 msgr2=0x7f6b68151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b66ffd700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b6814fa90 0x7f6b68151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b66ffd700 1 -- 172.21.15.118:0/502973864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60009a20 con 0x7f6b680c84c0 2023-09-28T04:23:31.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.787+0000 7f6b66ffd700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b680c84c0 0x7f6b681510c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800c5b0 tx=0x7f6b58001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:31.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.788+0000 7f6b4effd700 1 -- 172.21.15.118:0/502973864 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58005b30 con 0x7f6b680c84c0 2023-09-28T04:23:31.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.788+0000 7f6b4effd700 1 -- 172.21.15.118:0/502973864 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b58005c90 con 0x7f6b680c84c0 2023-09-28T04:23:31.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.788+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/502973864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5c009420 con 0x7f6b680c84c0 2023-09-28T04:23:31.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.788+0000 7f6b4effd700 1 -- 172.21.15.118:0/502973864 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58007300 con 0x7f6b680c84c0 2023-09-28T04:23:31.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.788+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/502973864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b681505e0 con 0x7f6b680c84c0 2023-09-28T04:23:31.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.789+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/502973864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b68071980 con 0x7f6b680c84c0 2023-09-28T04:23:31.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.790+0000 7f6b4effd700 1 -- 172.21.15.118:0/502973864 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6b5801b3b0 con 0x7f6b680c84c0 2023-09-28T04:23:31.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.791+0000 7f6b4effd700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6b54067360 0x7f6b54069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:31.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.791+0000 7f6b4effd700 1 -- 172.21.15.118:0/502973864 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6b580840e0 con 0x7f6b680c84c0 2023-09-28T04:23:31.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.791+0000 7f6b667fc700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6b54067360 0x7f6b54069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:31.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.792+0000 7f6b667fc700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6b54067360 0x7f6b54069810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b68150270 tx=0x7f6b5c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:31.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.795+0000 7f6b4effd700 1 -- 172.21.15.118:0/502973864 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6b58051000 con 0x7f6b680c84c0 2023-09-28T04:23:31.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.986+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/502973864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b68152cb0 con 0x7f6b680c84c0 2023-09-28T04:23:31.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.986+0000 7f6b4effd700 1 -- 172.21.15.118:0/502973864 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b58054620 con 0x7f6b680c84c0 2023-09-28T04:23:31.987 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2023-09-28T04:23:31.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.988+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6b54067360 msgr2=0x7f6b54069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.988+0000 7f6b6d5ff700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6b54067360 0x7f6b54069810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b68150270 tx=0x7f6b5c017000 comp rx=0 tx=0).stop 2023-09-28T04:23:31.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.988+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/502973864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b680c84c0 msgr2=0x7f6b681510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:31.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.988+0000 7f6b6d5ff700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b680c84c0 0x7f6b681510c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800c5b0 tx=0x7f6b58001070 comp rx=0 tx=0).stop 2023-09-28T04:23:31.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.989+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/502973864 shutdown_connections 2023-09-28T04:23:31.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.989+0000 7f6b6d5ff700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6b54067360 0x7f6b54069810 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.989+0000 7f6b6d5ff700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6b6814fe60 0x7f6b68169200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.989+0000 7f6b6d5ff700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b680c84c0 0x7f6b681510c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.989+0000 7f6b6d5ff700 1 --2- 172.21.15.118:0/502973864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b6814fa90 0x7f6b68151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:31.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.989+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/502973864 >> 172.21.15.118:0/502973864 conn(0x7f6b68063cd0 msgr2=0x7f6b680cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:31.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.989+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/502973864 shutdown_connections 2023-09-28T04:23:31.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:31.989+0000 7f6b6d5ff700 1 -- 172.21.15.118:0/502973864 wait complete. 2023-09-28T04:23:32.006 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-28T04:23:32.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.199+0000 7fd8351ff700 1 Processor -- start 2023-09-28T04:23:32.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.199+0000 7fd8351ff700 1 -- start start 2023-09-28T04:23:32.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.200+0000 7fd8351ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd83014c6a0 0x7fd830152370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:32.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.200+0000 7fd8351ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd8300c4310 0x7fd8300c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:32.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.200+0000 7fd8351ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8300c3450 con 0x7fd8300c0590 2023-09-28T04:23:32.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.200+0000 7fd8351ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8300bfbb0 con 0x7fd8300c4310 2023-09-28T04:23:32.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.200+0000 7fd8351ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83014ca70 con 0x7fd83014c6a0 2023-09-28T04:23:32.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.201+0000 7fd82f59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd8300c4310 0x7fd8300c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:32.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.201+0000 7fd82ed9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd83014c6a0 0x7fd830152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:32.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.201+0000 7fd82e59c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd8300c0590 0x7fd8300c09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:50710/0 (socket says 172.21.15.118:50710) 2023-09-28T04:23:32.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.201+0000 7fd82e59c700 1 -- 172.21.15.118:0/222073325 learned_addr learned my addr 172.21.15.118:0/222073325 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:32.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.201+0000 7fd82dd9b700 1 -- 172.21.15.118:0/222073325 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474321068 0 0) 0x7fd8300c3450 con 0x7fd8300c0590 2023-09-28T04:23:32.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.201+0000 7fd82dd9b700 1 -- 172.21.15.118:0/222073325 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd818003570 con 0x7fd8300c0590 2023-09-28T04:23:32.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.201+0000 7fd82f59e700 1 -- 172.21.15.118:0/222073325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd83014c6a0 msgr2=0x7fd830152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:32.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.201+0000 7fd82f59e700 1 --2- 172.21.15.118:0/222073325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd83014c6a0 0x7fd830152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.201+0000 7fd82f59e700 1 -- 172.21.15.118:0/222073325 >> v1:172.21.15.174:6789/0 conn(0x7fd8300c0590 legacy=0x7fd8300c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:32.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.201+0000 7fd82f59e700 1 -- 172.21.15.118:0/222073325 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8300c2560 con 0x7fd8300c4310 2023-09-28T04:23:32.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.201+0000 7fd82ed9d700 1 --2- 172.21.15.118:0/222073325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd83014c6a0 0x7fd830152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:32.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.201+0000 7fd82f59e700 1 --2- 172.21.15.118:0/222073325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8300c4310 0x7fd8300c4790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd828009e60 tx=0x7fd828009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3e9710b56560380 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:32.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.201+0000 7fd82dd9b700 1 -- 172.21.15.118:0/222073325 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82800e070 con 0x7fd8300c4310 2023-09-28T04:23:32.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.202+0000 7fd82dd9b700 1 -- 172.21.15.118:0/222073325 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82800bab0 con 0x7fd8300c4310 2023-09-28T04:23:32.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.202+0000 7fd82dd9b700 1 -- 172.21.15.118:0/222073325 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82800be70 con 0x7fd8300c4310 2023-09-28T04:23:32.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.202+0000 7fd8351ff700 1 -- 172.21.15.118:0/222073325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8300c4310 msgr2=0x7fd8300c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:32.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.202+0000 7fd8351ff700 1 --2- 172.21.15.118:0/222073325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8300c4310 0x7fd8300c4790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd828009e60 tx=0x7fd828009780 comp rx=0 tx=0).stop 2023-09-28T04:23:32.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.202+0000 7fd8351ff700 1 -- 172.21.15.118:0/222073325 shutdown_connections 2023-09-28T04:23:32.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.202+0000 7fd8351ff700 1 --2- 172.21.15.118:0/222073325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8300c4310 0x7fd8300c4790 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.202+0000 7fd8351ff700 1 --2- 172.21.15.118:0/222073325 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd83014c6a0 0x7fd830152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.202+0000 7fd8351ff700 1 -- 172.21.15.118:0/222073325 >> 172.21.15.118:0/222073325 conn(0x7fd830067630 msgr2=0x7fd830067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:32.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.202+0000 7fd8351ff700 1 -- 172.21.15.118:0/222073325 shutdown_connections 2023-09-28T04:23:32.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.202+0000 7fd8351ff700 1 -- 172.21.15.118:0/222073325 wait complete. 2023-09-28T04:23:32.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.204+0000 7fd8351ff700 1 Processor -- start 2023-09-28T04:23:32.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.204+0000 7fd8351ff700 1 -- start start 2023-09-28T04:23:32.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd8351ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8300c0590 0x7fd830148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:32.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd8351ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8300c4310 0x7fd83014f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:32.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd8351ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd83014c6a0 0x7fd830166740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:32.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd8351ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd830156320 con 0x7fd8300c0590 2023-09-28T04:23:32.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd8351ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd830166520 con 0x7fd8300c4310 2023-09-28T04:23:32.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd8351ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83014dd70 con 0x7fd83014c6a0 2023-09-28T04:23:32.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd82ed9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8300c0590 0x7fd830148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:32.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd82ed9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8300c0590 0x7fd830148fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51114/0 (socket says 172.21.15.118:51114) 2023-09-28T04:23:32.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd82ed9d700 1 -- 172.21.15.118:0/3670205935 learned_addr learned my addr 172.21.15.118:0/3670205935 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:32.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd82e59c700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8300c4310 0x7fd83014f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:32.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd82f59e700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd83014c6a0 0x7fd830166740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:32.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd82ed9d700 1 -- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd83014c6a0 msgr2=0x7fd830166740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:32.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd82ed9d700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd83014c6a0 0x7fd830166740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd82ed9d700 1 -- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8300c4310 msgr2=0x7fd83014f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:32.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd82ed9d700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8300c4310 0x7fd83014f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.205+0000 7fd82ed9d700 1 -- 172.21.15.118:0/3670205935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd820009420 con 0x7fd8300c0590 2023-09-28T04:23:32.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.206+0000 7fd82ed9d700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8300c0590 0x7fd830148fc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd82000ec80 tx=0x7fd8200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:32.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.206+0000 7fd816ffd700 1 -- 172.21.15.118:0/3670205935 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000c850 con 0x7fd8300c0590 2023-09-28T04:23:32.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.206+0000 7fd816ffd700 1 -- 172.21.15.118:0/3670205935 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82000c9b0 con 0x7fd8300c0590 2023-09-28T04:23:32.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.206+0000 7fd816ffd700 1 -- 172.21.15.118:0/3670205935 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000cd30 con 0x7fd8300c0590 2023-09-28T04:23:32.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.206+0000 7fd8351ff700 1 -- 172.21.15.118:0/3670205935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd828009a20 con 0x7fd8300c0590 2023-09-28T04:23:32.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.206+0000 7fd8351ff700 1 -- 172.21.15.118:0/3670205935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd830167360 con 0x7fd8300c0590 2023-09-28T04:23:32.210 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.207+0000 7fd8351ff700 1 -- 172.21.15.118:0/3670205935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd830071980 con 0x7fd8300c0590 2023-09-28T04:23:32.210 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.208+0000 7fd816ffd700 1 -- 172.21.15.118:0/3670205935 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd820013680 con 0x7fd8300c0590 2023-09-28T04:23:32.210 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.209+0000 7fd816ffd700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd81c067360 0x7fd81c069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:32.210 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.209+0000 7fd816ffd700 1 -- 172.21.15.118:0/3670205935 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd820085140 con 0x7fd8300c0590 2023-09-28T04:23:32.210 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.209+0000 7fd82e59c700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd81c067360 0x7fd81c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:32.210 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.210+0000 7fd82e59c700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd81c067360 0x7fd81c069810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd8300c0150 tx=0x7fd824009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:32.213 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.213+0000 7fd816ffd700 1 -- 172.21.15.118:0/3670205935 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd820055a30 con 0x7fd8300c0590 2023-09-28T04:23:32.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.401+0000 7fd8351ff700 1 -- 172.21.15.118:0/3670205935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd8300c2840 con 0x7fd8300c0590 2023-09-28T04:23:32.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.401+0000 7fd816ffd700 1 -- 172.21.15.118:0/3670205935 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd8200555c0 con 0x7fd8300c0590 2023-09-28T04:23:32.402 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2023-09-28T04:23:32.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.404+0000 7fd8351ff700 1 -- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd81c067360 msgr2=0x7fd81c069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:32.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.404+0000 7fd8351ff700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd81c067360 0x7fd81c069810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd8300c0150 tx=0x7fd824009040 comp rx=0 tx=0).stop 2023-09-28T04:23:32.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.404+0000 7fd8351ff700 1 -- 172.21.15.118:0/3670205935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8300c0590 msgr2=0x7fd830148fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:32.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.404+0000 7fd8351ff700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8300c0590 0x7fd830148fc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd82000ec80 tx=0x7fd8200091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.404+0000 7fd8351ff700 1 -- 172.21.15.118:0/3670205935 shutdown_connections 2023-09-28T04:23:32.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.404+0000 7fd8351ff700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd81c067360 0x7fd81c069810 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.404+0000 7fd8351ff700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd83014c6a0 0x7fd830166740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.404+0000 7fd8351ff700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8300c0590 0x7fd830148fc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.404+0000 7fd8351ff700 1 --2- 172.21.15.118:0/3670205935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8300c4310 0x7fd83014f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.404+0000 7fd8351ff700 1 -- 172.21.15.118:0/3670205935 >> 172.21.15.118:0/3670205935 conn(0x7fd830067630 msgr2=0x7fd83014b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:32.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.404+0000 7fd8351ff700 1 -- 172.21.15.118:0/3670205935 shutdown_connections 2023-09-28T04:23:32.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.404+0000 7fd8351ff700 1 -- 172.21.15.118:0/3670205935 wait complete. 2023-09-28T04:23:32.422 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-28T04:23:32.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.614+0000 7f71f63ff700 1 Processor -- start 2023-09-28T04:23:32.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.614+0000 7f71f63ff700 1 -- start start 2023-09-28T04:23:32.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71f63ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f71f014fe60 0x7f71f0156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:32.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71f63ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f71f00c84c0 0x7f71f0068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:32.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71f63ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f00c8030 con 0x7f71f014fa90 2023-09-28T04:23:32.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71f63ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f00c7180 con 0x7f71f014fe60 2023-09-28T04:23:32.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71f63ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f00c7420 con 0x7f71f00c84c0 2023-09-28T04:23:32.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71e7fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f71f014fe60 0x7f71f0156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:32.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71effff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f71f014fa90 0x7f71f00cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47850/0 (socket says 172.21.15.118:47850) 2023-09-28T04:23:32.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71effff700 1 -- 172.21.15.118:0/2856874967 learned_addr learned my addr 172.21.15.118:0/2856874967 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:32.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71f499c700 1 --2- 172.21.15.118:0/2856874967 >> v2:172.21.15.174:3300/0 conn(0x7f71f00c84c0 0x7f71f0068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:32.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71e7fff700 1 -- 172.21.15.118:0/2856874967 >> v2:172.21.15.174:3300/0 conn(0x7f71f00c84c0 msgr2=0x7f71f0068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:32.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71e7fff700 1 --2- 172.21.15.118:0/2856874967 >> v2:172.21.15.174:3300/0 conn(0x7f71f00c84c0 0x7f71f0068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71e7fff700 1 -- 172.21.15.118:0/2856874967 >> v1:172.21.15.118:6789/0 conn(0x7f71f014fa90 legacy=0x7f71f00cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:32.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71e7fff700 1 -- 172.21.15.118:0/2856874967 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f00c7700 con 0x7f71f014fe60 2023-09-28T04:23:32.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.616+0000 7f71ef7fe700 1 -- 172.21.15.118:0/2856874967 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264643757 0 0) 0x7f71f00c8030 con 0x7f71f014fa90 2023-09-28T04:23:32.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.617+0000 7f71e7fff700 1 --2- 172.21.15.118:0/2856874967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71f014fe60 0x7f71f0156430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71f00c64b0 tx=0x7f71d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b727faa866e8b2f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:32.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.617+0000 7f71ef7fe700 1 -- 172.21.15.118:0/2856874967 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d800b6b0 con 0x7f71f014fe60 2023-09-28T04:23:32.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.617+0000 7f71ef7fe700 1 -- 172.21.15.118:0/2856874967 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d800b810 con 0x7f71f014fe60 2023-09-28T04:23:32.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.617+0000 7f71ef7fe700 1 -- 172.21.15.118:0/2856874967 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d800bbb0 con 0x7f71f014fe60 2023-09-28T04:23:32.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.617+0000 7f71f63ff700 1 -- 172.21.15.118:0/2856874967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71f014fe60 msgr2=0x7f71f0156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:32.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.617+0000 7f71f63ff700 1 --2- 172.21.15.118:0/2856874967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71f014fe60 0x7f71f0156430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71f00c64b0 tx=0x7f71d80091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.617+0000 7f71f63ff700 1 -- 172.21.15.118:0/2856874967 shutdown_connections 2023-09-28T04:23:32.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.617+0000 7f71f63ff700 1 --2- 172.21.15.118:0/2856874967 >> v2:172.21.15.174:3300/0 conn(0x7f71f00c84c0 0x7f71f0068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.617+0000 7f71f63ff700 1 --2- 172.21.15.118:0/2856874967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71f014fe60 0x7f71f0156430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.617+0000 7f71f63ff700 1 -- 172.21.15.118:0/2856874967 >> 172.21.15.118:0/2856874967 conn(0x7f71f0063cd0 msgr2=0x7f71f00cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:32.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.617+0000 7f71f63ff700 1 -- 172.21.15.118:0/2856874967 shutdown_connections 2023-09-28T04:23:32.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.617+0000 7f71f63ff700 1 -- 172.21.15.118:0/2856874967 wait complete. 2023-09-28T04:23:32.622 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.619+0000 7f71f63ff700 1 Processor -- start 2023-09-28T04:23:32.622 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.619+0000 7f71f63ff700 1 -- start start 2023-09-28T04:23:32.622 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71f63ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71f00c84c0 0x7f71f0169930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:32.622 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71f63ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71f014fa90 0x7f71f015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:32.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71f63ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71f014fe60 0x7f71f0156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:32.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71f63ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f01694a0 con 0x7f71f014fa90 2023-09-28T04:23:32.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71f63ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00ca520 con 0x7f71f014fe60 2023-09-28T04:23:32.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71f63ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f0159df0 con 0x7f71f00c84c0 2023-09-28T04:23:32.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71e7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71f014fa90 0x7f71f015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:32.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71e7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71f014fa90 0x7f71f015cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51142/0 (socket says 172.21.15.118:51142) 2023-09-28T04:23:32.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71e7fff700 1 -- 172.21.15.118:0/1811823478 learned_addr learned my addr 172.21.15.118:0/1811823478 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:32.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71f499c700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71f014fe60 0x7f71f0156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:32.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71effff700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71f00c84c0 0x7f71f0169930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:32.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71e7fff700 1 -- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71f00c84c0 msgr2=0x7f71f0169930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:32.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71e7fff700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71f00c84c0 0x7f71f0169930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71e7fff700 1 -- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71f014fe60 msgr2=0x7f71f0156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:32.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71e7fff700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71f014fe60 0x7f71f0156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.620+0000 7f71e7fff700 1 -- 172.21.15.118:0/1811823478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d8009420 con 0x7f71f014fa90 2023-09-28T04:23:32.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.621+0000 7f71e7fff700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71f014fa90 0x7f71f015cad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f71d8013000 tx=0x7f71d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:32.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.621+0000 7f71ecff9700 1 -- 172.21.15.118:0/1811823478 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d800bb90 con 0x7f71f014fa90 2023-09-28T04:23:32.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.621+0000 7f71ecff9700 1 -- 172.21.15.118:0/1811823478 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d8011420 con 0x7f71f014fa90 2023-09-28T04:23:32.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.621+0000 7f71ecff9700 1 -- 172.21.15.118:0/1811823478 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d80117c0 con 0x7f71f014fa90 2023-09-28T04:23:32.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.621+0000 7f71f63ff700 1 -- 172.21.15.118:0/1811823478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f00c9f60 con 0x7f71f014fa90 2023-09-28T04:23:32.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.621+0000 7f71f63ff700 1 -- 172.21.15.118:0/1811823478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f0169130 con 0x7f71f014fa90 2023-09-28T04:23:32.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.622+0000 7f71f63ff700 1 -- 172.21.15.118:0/1811823478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f0169650 con 0x7f71f014fa90 2023-09-28T04:23:32.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.623+0000 7f71ecff9700 1 -- 172.21.15.118:0/1811823478 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f71d8011b70 con 0x7f71f014fa90 2023-09-28T04:23:32.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.624+0000 7f71ecff9700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f71d0067330 0x7f71d00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:32.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.624+0000 7f71ecff9700 1 -- 172.21.15.118:0/1811823478 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f71d80863f0 con 0x7f71f014fa90 2023-09-28T04:23:32.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.624+0000 7f71effff700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f71d0067330 0x7f71d00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:32.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.624+0000 7f71effff700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f71d0067330 0x7f71d00697e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f71e0007fd0 tx=0x7f71e0007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:32.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.628+0000 7f71ecff9700 1 -- 172.21.15.118:0/1811823478 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f71f0169650 con 0x7f71f014fa90 2023-09-28T04:23:32.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.818+0000 7f71f63ff700 1 -- 172.21.15.118:0/1811823478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71f0169650 con 0x7f71f014fa90 2023-09-28T04:23:32.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.819+0000 7f71ecff9700 1 -- 172.21.15.118:0/1811823478 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71f0169650 con 0x7f71f014fa90 2023-09-28T04:23:32.820 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2023-09-28T04:23:32.822 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.821+0000 7f71f63ff700 1 -- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f71d0067330 msgr2=0x7f71d00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:32.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.821+0000 7f71f63ff700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f71d0067330 0x7f71d00697e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f71e0007fd0 tx=0x7f71e0007d30 comp rx=0 tx=0).stop 2023-09-28T04:23:32.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.821+0000 7f71f63ff700 1 -- 172.21.15.118:0/1811823478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71f014fa90 msgr2=0x7f71f015cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:32.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.821+0000 7f71f63ff700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71f014fa90 0x7f71f015cad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f71d8013000 tx=0x7f71d8017000 comp rx=0 tx=0).stop 2023-09-28T04:23:32.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.821+0000 7f71f63ff700 1 -- 172.21.15.118:0/1811823478 shutdown_connections 2023-09-28T04:23:32.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.821+0000 7f71f63ff700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f71d0067330 0x7f71d00697e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.821+0000 7f71f63ff700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71f014fe60 0x7f71f0156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.821+0000 7f71f63ff700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71f00c84c0 0x7f71f0169930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.821+0000 7f71f63ff700 1 --2- 172.21.15.118:0/1811823478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71f014fa90 0x7f71f015cad0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:32.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.821+0000 7f71f63ff700 1 -- 172.21.15.118:0/1811823478 >> 172.21.15.118:0/1811823478 conn(0x7f71f0063cd0 msgr2=0x7f71f0069b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:32.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.822+0000 7f71f63ff700 1 -- 172.21.15.118:0/1811823478 shutdown_connections 2023-09-28T04:23:32.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:32.822+0000 7f71f63ff700 1 -- 172.21.15.118:0/1811823478 wait complete. 2023-09-28T04:23:32.839 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-28T04:23:33.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.031+0000 7f6cdf9ff700 1 Processor -- start 2023-09-28T04:23:33.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.032+0000 7f6cdf9ff700 1 -- start start 2023-09-28T04:23:33.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.033+0000 7f6cdf9ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6cd814fa90 0x7f6cd8156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.033+0000 7f6cdf9ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6cd814fe60 0x7f6cd8068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.033+0000 7f6cdf9ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd80c8030 con 0x7f6cd80c84c0 2023-09-28T04:23:33.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.033+0000 7f6cdf9ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd80c7180 con 0x7f6cd814fa90 2023-09-28T04:23:33.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.033+0000 7f6cdf9ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd80c7420 con 0x7f6cd814fe60 2023-09-28T04:23:33.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.033+0000 7f6cdd79b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6cd814fa90 0x7f6cd8156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.033+0000 7f6cddf9c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f6cd80c84c0 0x7f6cd80cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47852/0 (socket says 172.21.15.118:47852) 2023-09-28T04:23:33.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.033+0000 7f6cddf9c700 1 -- 172.21.15.118:0/3696390057 learned_addr learned my addr 172.21.15.118:0/3696390057 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:33.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.033+0000 7f6cdcf9a700 1 --2- 172.21.15.118:0/3696390057 >> v2:172.21.15.174:3300/0 conn(0x7f6cd814fe60 0x7f6cd8068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.033+0000 7f6cdd79b700 1 -- 172.21.15.118:0/3696390057 >> v2:172.21.15.174:3300/0 conn(0x7f6cd814fe60 msgr2=0x7f6cd8068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:33.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.033+0000 7f6cdd79b700 1 --2- 172.21.15.118:0/3696390057 >> v2:172.21.15.174:3300/0 conn(0x7f6cd814fe60 0x7f6cd8068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.033+0000 7f6cdd79b700 1 -- 172.21.15.118:0/3696390057 >> v1:172.21.15.118:6789/0 conn(0x7f6cd80c84c0 legacy=0x7f6cd80cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.034+0000 7f6cdd79b700 1 -- 172.21.15.118:0/3696390057 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd80c7700 con 0x7f6cd814fa90 2023-09-28T04:23:33.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.034+0000 7f6ccffff700 1 -- 172.21.15.118:0/3696390057 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665065504 0 0) 0x7f6cd80c8030 con 0x7f6cd80c84c0 2023-09-28T04:23:33.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.034+0000 7f6cdd79b700 1 --2- 172.21.15.118:0/3696390057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd814fa90 0x7f6cd8156430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8070fb0 tx=0x7f6cd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50058440744694d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:33.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.034+0000 7f6ccffff700 1 -- 172.21.15.118:0/3696390057 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4011630 con 0x7f6cd814fa90 2023-09-28T04:23:33.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.034+0000 7f6ccffff700 1 -- 172.21.15.118:0/3696390057 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd4011790 con 0x7f6cd814fa90 2023-09-28T04:23:33.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.034+0000 7f6ccffff700 1 -- 172.21.15.118:0/3696390057 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4011b30 con 0x7f6cd814fa90 2023-09-28T04:23:33.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.034+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3696390057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd814fa90 msgr2=0x7f6cd8156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.034+0000 7f6cdf9ff700 1 --2- 172.21.15.118:0/3696390057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd814fa90 0x7f6cd8156430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8070fb0 tx=0x7f6cd40091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.035+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3696390057 shutdown_connections 2023-09-28T04:23:33.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.035+0000 7f6cdf9ff700 1 --2- 172.21.15.118:0/3696390057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd814fa90 0x7f6cd8156430 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.035+0000 7f6cdf9ff700 1 --2- 172.21.15.118:0/3696390057 >> v2:172.21.15.174:3300/0 conn(0x7f6cd814fe60 0x7f6cd8068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.035+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3696390057 >> 172.21.15.118:0/3696390057 conn(0x7f6cd8063cd0 msgr2=0x7f6cd80cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:33.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.035+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3696390057 shutdown_connections 2023-09-28T04:23:33.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.035+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3696390057 wait complete. 2023-09-28T04:23:33.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.036+0000 7f6cdf9ff700 1 Processor -- start 2023-09-28T04:23:33.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.036+0000 7f6cdf9ff700 1 -- start start 2023-09-28T04:23:33.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.037+0000 7f6cdf9ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80c84c0 0x7f6cd80ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.037+0000 7f6cdf9ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd814fa90 0x7f6cd80c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.037+0000 7f6cdf9ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd814fe60 0x7f6cd8169640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.037+0000 7f6cdf9ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd81660c0 con 0x7f6cd814fe60 2023-09-28T04:23:33.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.037+0000 7f6cdf9ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80aed30 con 0x7f6cd814fa90 2023-09-28T04:23:33.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.037+0000 7f6cdf9ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80af5d0 con 0x7f6cd80c84c0 2023-09-28T04:23:33.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.037+0000 7f6cddf9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd814fe60 0x7f6cd8169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6cdd79b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80c84c0 0x7f6cd80ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6cdcf9a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd814fa90 0x7f6cd80c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6cddf9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd814fe60 0x7f6cd8169640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51158/0 (socket says 172.21.15.118:51158) 2023-09-28T04:23:33.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6cddf9c700 1 -- 172.21.15.118:0/3578445835 learned_addr learned my addr 172.21.15.118:0/3578445835 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:33.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6cdd79b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80c84c0 0x7f6cd80ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:56000/0 (socket says 172.21.15.118:56000) 2023-09-28T04:23:33.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6cddf9c700 1 -- 172.21.15.118:0/3578445835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80c84c0 msgr2=0x7f6cd80ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6cddf9c700 1 --2- 172.21.15.118:0/3578445835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80c84c0 0x7f6cd80ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6cddf9c700 1 -- 172.21.15.118:0/3578445835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd814fa90 msgr2=0x7f6cd80c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6cddf9c700 1 --2- 172.21.15.118:0/3578445835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd814fa90 0x7f6cd80c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6cddf9c700 1 -- 172.21.15.118:0/3578445835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4009420 con 0x7f6cd814fe60 2023-09-28T04:23:33.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6cddf9c700 1 --2- 172.21.15.118:0/3578445835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd814fe60 0x7f6cd8169640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000cc20 tx=0x7f6cd00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:33.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6ccd7fa700 1 -- 172.21.15.118:0/3578445835 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd000a870 con 0x7f6cd814fe60 2023-09-28T04:23:33.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6ccd7fa700 1 -- 172.21.15.118:0/3578445835 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd000a9d0 con 0x7f6cd814fe60 2023-09-28T04:23:33.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3578445835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd80ccb60 con 0x7f6cd814fe60 2023-09-28T04:23:33.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.038+0000 7f6ccd7fa700 1 -- 172.21.15.118:0/3578445835 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd000ad90 con 0x7f6cd814fe60 2023-09-28T04:23:33.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.039+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3578445835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd80aef80 con 0x7f6cd814fe60 2023-09-28T04:23:33.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.039+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3578445835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd80af760 con 0x7f6cd814fe60 2023-09-28T04:23:33.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.040+0000 7f6ccd7fa700 1 -- 172.21.15.118:0/3578445835 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6cd0007300 con 0x7f6cd814fe60 2023-09-28T04:23:33.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.041+0000 7f6ccd7fa700 1 --2- 172.21.15.118:0/3578445835 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6cbc067330 0x7f6cbc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.041+0000 7f6ccd7fa700 1 -- 172.21.15.118:0/3578445835 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6cd0084ee0 con 0x7f6cd814fe60 2023-09-28T04:23:33.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.041+0000 7f6cdd79b700 1 --2- 172.21.15.118:0/3578445835 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6cbc067330 0x7f6cbc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.042+0000 7f6cdd79b700 1 --2- 172.21.15.118:0/3578445835 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6cbc067330 0x7f6cbc0697e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40093f0 tx=0x7f6cd4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:33.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.045+0000 7f6ccd7fa700 1 -- 172.21.15.118:0/3578445835 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6cd0051dc0 con 0x7f6cd814fe60 2023-09-28T04:23:33.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.235+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3578445835 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6cd8071980 con 0x7f6cd814fe60 2023-09-28T04:23:33.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.236+0000 7f6ccd7fa700 1 -- 172.21.15.118:0/3578445835 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6cd00553e0 con 0x7f6cd814fe60 2023-09-28T04:23:33.236 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2023-09-28T04:23:33.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.238+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3578445835 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6cbc067330 msgr2=0x7f6cbc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.238+0000 7f6cdf9ff700 1 --2- 172.21.15.118:0/3578445835 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6cbc067330 0x7f6cbc0697e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40093f0 tx=0x7f6cd4017000 comp rx=0 tx=0).stop 2023-09-28T04:23:33.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.238+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3578445835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd814fe60 msgr2=0x7f6cd8169640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.238+0000 7f6cdf9ff700 1 --2- 172.21.15.118:0/3578445835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd814fe60 0x7f6cd8169640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000cc20 tx=0x7f6cd00019b0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.238+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3578445835 shutdown_connections 2023-09-28T04:23:33.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.238+0000 7f6cdf9ff700 1 --2- 172.21.15.118:0/3578445835 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6cbc067330 0x7f6cbc0697e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.238+0000 7f6cdf9ff700 1 --2- 172.21.15.118:0/3578445835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cd814fe60 0x7f6cd8169640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.238+0000 7f6cdf9ff700 1 --2- 172.21.15.118:0/3578445835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80c84c0 0x7f6cd80ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.238+0000 7f6cdf9ff700 1 --2- 172.21.15.118:0/3578445835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd814fa90 0x7f6cd80c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.238+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3578445835 >> 172.21.15.118:0/3578445835 conn(0x7f6cd8063cd0 msgr2=0x7f6cd81557c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:33.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.238+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3578445835 shutdown_connections 2023-09-28T04:23:33.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.238+0000 7f6cdf9ff700 1 -- 172.21.15.118:0/3578445835 wait complete. 2023-09-28T04:23:33.256 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T04:23:33.448 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.448+0000 7f60fd3ff700 1 Processor -- start 2023-09-28T04:23:33.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.448+0000 7f60fd3ff700 1 -- start start 2023-09-28T04:23:33.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.449+0000 7f60fd3ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60f80c0ca0 0x7f60f8152370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.449+0000 7f60fd3ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f60f80c4310 0x7f60f80c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.449+0000 7f60fd3ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f80c3450 con 0x7f60f814c6a0 2023-09-28T04:23:33.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.450+0000 7f60fd3ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f80bfbb0 con 0x7f60f80c4310 2023-09-28T04:23:33.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.450+0000 7f60fd3ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f814ca70 con 0x7f60f80c0ca0 2023-09-28T04:23:33.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.450+0000 7f60f77fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f60f80c4310 0x7f60f80c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.450+0000 7f60f67fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60f80c0ca0 0x7f60f8152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.450+0000 7f60f6ffd700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f60f814c6a0 0x7f60f80c0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:50726/0 (socket says 172.21.15.118:50726) 2023-09-28T04:23:33.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.450+0000 7f60f77fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f60f80c4310 0x7f60f80c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:57578/0 (socket says 172.21.15.118:57578) 2023-09-28T04:23:33.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.450+0000 7f60f6ffd700 1 -- 172.21.15.118:0/846188035 learned_addr learned my addr 172.21.15.118:0/846188035 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:33.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.450+0000 7f60f5ffb700 1 -- 172.21.15.118:0/846188035 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595325156 0 0) 0x7f60f80c3450 con 0x7f60f814c6a0 2023-09-28T04:23:33.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.450+0000 7f60f77fe700 1 -- 172.21.15.118:0/846188035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60f80c0ca0 msgr2=0x7f60f8152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:33.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.450+0000 7f60f77fe700 1 --2- 172.21.15.118:0/846188035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60f80c0ca0 0x7f60f8152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.450+0000 7f60f77fe700 1 -- 172.21.15.118:0/846188035 >> v1:172.21.15.174:6789/0 conn(0x7f60f814c6a0 legacy=0x7f60f80c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.450+0000 7f60f77fe700 1 -- 172.21.15.118:0/846188035 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f80c2560 con 0x7f60f80c4310 2023-09-28T04:23:33.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.450+0000 7f60f67fc700 1 --2- 172.21.15.118:0/846188035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60f80c0ca0 0x7f60f8152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:33.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.451+0000 7f60f77fe700 1 --2- 172.21.15.118:0/846188035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60f80c4310 0x7f60f80c4790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009e60 tx=0x7f60f0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64017100253f58d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:33.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.451+0000 7f60f5ffb700 1 -- 172.21.15.118:0/846188035 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000bb60 con 0x7f60f80c4310 2023-09-28T04:23:33.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.451+0000 7f60f5ffb700 1 -- 172.21.15.118:0/846188035 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f000bcc0 con 0x7f60f80c4310 2023-09-28T04:23:33.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.451+0000 7f60f5ffb700 1 -- 172.21.15.118:0/846188035 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f00116b0 con 0x7f60f80c4310 2023-09-28T04:23:33.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.451+0000 7f60fd3ff700 1 -- 172.21.15.118:0/846188035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60f80c4310 msgr2=0x7f60f80c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.451+0000 7f60fd3ff700 1 --2- 172.21.15.118:0/846188035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60f80c4310 0x7f60f80c4790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009e60 tx=0x7f60f0009780 comp rx=0 tx=0).stop 2023-09-28T04:23:33.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.451+0000 7f60fd3ff700 1 -- 172.21.15.118:0/846188035 shutdown_connections 2023-09-28T04:23:33.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.451+0000 7f60fd3ff700 1 --2- 172.21.15.118:0/846188035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60f80c4310 0x7f60f80c4790 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.451+0000 7f60fd3ff700 1 --2- 172.21.15.118:0/846188035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60f80c0ca0 0x7f60f8152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.451+0000 7f60fd3ff700 1 -- 172.21.15.118:0/846188035 >> 172.21.15.118:0/846188035 conn(0x7f60f8067630 msgr2=0x7f60f8067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:33.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.451+0000 7f60fd3ff700 1 -- 172.21.15.118:0/846188035 shutdown_connections 2023-09-28T04:23:33.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.452+0000 7f60fd3ff700 1 -- 172.21.15.118:0/846188035 wait complete. 2023-09-28T04:23:33.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.453+0000 7f60fd3ff700 1 Processor -- start 2023-09-28T04:23:33.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.453+0000 7f60fd3ff700 1 -- start start 2023-09-28T04:23:33.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60fd3ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60f80c0ca0 0x7f60f8165d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60fd3ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60f80c4310 0x7f60f80c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60fd3ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f814c6a0 0x7f60f8159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60fd3ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8154080 con 0x7f60f814c6a0 2023-09-28T04:23:33.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60fd3ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8169760 con 0x7f60f80c4310 2023-09-28T04:23:33.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60fd3ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8165880 con 0x7f60f80c0ca0 2023-09-28T04:23:33.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60f77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f814c6a0 0x7f60f8159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60f77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f814c6a0 0x7f60f8159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51168/0 (socket says 172.21.15.118:51168) 2023-09-28T04:23:33.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60f77fe700 1 -- 172.21.15.118:0/1147872528 learned_addr learned my addr 172.21.15.118:0/1147872528 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:33.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60f67fc700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60f80c4310 0x7f60f80c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60f6ffd700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60f80c0ca0 0x7f60f8165d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60f77fe700 1 -- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60f80c0ca0 msgr2=0x7f60f8165d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60f77fe700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60f80c0ca0 0x7f60f8165d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60f77fe700 1 -- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60f80c4310 msgr2=0x7f60f80c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60f77fe700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60f80c4310 0x7f60f80c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60f77fe700 1 -- 172.21.15.118:0/1147872528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec009420 con 0x7f60f814c6a0 2023-09-28T04:23:33.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.454+0000 7f60f67fc700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60f80c4310 0x7f60f80c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:33.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.455+0000 7f60f77fe700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f814c6a0 0x7f60f8159d30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f60f000b6c0 tx=0x7f60f001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:33.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.455+0000 7f60deffd700 1 -- 172.21.15.118:0/1147872528 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f001a770 con 0x7f60f814c6a0 2023-09-28T04:23:33.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.455+0000 7f60deffd700 1 -- 172.21.15.118:0/1147872528 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f001a8d0 con 0x7f60f814c6a0 2023-09-28T04:23:33.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.455+0000 7f60fd3ff700 1 -- 172.21.15.118:0/1147872528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f0009a20 con 0x7f60f814c6a0 2023-09-28T04:23:33.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.455+0000 7f60deffd700 1 -- 172.21.15.118:0/1147872528 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f001ac90 con 0x7f60f814c6a0 2023-09-28T04:23:33.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.455+0000 7f60fd3ff700 1 -- 172.21.15.118:0/1147872528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f8168ec0 con 0x7f60f814c6a0 2023-09-28T04:23:33.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.456+0000 7f60fd3ff700 1 -- 172.21.15.118:0/1147872528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f8071980 con 0x7f60f814c6a0 2023-09-28T04:23:33.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.457+0000 7f60deffd700 1 -- 172.21.15.118:0/1147872528 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f60f0003040 con 0x7f60f814c6a0 2023-09-28T04:23:33.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.458+0000 7f60deffd700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f60e4067330 0x7f60e40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.458+0000 7f60deffd700 1 -- 172.21.15.118:0/1147872528 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f60f0086b50 con 0x7f60f814c6a0 2023-09-28T04:23:33.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.458+0000 7f60f6ffd700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f60e4067330 0x7f60e40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.459+0000 7f60f6ffd700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f60e4067330 0x7f60e40697e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f60e800c8f0 tx=0x7f60e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:33.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.462+0000 7f60deffd700 1 -- 172.21.15.118:0/1147872528 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f60f0053a50 con 0x7f60f814c6a0 2023-09-28T04:23:33.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.694+0000 7f60fd3ff700 1 -- 172.21.15.118:0/1147872528 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60f81659f0 con 0x7f60f814c6a0 2023-09-28T04:23:33.695 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.694+0000 7f60deffd700 1 -- 172.21.15.118:0/1147872528 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6147 (secure 0 0 0) 0x7f60f0028090 con 0x7f60f814c6a0 2023-09-28T04:23:33.695 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:33.695 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3635601230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3635601230},{"type":"v1","addr":"172.21.15.174:6837","nonce":3635601230}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2662305504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2662305504},{"type":"v1","addr":"172.21.15.174:6839","nonce":2662305504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/524044984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":524044984},{"type":"v1","addr":"172.21.15.118:6833","nonce":524044984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T04:23:18.370081+0000","modified":"2023-09-28T04:23:33.491193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4303,"mds_1":4300,"mds_2":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6836/1739320088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1739320088},{"type":"v1","addr":"172.21.15.174:6836","nonce":1739320088}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4300":{"gid":4300,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6835/2977056141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2977056141},{"type":"v1","addr":"172.21.15.118:6835","nonce":2977056141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4303":{"gid":4303,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6837/233759601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":233759601},{"type":"v1","addr":"172.21.15.118:6837","nonce":233759601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T04:23:33.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.696+0000 7f60fd3ff700 1 -- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f60e4067330 msgr2=0x7f60e40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.696+0000 7f60fd3ff700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f60e4067330 0x7f60e40697e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f60e800c8f0 tx=0x7f60e8009040 comp rx=0 tx=0).stop 2023-09-28T04:23:33.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.697+0000 7f60fd3ff700 1 -- 172.21.15.118:0/1147872528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f814c6a0 msgr2=0x7f60f8159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.697+0000 7f60fd3ff700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f814c6a0 0x7f60f8159d30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f60f000b6c0 tx=0x7f60f001b000 comp rx=0 tx=0).stop 2023-09-28T04:23:33.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.697+0000 7f60fd3ff700 1 -- 172.21.15.118:0/1147872528 shutdown_connections 2023-09-28T04:23:33.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.697+0000 7f60fd3ff700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f60e4067330 0x7f60e40697e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.697+0000 7f60fd3ff700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f814c6a0 0x7f60f8159d30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.697+0000 7f60fd3ff700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f60f80c0ca0 0x7f60f8165d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.697+0000 7f60fd3ff700 1 --2- 172.21.15.118:0/1147872528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60f80c4310 0x7f60f80c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.697+0000 7f60fd3ff700 1 -- 172.21.15.118:0/1147872528 >> 172.21.15.118:0/1147872528 conn(0x7f60f8067630 msgr2=0x7f60f814b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:33.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.697+0000 7f60fd3ff700 1 -- 172.21.15.118:0/1147872528 shutdown_connections 2023-09-28T04:23:33.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.697+0000 7f60fd3ff700 1 -- 172.21.15.118:0/1147872528 wait complete. 2023-09-28T04:23:33.699 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 12 2023-09-28T04:23:33.714 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:33.882 INFO:tasks.ceph.mds.a.smithi118.stderr:2023-09-28T04:23:33.882+0000 7f18cb3f1700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-09-28T04:23:33.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.902+0000 7f120bdff700 1 Processor -- start 2023-09-28T04:23:33.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.902+0000 7f120bdff700 1 -- start start 2023-09-28T04:23:33.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.904+0000 7f120bdff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f12040c5e30 0x7f1204156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.904+0000 7f120bdff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12040c73e0 con 0x7f12040c4ab0 2023-09-28T04:23:33.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.904+0000 7f120bdff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12040c0b60 con 0x7f12040ca6c0 2023-09-28T04:23:33.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.904+0000 7f120bdff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12040c67d0 con 0x7f12040c5e30 2023-09-28T04:23:33.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.904+0000 7f1209b9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f12040c5e30 0x7f1204156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.904+0000 7f120a39c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f12040ca6c0 0x7f120414f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:50740/0 (socket says 172.21.15.118:50740) 2023-09-28T04:23:33.905 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.904+0000 7f120a39c700 1 -- 172.21.15.118:0/830120433 learned_addr learned my addr 172.21.15.118:0/830120433 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:33.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.905+0000 7f1208b99700 1 -- 172.21.15.118:0/830120433 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577290467 0 0) 0x7f12040c73e0 con 0x7f12040c4ab0 2023-09-28T04:23:33.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.905+0000 7f1208b99700 1 -- 172.21.15.118:0/830120433 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f0003570 con 0x7f12040c4ab0 2023-09-28T04:23:33.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.905+0000 7f1209b9b700 1 -- 172.21.15.118:0/830120433 >> v1:172.21.15.174:6789/0 conn(0x7f12040ca6c0 legacy=0x7f120414f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.905+0000 7f1208b99700 1 -- 172.21.15.118:0/830120433 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558736708 0 0) 0x7f12040c0b60 con 0x7f12040ca6c0 2023-09-28T04:23:33.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.905+0000 7f1209b9b700 1 -- 172.21.15.118:0/830120433 >> v1:172.21.15.118:6789/0 conn(0x7f12040c4ab0 legacy=0x7f12040c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.905+0000 7f1209b9b700 1 -- 172.21.15.118:0/830120433 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12040c6ab0 con 0x7f12040c5e30 2023-09-28T04:23:33.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.905+0000 7f1209b9b700 1 --2- 172.21.15.118:0/830120433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12040c5e30 0x7f1204156570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f12000098d0 tx=0x7f1200009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f10d4a2b7acf7c78 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:33.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.905+0000 7f1208b99700 1 -- 172.21.15.118:0/830120433 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200005c10 con 0x7f12040c5e30 2023-09-28T04:23:33.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.905+0000 7f1208b99700 1 -- 172.21.15.118:0/830120433 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1200005d70 con 0x7f12040c5e30 2023-09-28T04:23:33.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.905+0000 7f1208b99700 1 -- 172.21.15.118:0/830120433 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200006280 con 0x7f12040c5e30 2023-09-28T04:23:33.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.906+0000 7f120bdff700 1 -- 172.21.15.118:0/830120433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12040c5e30 msgr2=0x7f1204156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.906+0000 7f120bdff700 1 --2- 172.21.15.118:0/830120433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12040c5e30 0x7f1204156570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f12000098d0 tx=0x7f1200009120 comp rx=0 tx=0).stop 2023-09-28T04:23:33.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.906+0000 7f120bdff700 1 -- 172.21.15.118:0/830120433 shutdown_connections 2023-09-28T04:23:33.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.906+0000 7f120bdff700 1 --2- 172.21.15.118:0/830120433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12040c5e30 0x7f1204156570 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.906+0000 7f120bdff700 1 -- 172.21.15.118:0/830120433 >> 172.21.15.118:0/830120433 conn(0x7f1204063230 msgr2=0x7f1204063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:33.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.906+0000 7f120bdff700 1 -- 172.21.15.118:0/830120433 shutdown_connections 2023-09-28T04:23:33.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.906+0000 7f120bdff700 1 -- 172.21.15.118:0/830120433 wait complete. 2023-09-28T04:23:33.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.907+0000 7f120bdff700 1 Processor -- start 2023-09-28T04:23:33.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.908+0000 7f120bdff700 1 -- start start 2023-09-28T04:23:33.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.908+0000 7f120bdff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12040c4ab0 0x7f120415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.908+0000 7f120bdff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12040c5e30 0x7f12040c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.908+0000 7f120bdff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12040ca6c0 0x7f12040c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.908+0000 7f120bdff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12040c8f90 con 0x7f12040ca6c0 2023-09-28T04:23:33.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.908+0000 7f120bdff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1204159c60 con 0x7f12040c4ab0 2023-09-28T04:23:33.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.908+0000 7f120bdff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12040c9230 con 0x7f12040c5e30 2023-09-28T04:23:33.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.909+0000 7f1209b9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12040c4ab0 0x7f120415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.909+0000 7f120939a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12040c5e30 0x7f12040c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.909+0000 7f1209b9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12040c4ab0 0x7f120415b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:57610/0 (socket says 172.21.15.118:57610) 2023-09-28T04:23:33.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.909+0000 7f1209b9b700 1 -- 172.21.15.118:0/2084840539 learned_addr learned my addr 172.21.15.118:0/2084840539 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:33.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.909+0000 7f120a39c700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12040ca6c0 0x7f12040c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.909+0000 7f1209b9b700 1 -- 172.21.15.118:0/2084840539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12040c5e30 msgr2=0x7f12040c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.909+0000 7f1209b9b700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12040c5e30 0x7f12040c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.909+0000 7f1209b9b700 1 -- 172.21.15.118:0/2084840539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12040ca6c0 msgr2=0x7f12040c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:33.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.909+0000 7f1209b9b700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12040ca6c0 0x7f12040c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:33.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.909+0000 7f1209b9b700 1 -- 172.21.15.118:0/2084840539 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12000093c0 con 0x7f12040c4ab0 2023-09-28T04:23:33.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.909+0000 7f120a39c700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12040ca6c0 0x7f12040c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:33.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.909+0000 7f1209b9b700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12040c4ab0 0x7f120415b530 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1204070f30 tx=0x7f1200016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:33.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.910+0000 7f11f9ffb700 1 -- 172.21.15.118:0/2084840539 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120000b7d0 con 0x7f12040c4ab0 2023-09-28T04:23:33.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.910+0000 7f11f9ffb700 1 -- 172.21.15.118:0/2084840539 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120000b950 con 0x7f12040c4ab0 2023-09-28T04:23:33.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.910+0000 7f11f9ffb700 1 -- 172.21.15.118:0/2084840539 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120000bd10 con 0x7f12040c4ab0 2023-09-28T04:23:33.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.910+0000 7f120bdff700 1 -- 172.21.15.118:0/2084840539 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12040c9510 con 0x7f12040c4ab0 2023-09-28T04:23:33.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.910+0000 7f120bdff700 1 -- 172.21.15.118:0/2084840539 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12040c9ad0 con 0x7f12040c4ab0 2023-09-28T04:23:33.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.911+0000 7f120bdff700 1 -- 172.21.15.118:0/2084840539 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12040713a0 con 0x7f12040c4ab0 2023-09-28T04:23:33.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.912+0000 7f11f9ffb700 1 -- 172.21.15.118:0/2084840539 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f120001b690 con 0x7f12040c4ab0 2023-09-28T04:23:33.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.913+0000 7f11f9ffb700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f11e8067330 0x7f11e80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:33.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.913+0000 7f11f9ffb700 1 -- 172.21.15.118:0/2084840539 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1200086550 con 0x7f12040c4ab0 2023-09-28T04:23:33.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.913+0000 7f120939a700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f11e8067330 0x7f11e80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:33.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.914+0000 7f120939a700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f11e8067330 0x7f11e80697e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f120406a250 tx=0x7f11f4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:33.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:33.917+0000 7f11f9ffb700 1 -- 172.21.15.118:0/2084840539 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1200053450 con 0x7f12040c4ab0 2023-09-28T04:23:34.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.108+0000 7f120bdff700 1 -- 172.21.15.118:0/2084840539 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1204071980 con 0x7f12040c4ab0 2023-09-28T04:23:34.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.109+0000 7f11f9ffb700 1 -- 172.21.15.118:0/2084840539 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f1200056a70 con 0x7f12040c4ab0 2023-09-28T04:23:34.110 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:34.111 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:19.371938+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T04:23:10.586895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T04:23:10.697802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T04:23:16.491417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T04:23:17.349188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:07.142219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.951857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.911133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.882482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.688096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.764671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.767264+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.763816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:34.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.112+0000 7f120bdff700 1 -- 172.21.15.118:0/2084840539 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f11e8067330 msgr2=0x7f11e80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.112+0000 7f120bdff700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f11e8067330 0x7f11e80697e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f120406a250 tx=0x7f11f4007d30 comp rx=0 tx=0).stop 2023-09-28T04:23:34.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.112+0000 7f120bdff700 1 -- 172.21.15.118:0/2084840539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12040c4ab0 msgr2=0x7f120415b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.112+0000 7f120bdff700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12040c4ab0 0x7f120415b530 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1204070f30 tx=0x7f1200016000 comp rx=0 tx=0).stop 2023-09-28T04:23:34.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.112+0000 7f120bdff700 1 -- 172.21.15.118:0/2084840539 shutdown_connections 2023-09-28T04:23:34.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.112+0000 7f120bdff700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f11e8067330 0x7f11e80697e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.112+0000 7f120bdff700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12040ca6c0 0x7f12040c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.112+0000 7f120bdff700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12040c4ab0 0x7f120415b530 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.112+0000 7f120bdff700 1 --2- 172.21.15.118:0/2084840539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12040c5e30 0x7f12040c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.112+0000 7f120bdff700 1 -- 172.21.15.118:0/2084840539 >> 172.21.15.118:0/2084840539 conn(0x7f1204063230 msgr2=0x7f12040bec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:34.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.112+0000 7f120bdff700 1 -- 172.21.15.118:0/2084840539 shutdown_connections 2023-09-28T04:23:34.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.112+0000 7f120bdff700 1 -- 172.21.15.118:0/2084840539 wait complete. 2023-09-28T04:23:34.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-28T04:23:10.586895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-28T04:23:10.697802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-28T04:23:16.491417+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-28T04:23:17.349188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-28T04:23:34.130 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-28T04:23:34.322 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.321+0000 7fedbe1ff700 1 Processor -- start 2023-09-28T04:23:34.322 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.322+0000 7fedbe1ff700 1 -- start start 2023-09-28T04:23:34.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.323+0000 7fedbe1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedb80ca6c0 0x7fedb8156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:34.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.323+0000 7fedbe1ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80c73e0 con 0x7fedb80c4ab0 2023-09-28T04:23:34.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.323+0000 7fedbe1ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80c0b60 con 0x7fedb80c5e30 2023-09-28T04:23:34.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.323+0000 7fedbe1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80c67d0 con 0x7fedb80ca6c0 2023-09-28T04:23:34.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.323+0000 7fedb6ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedb80ca6c0 0x7fedb8156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:34.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.323+0000 7fedb77fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fedb80c5e30 0x7fedb80c9fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:50754/0 (socket says 172.21.15.118:50754) 2023-09-28T04:23:34.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.323+0000 7fedb77fe700 1 -- 172.21.15.118:0/3105669728 learned_addr learned my addr 172.21.15.118:0/3105669728 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:34.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.323+0000 7fedb67fc700 1 -- 172.21.15.118:0/3105669728 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352076914 0 0) 0x7fedb80c0b60 con 0x7fedb80c5e30 2023-09-28T04:23:34.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.324+0000 7fedb67fc700 1 -- 172.21.15.118:0/3105669728 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feda0003570 con 0x7fedb80c5e30 2023-09-28T04:23:34.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.324+0000 7fedb6ffd700 1 -- 172.21.15.118:0/3105669728 >> v1:172.21.15.174:6789/0 conn(0x7fedb80c5e30 legacy=0x7fedb80c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.324+0000 7fedb6ffd700 1 -- 172.21.15.118:0/3105669728 >> v1:172.21.15.118:6789/0 conn(0x7fedb80c4ab0 legacy=0x7fedb814f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.324+0000 7fedb67fc700 1 -- 172.21.15.118:0/3105669728 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074677022 0 0) 0x7fedb80c73e0 con 0x7fedb80c4ab0 2023-09-28T04:23:34.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.324+0000 7fedb6ffd700 1 -- 172.21.15.118:0/3105669728 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80c6ab0 con 0x7fedb80ca6c0 2023-09-28T04:23:34.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.324+0000 7fedb6ffd700 1 --2- 172.21.15.118:0/3105669728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedb80ca6c0 0x7fedb8156570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fedac009910 tx=0x7fedac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbdfaf04453ab2b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:34.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.324+0000 7fedb67fc700 1 -- 172.21.15.118:0/3105669728 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00b710 con 0x7fedb80ca6c0 2023-09-28T04:23:34.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.324+0000 7fedb67fc700 1 -- 172.21.15.118:0/3105669728 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac00b870 con 0x7fedb80ca6c0 2023-09-28T04:23:34.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.324+0000 7fedb67fc700 1 -- 172.21.15.118:0/3105669728 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00bc30 con 0x7fedb80ca6c0 2023-09-28T04:23:34.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.325+0000 7fedbe1ff700 1 -- 172.21.15.118:0/3105669728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedb80ca6c0 msgr2=0x7fedb8156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.325+0000 7fedbe1ff700 1 --2- 172.21.15.118:0/3105669728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedb80ca6c0 0x7fedb8156570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fedac009910 tx=0x7fedac0091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.325+0000 7fedbe1ff700 1 -- 172.21.15.118:0/3105669728 shutdown_connections 2023-09-28T04:23:34.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.325+0000 7fedbe1ff700 1 --2- 172.21.15.118:0/3105669728 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedb80ca6c0 0x7fedb8156570 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.325+0000 7fedbe1ff700 1 -- 172.21.15.118:0/3105669728 >> 172.21.15.118:0/3105669728 conn(0x7fedb8063230 msgr2=0x7fedb8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:34.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.325+0000 7fedbe1ff700 1 -- 172.21.15.118:0/3105669728 shutdown_connections 2023-09-28T04:23:34.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.325+0000 7fedbe1ff700 1 -- 172.21.15.118:0/3105669728 wait complete. 2023-09-28T04:23:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.327+0000 7fedbe1ff700 1 Processor -- start 2023-09-28T04:23:34.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.327+0000 7fedbe1ff700 1 -- start start 2023-09-28T04:23:34.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.328+0000 7fedbe1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedb80c4ab0 0x7fedb815b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:34.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.328+0000 7fedbe1ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedb80c5e30 0x7fedb80c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:34.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.328+0000 7fedbe1ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb80ca6c0 0x7fedb80ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:34.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.328+0000 7fedbe1ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb81551a0 con 0x7fedb80c5e30 2023-09-28T04:23:34.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.328+0000 7fedbe1ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb814e3a0 con 0x7fedb80ca6c0 2023-09-28T04:23:34.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.328+0000 7fedbe1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb815c190 con 0x7fedb80c4ab0 2023-09-28T04:23:34.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.328+0000 7fedb6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedb80c5e30 0x7fedb80c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.328+0000 7fedb6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedb80c5e30 0x7fedb80c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51174/0 (socket says 172.21.15.118:51174) 2023-09-28T04:23:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.328+0000 7fedb6ffd700 1 -- 172.21.15.118:0/2507324504 learned_addr learned my addr 172.21.15.118:0/2507324504 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.328+0000 7fedb7fff700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb80ca6c0 0x7fedb80ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.328+0000 7fedb77fe700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedb80c4ab0 0x7fedb815b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.329+0000 7fedb6ffd700 1 -- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedb80c4ab0 msgr2=0x7fedb815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.329+0000 7fedb6ffd700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedb80c4ab0 0x7fedb815b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.329+0000 7fedb6ffd700 1 -- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb80ca6c0 msgr2=0x7fedb80ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.329+0000 7fedb6ffd700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb80ca6c0 0x7fedb80ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.329+0000 7fedb6ffd700 1 -- 172.21.15.118:0/2507324504 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac009420 con 0x7fedb80c5e30 2023-09-28T04:23:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.329+0000 7fedb6ffd700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedb80c5e30 0x7fedb80c9010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fedac009fb0 tx=0x7fedac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.329+0000 7fed9f7fe700 1 -- 172.21.15.118:0/2507324504 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00bbf0 con 0x7fedb80c5e30 2023-09-28T04:23:34.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.329+0000 7fed9f7fe700 1 -- 172.21.15.118:0/2507324504 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac011420 con 0x7fedb80c5e30 2023-09-28T04:23:34.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.329+0000 7fedbe1ff700 1 -- 172.21.15.118:0/2507324504 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb815bbd0 con 0x7fedb80c5e30 2023-09-28T04:23:34.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.329+0000 7fed9f7fe700 1 -- 172.21.15.118:0/2507324504 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0117c0 con 0x7fedb80c5e30 2023-09-28T04:23:34.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.330+0000 7fedbe1ff700 1 -- 172.21.15.118:0/2507324504 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb8155670 con 0x7fedb80c5e30 2023-09-28T04:23:34.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.330+0000 7fedbe1ff700 1 -- 172.21.15.118:0/2507324504 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb806f700 con 0x7fedb80c5e30 2023-09-28T04:23:34.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.331+0000 7fed9f7fe700 1 -- 172.21.15.118:0/2507324504 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fedac011b70 con 0x7fedb80c5e30 2023-09-28T04:23:34.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.332+0000 7fed9f7fe700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7feda4067330 0x7feda40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:34.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.332+0000 7fed9f7fe700 1 -- 172.21.15.118:0/2507324504 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fedac0868b0 con 0x7fedb80c5e30 2023-09-28T04:23:34.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.332+0000 7fedb77fe700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7feda4067330 0x7feda40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:34.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.333+0000 7fedb77fe700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7feda4067330 0x7feda40697e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feda8000ef0 tx=0x7feda8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:34.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.337+0000 7fed9f7fe700 1 -- 172.21.15.118:0/2507324504 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fedac053710 con 0x7fedb80c5e30 2023-09-28T04:23:34.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.531+0000 7fedbe1ff700 1 -- 172.21.15.118:0/2507324504 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedb80713a0 con 0x7fedb80c5e30 2023-09-28T04:23:34.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.531+0000 7fed9f7fe700 1 -- 172.21.15.118:0/2507324504 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedac056d30 con 0x7fedb80c5e30 2023-09-28T04:23:34.532 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2023-09-28T04:23:34.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.533+0000 7fedbe1ff700 1 -- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7feda4067330 msgr2=0x7feda40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.533+0000 7fedbe1ff700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7feda4067330 0x7feda40697e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feda8000ef0 tx=0x7feda8009040 comp rx=0 tx=0).stop 2023-09-28T04:23:34.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.533+0000 7fedbe1ff700 1 -- 172.21.15.118:0/2507324504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedb80c5e30 msgr2=0x7fedb80c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.533+0000 7fedbe1ff700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedb80c5e30 0x7fedb80c9010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fedac009fb0 tx=0x7fedac017000 comp rx=0 tx=0).stop 2023-09-28T04:23:34.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.533+0000 7fedbe1ff700 1 -- 172.21.15.118:0/2507324504 shutdown_connections 2023-09-28T04:23:34.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.533+0000 7fedbe1ff700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7feda4067330 0x7feda40697e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.533+0000 7fedbe1ff700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb80ca6c0 0x7fedb80ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.533+0000 7fedbe1ff700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fedb80c4ab0 0x7fedb815b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.533+0000 7fedbe1ff700 1 --2- 172.21.15.118:0/2507324504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedb80c5e30 0x7fedb80c9010 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.533+0000 7fedbe1ff700 1 -- 172.21.15.118:0/2507324504 >> 172.21.15.118:0/2507324504 conn(0x7fedb8063230 msgr2=0x7fedb80bf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:34.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.533+0000 7fedbe1ff700 1 -- 172.21.15.118:0/2507324504 shutdown_connections 2023-09-28T04:23:34.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.533+0000 7fedbe1ff700 1 -- 172.21.15.118:0/2507324504 wait complete. 2023-09-28T04:23:34.551 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-28T04:23:34.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.742+0000 7fd2827ff700 1 Processor -- start 2023-09-28T04:23:34.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.742+0000 7fd2827ff700 1 -- start start 2023-09-28T04:23:34.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.743+0000 7fd2827ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd27c14fa90 0x7fd27c156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:34.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd2827ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27c14fe60 0x7fd27c068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:34.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd2827ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd27c0c84c0 0x7fd27c0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:34.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd2827ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27c0c8030 con 0x7fd27c0c84c0 2023-09-28T04:23:34.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd2827ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27c0c7180 con 0x7fd27c14fa90 2023-09-28T04:23:34.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd2827ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0c7420 con 0x7fd27c14fe60 2023-09-28T04:23:34.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd280d9c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd27c0c84c0 0x7fd27c0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:34.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd27bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd27c14fa90 0x7fd27c156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:34.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd280d9c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd27c0c84c0 0x7fd27c0cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51178/0 (socket says 172.21.15.118:51178) 2023-09-28T04:23:34.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd280d9c700 1 -- 172.21.15.118:0/3649013231 learned_addr learned my addr 172.21.15.118:0/3649013231 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:34.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd27b7fe700 1 --2- 172.21.15.118:0/3649013231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27c14fe60 0x7fd27c068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:34.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd280d9c700 1 -- 172.21.15.118:0/3649013231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27c14fe60 msgr2=0x7fd27c068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:34.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd280d9c700 1 --2- 172.21.15.118:0/3649013231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27c14fe60 0x7fd27c068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd280d9c700 1 -- 172.21.15.118:0/3649013231 >> v2:172.21.15.174:3300/0 conn(0x7fd27c14fa90 msgr2=0x7fd27c156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:34.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd280d9c700 1 --2- 172.21.15.118:0/3649013231 >> v2:172.21.15.174:3300/0 conn(0x7fd27c14fa90 0x7fd27c156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.744+0000 7fd280d9c700 1 -- 172.21.15.118:0/3649013231 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c0c7700 con 0x7fd27c0c84c0 2023-09-28T04:23:34.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.745+0000 7fd280d9c700 1 --2- 172.21.15.118:0/3649013231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c0c84c0 0x7fd27c0cc690 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd27c089480 tx=0x7fd274009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f407e9ad96e1211a server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:34.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.745+0000 7fd27affd700 1 -- 172.21.15.118:0/3649013231 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27400e070 con 0x7fd27c0c84c0 2023-09-28T04:23:34.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.745+0000 7fd27affd700 1 -- 172.21.15.118:0/3649013231 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27400b970 con 0x7fd27c0c84c0 2023-09-28T04:23:34.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.745+0000 7fd27affd700 1 -- 172.21.15.118:0/3649013231 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2740092e0 con 0x7fd27c0c84c0 2023-09-28T04:23:34.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.745+0000 7fd2827ff700 1 -- 172.21.15.118:0/3649013231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c0c84c0 msgr2=0x7fd27c0cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.745+0000 7fd2827ff700 1 --2- 172.21.15.118:0/3649013231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c0c84c0 0x7fd27c0cc690 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd27c089480 tx=0x7fd274009840 comp rx=0 tx=0).stop 2023-09-28T04:23:34.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.745+0000 7fd2827ff700 1 -- 172.21.15.118:0/3649013231 shutdown_connections 2023-09-28T04:23:34.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.745+0000 7fd2827ff700 1 --2- 172.21.15.118:0/3649013231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c0c84c0 0x7fd27c0cc690 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.745+0000 7fd2827ff700 1 --2- 172.21.15.118:0/3649013231 >> v2:172.21.15.174:3300/0 conn(0x7fd27c14fa90 0x7fd27c156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.745+0000 7fd2827ff700 1 --2- 172.21.15.118:0/3649013231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27c14fe60 0x7fd27c068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.745+0000 7fd2827ff700 1 -- 172.21.15.118:0/3649013231 >> 172.21.15.118:0/3649013231 conn(0x7fd27c063cd0 msgr2=0x7fd27c0cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:34.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.746+0000 7fd2827ff700 1 -- 172.21.15.118:0/3649013231 shutdown_connections 2023-09-28T04:23:34.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.746+0000 7fd2827ff700 1 -- 172.21.15.118:0/3649013231 wait complete. 2023-09-28T04:23:34.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.747+0000 7fd2827ff700 1 Processor -- start 2023-09-28T04:23:34.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.747+0000 7fd2827ff700 1 -- start start 2023-09-28T04:23:34.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd2827ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c0c84c0 0x7fd27c1665a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:34.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd2827ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd27c14fa90 0x7fd27c0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:34.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd2827ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27c14fe60 0x7fd27c1697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:34.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd2827ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0c59c0 con 0x7fd27c0c84c0 2023-09-28T04:23:34.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd2827ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c169320 con 0x7fd27c14fa90 2023-09-28T04:23:34.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd2827ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c153320 con 0x7fd27c14fe60 2023-09-28T04:23:34.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd27bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c0c84c0 0x7fd27c1665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:34.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd27bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c0c84c0 0x7fd27c1665a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51184/0 (socket says 172.21.15.118:51184) 2023-09-28T04:23:34.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd27bfff700 1 -- 172.21.15.118:0/3800217939 learned_addr learned my addr 172.21.15.118:0/3800217939 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:34.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd280d9c700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27c14fe60 0x7fd27c1697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:34.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd27b7fe700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd27c14fa90 0x7fd27c0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:34.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd27bfff700 1 -- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27c14fe60 msgr2=0x7fd27c1697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd27bfff700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27c14fe60 0x7fd27c1697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd27bfff700 1 -- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd27c14fa90 msgr2=0x7fd27c0cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.748+0000 7fd27bfff700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd27c14fa90 0x7fd27c0cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.749+0000 7fd27bfff700 1 -- 172.21.15.118:0/3800217939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274009ae0 con 0x7fd27c0c84c0 2023-09-28T04:23:34.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.749+0000 7fd27bfff700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c0c84c0 0x7fd27c1665a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00e990 tx=0x7fd26c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:34.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.749+0000 7fd263fff700 1 -- 172.21.15.118:0/3800217939 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c013680 con 0x7fd27c0c84c0 2023-09-28T04:23:34.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.749+0000 7fd263fff700 1 -- 172.21.15.118:0/3800217939 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c0137e0 con 0x7fd27c0c84c0 2023-09-28T04:23:34.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.749+0000 7fd2827ff700 1 -- 172.21.15.118:0/3800217939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c166ae0 con 0x7fd27c0c84c0 2023-09-28T04:23:34.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.749+0000 7fd263fff700 1 -- 172.21.15.118:0/3800217939 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c013ba0 con 0x7fd27c0c84c0 2023-09-28T04:23:34.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.749+0000 7fd2827ff700 1 -- 172.21.15.118:0/3800217939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27c152d80 con 0x7fd27c0c84c0 2023-09-28T04:23:34.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.750+0000 7fd2827ff700 1 -- 172.21.15.118:0/3800217939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27c169600 con 0x7fd27c0c84c0 2023-09-28T04:23:34.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.751+0000 7fd263fff700 1 -- 172.21.15.118:0/3800217939 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd26c00c460 con 0x7fd27c0c84c0 2023-09-28T04:23:34.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.752+0000 7fd263fff700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd268067330 0x7fd2680697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:34.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.752+0000 7fd263fff700 1 -- 172.21.15.118:0/3800217939 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd26c084bb0 con 0x7fd27c0c84c0 2023-09-28T04:23:34.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.752+0000 7fd27b7fe700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd268067330 0x7fd2680697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:34.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.753+0000 7fd27b7fe700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd268067330 0x7fd2680697e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0c2dd0 tx=0x7fd2700091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:34.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.756+0000 7fd263fff700 1 -- 172.21.15.118:0/3800217939 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd26c051ab0 con 0x7fd27c0c84c0 2023-09-28T04:23:34.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.947+0000 7fd2827ff700 1 -- 172.21.15.118:0/3800217939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd27c071980 con 0x7fd27c0c84c0 2023-09-28T04:23:34.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.947+0000 7fd263fff700 1 -- 172.21.15.118:0/3800217939 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd26c0550d0 con 0x7fd27c0c84c0 2023-09-28T04:23:34.948 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2023-09-28T04:23:34.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.949+0000 7fd2827ff700 1 -- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd268067330 msgr2=0x7fd2680697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.949+0000 7fd2827ff700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd268067330 0x7fd2680697e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0c2dd0 tx=0x7fd2700091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.949+0000 7fd2827ff700 1 -- 172.21.15.118:0/3800217939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c0c84c0 msgr2=0x7fd27c1665a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:34.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.949+0000 7fd2827ff700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c0c84c0 0x7fd27c1665a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00e990 tx=0x7fd26c0091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.949+0000 7fd2827ff700 1 -- 172.21.15.118:0/3800217939 shutdown_connections 2023-09-28T04:23:34.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.949+0000 7fd2827ff700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd268067330 0x7fd2680697e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.949+0000 7fd2827ff700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd27c14fe60 0x7fd27c1697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.949+0000 7fd2827ff700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c0c84c0 0x7fd27c1665a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.949+0000 7fd2827ff700 1 --2- 172.21.15.118:0/3800217939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd27c14fa90 0x7fd27c0cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:34.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.949+0000 7fd2827ff700 1 -- 172.21.15.118:0/3800217939 >> 172.21.15.118:0/3800217939 conn(0x7fd27c063cd0 msgr2=0x7fd27c0c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:34.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.949+0000 7fd2827ff700 1 -- 172.21.15.118:0/3800217939 shutdown_connections 2023-09-28T04:23:34.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:34.949+0000 7fd2827ff700 1 -- 172.21.15.118:0/3800217939 wait complete. 2023-09-28T04:23:34.967 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-28T04:23:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.159+0000 7f8f113ff700 1 Processor -- start 2023-09-28T04:23:35.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.159+0000 7f8f113ff700 1 -- start start 2023-09-28T04:23:35.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.160+0000 7f8f113ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8f0c152640 0x7f8f0c0c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.160+0000 7f8f113ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f0c0c36f0 0x7f8f0c15c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.160+0000 7f8f113ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0c14c3c0 con 0x7f8f0c06f1c0 2023-09-28T04:23:35.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.160+0000 7f8f113ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c0c24c0 con 0x7f8f0c152640 2023-09-28T04:23:35.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.161+0000 7f8f113ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c152a70 con 0x7f8f0c0c36f0 2023-09-28T04:23:35.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.161+0000 7f8f0a7fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8f0c152640 0x7f8f0c0c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.161+0000 7f8f0affd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8f0c06f1c0 0x7f8f0c06b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47894/0 (socket says 172.21.15.118:47894) 2023-09-28T04:23:35.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.161+0000 7f8f0affd700 1 -- 172.21.15.118:0/739134564 learned_addr learned my addr 172.21.15.118:0/739134564 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:35.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.161+0000 7f8f0b7fe700 1 --2- 172.21.15.118:0/739134564 >> v2:172.21.15.174:3300/0 conn(0x7f8f0c0c36f0 0x7f8f0c15c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.161+0000 7f8f09ffb700 1 -- 172.21.15.118:0/739134564 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098621243 0 0) 0x7f8f0c14c3c0 con 0x7f8f0c06f1c0 2023-09-28T04:23:35.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.161+0000 7f8f09ffb700 1 -- 172.21.15.118:0/739134564 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ef4003570 con 0x7f8f0c06f1c0 2023-09-28T04:23:35.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.161+0000 7f8f0a7fc700 1 -- 172.21.15.118:0/739134564 >> v2:172.21.15.174:3300/0 conn(0x7f8f0c0c36f0 msgr2=0x7f8f0c15c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:35.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.161+0000 7f8f0a7fc700 1 --2- 172.21.15.118:0/739134564 >> v2:172.21.15.174:3300/0 conn(0x7f8f0c0c36f0 0x7f8f0c15c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.161+0000 7f8f0a7fc700 1 -- 172.21.15.118:0/739134564 >> v1:172.21.15.118:6789/0 conn(0x7f8f0c06f1c0 legacy=0x7f8f0c06b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.161+0000 7f8f0a7fc700 1 -- 172.21.15.118:0/739134564 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c06c2c0 con 0x7f8f0c152640 2023-09-28T04:23:35.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.162+0000 7f8f0a7fc700 1 --2- 172.21.15.118:0/739134564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c152640 0x7f8f0c0c31b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c06ab30 tx=0x7f8f000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4913dd67ca0b47f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:35.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.162+0000 7f8f09ffb700 1 -- 172.21.15.118:0/739134564 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00011630 con 0x7f8f0c152640 2023-09-28T04:23:35.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.162+0000 7f8f09ffb700 1 -- 172.21.15.118:0/739134564 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f000117b0 con 0x7f8f0c152640 2023-09-28T04:23:35.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.162+0000 7f8f09ffb700 1 -- 172.21.15.118:0/739134564 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00011b70 con 0x7f8f0c152640 2023-09-28T04:23:35.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.162+0000 7f8f113ff700 1 -- 172.21.15.118:0/739134564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c152640 msgr2=0x7f8f0c0c31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.162+0000 7f8f113ff700 1 --2- 172.21.15.118:0/739134564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c152640 0x7f8f0c0c31b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c06ab30 tx=0x7f8f000091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.162+0000 7f8f113ff700 1 -- 172.21.15.118:0/739134564 shutdown_connections 2023-09-28T04:23:35.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.162+0000 7f8f113ff700 1 --2- 172.21.15.118:0/739134564 >> v2:172.21.15.174:3300/0 conn(0x7f8f0c0c36f0 0x7f8f0c15c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.162+0000 7f8f113ff700 1 --2- 172.21.15.118:0/739134564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c152640 0x7f8f0c0c31b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.162+0000 7f8f113ff700 1 -- 172.21.15.118:0/739134564 >> 172.21.15.118:0/739134564 conn(0x7f8f0c067630 msgr2=0x7f8f0c067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:35.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.162+0000 7f8f113ff700 1 -- 172.21.15.118:0/739134564 shutdown_connections 2023-09-28T04:23:35.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.162+0000 7f8f113ff700 1 -- 172.21.15.118:0/739134564 wait complete. 2023-09-28T04:23:35.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.164+0000 7f8f113ff700 1 Processor -- start 2023-09-28T04:23:35.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.164+0000 7f8f113ff700 1 -- start start 2023-09-28T04:23:35.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f113ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f0c06f1c0 0x7f8f0c0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f113ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f0c0c36f0 0x7f8f0c1652d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f113ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c152640 0x7f8f0c165810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f113ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c164e80 con 0x7f8f0c152640 2023-09-28T04:23:35.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f113ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c168600 con 0x7f8f0c0c36f0 2023-09-28T04:23:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f113ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c168880 con 0x7f8f0c06f1c0 2023-09-28T04:23:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f0b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c152640 0x7f8f0c165810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f0b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c152640 0x7f8f0c165810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51198/0 (socket says 172.21.15.118:51198) 2023-09-28T04:23:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f0b7fe700 1 -- 172.21.15.118:0/3861671459 learned_addr learned my addr 172.21.15.118:0/3861671459 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f0a7fc700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f0c0c36f0 0x7f8f0c1652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f0affd700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f0c06f1c0 0x7f8f0c0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f0b7fe700 1 -- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f0c06f1c0 msgr2=0x7f8f0c0b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f0b7fe700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f0c06f1c0 0x7f8f0c0b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f0b7fe700 1 -- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f0c0c36f0 msgr2=0x7f8f0c1652d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f0b7fe700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f0c0c36f0 0x7f8f0c1652d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.165+0000 7f8f0b7fe700 1 -- 172.21.15.118:0/3861671459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00009420 con 0x7f8f0c152640 2023-09-28T04:23:35.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.166+0000 7f8f0b7fe700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c152640 0x7f8f0c165810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009ec0 tx=0x7f8f0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:35.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.166+0000 7f8ef2ffd700 1 -- 172.21.15.118:0/3861671459 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0400cc20 con 0x7f8f0c152640 2023-09-28T04:23:35.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.166+0000 7f8ef2ffd700 1 -- 172.21.15.118:0/3861671459 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0400f040 con 0x7f8f0c152640 2023-09-28T04:23:35.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.166+0000 7f8ef2ffd700 1 -- 172.21.15.118:0/3861671459 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04014480 con 0x7f8f0c152640 2023-09-28T04:23:35.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.166+0000 7f8f113ff700 1 -- 172.21.15.118:0/3861671459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c168b60 con 0x7f8f0c152640 2023-09-28T04:23:35.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.166+0000 7f8f113ff700 1 -- 172.21.15.118:0/3861671459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c169120 con 0x7f8f0c152640 2023-09-28T04:23:35.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.167+0000 7f8f113ff700 1 -- 172.21.15.118:0/3861671459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c071980 con 0x7f8f0c152640 2023-09-28T04:23:35.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.168+0000 7f8ef2ffd700 1 -- 172.21.15.118:0/3861671459 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8f04014830 con 0x7f8f0c152640 2023-09-28T04:23:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.170+0000 7f8ef2ffd700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8ef8067330 0x7f8ef80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.170+0000 7f8ef2ffd700 1 -- 172.21.15.118:0/3861671459 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8f040855c0 con 0x7f8f0c152640 2023-09-28T04:23:35.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.170+0000 7f8f0affd700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8ef8067330 0x7f8ef80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.171+0000 7f8f0affd700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8ef8067330 0x7f8ef80697e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0058d0 tx=0x7f8efc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:35.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.174+0000 7f8ef2ffd700 1 -- 172.21.15.118:0/3861671459 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8f04052420 con 0x7f8f0c152640 2023-09-28T04:23:35.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.362+0000 7f8f113ff700 1 -- 172.21.15.118:0/3861671459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f0c0be3b0 con 0x7f8f0c152640 2023-09-28T04:23:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.362+0000 7f8ef2ffd700 1 -- 172.21.15.118:0/3861671459 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8f04055a40 con 0x7f8f0c152640 2023-09-28T04:23:35.363 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2023-09-28T04:23:35.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.364+0000 7f8f113ff700 1 -- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8ef8067330 msgr2=0x7f8ef80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.364+0000 7f8f113ff700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8ef8067330 0x7f8ef80697e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0058d0 tx=0x7f8efc009040 comp rx=0 tx=0).stop 2023-09-28T04:23:35.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.364+0000 7f8f113ff700 1 -- 172.21.15.118:0/3861671459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c152640 msgr2=0x7f8f0c165810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.364+0000 7f8f113ff700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c152640 0x7f8f0c165810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009ec0 tx=0x7f8f0400b040 comp rx=0 tx=0).stop 2023-09-28T04:23:35.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.364+0000 7f8f113ff700 1 -- 172.21.15.118:0/3861671459 shutdown_connections 2023-09-28T04:23:35.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.364+0000 7f8f113ff700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8ef8067330 0x7f8ef80697e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.364+0000 7f8f113ff700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f0c152640 0x7f8f0c165810 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.364+0000 7f8f113ff700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f0c06f1c0 0x7f8f0c0b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.364+0000 7f8f113ff700 1 --2- 172.21.15.118:0/3861671459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f0c0c36f0 0x7f8f0c1652d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.364+0000 7f8f113ff700 1 -- 172.21.15.118:0/3861671459 >> 172.21.15.118:0/3861671459 conn(0x7f8f0c067630 msgr2=0x7f8f0c0bfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:35.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.365+0000 7f8f113ff700 1 -- 172.21.15.118:0/3861671459 shutdown_connections 2023-09-28T04:23:35.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.365+0000 7f8f113ff700 1 -- 172.21.15.118:0/3861671459 wait complete. 2023-09-28T04:23:35.382 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-28T04:23:35.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.575+0000 7f65551ff700 1 Processor -- start 2023-09-28T04:23:35.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.576+0000 7f65551ff700 1 -- start start 2023-09-28T04:23:35.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.577+0000 7f65551ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f65500adf10 0x7f65501562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.577+0000 7f65551ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65500c7980 con 0x7f655014f9f0 2023-09-28T04:23:35.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.577+0000 7f65551ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65500ccbc0 con 0x7f6550089830 2023-09-28T04:23:35.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.577+0000 7f65551ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65500cce60 con 0x7f65500adf10 2023-09-28T04:23:35.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.577+0000 7f654ed9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f65500adf10 0x7f65501562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.577+0000 7f654f59e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f655014f9f0 0x7f65500c7e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47908/0 (socket says 172.21.15.118:47908) 2023-09-28T04:23:35.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.577+0000 7f654f59e700 1 -- 172.21.15.118:0/3561965605 learned_addr learned my addr 172.21.15.118:0/3561965605 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:35.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.577+0000 7f654ed9d700 1 -- 172.21.15.118:0/3561965605 >> v1:172.21.15.174:6789/0 conn(0x7f6550089830 legacy=0x7f655014f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.577+0000 7f654ed9d700 1 -- 172.21.15.118:0/3561965605 >> v1:172.21.15.118:6789/0 conn(0x7f655014f9f0 legacy=0x7f65500c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.577+0000 7f654ed9d700 1 -- 172.21.15.118:0/3561965605 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65500c7020 con 0x7f65500adf10 2023-09-28T04:23:35.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.577+0000 7f654dd9b700 1 -- 172.21.15.118:0/3561965605 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047362715 0 0) 0x7f65500c7980 con 0x7f655014f9f0 2023-09-28T04:23:35.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.578+0000 7f654ed9d700 1 --2- 172.21.15.118:0/3561965605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65500adf10 0x7f65501562b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6540009860 tx=0x7f65400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2288ebd78c441984 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:35.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.578+0000 7f654dd9b700 1 -- 172.21.15.118:0/3561965605 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540011630 con 0x7f65500adf10 2023-09-28T04:23:35.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.578+0000 7f654dd9b700 1 -- 172.21.15.118:0/3561965605 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6540011790 con 0x7f65500adf10 2023-09-28T04:23:35.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.578+0000 7f654dd9b700 1 -- 172.21.15.118:0/3561965605 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540011b50 con 0x7f65500adf10 2023-09-28T04:23:35.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.578+0000 7f65551ff700 1 -- 172.21.15.118:0/3561965605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65500adf10 msgr2=0x7f65501562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.578+0000 7f65551ff700 1 --2- 172.21.15.118:0/3561965605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65500adf10 0x7f65501562b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6540009860 tx=0x7f65400091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.578+0000 7f65551ff700 1 -- 172.21.15.118:0/3561965605 shutdown_connections 2023-09-28T04:23:35.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.578+0000 7f65551ff700 1 --2- 172.21.15.118:0/3561965605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65500adf10 0x7f65501562b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.578+0000 7f65551ff700 1 -- 172.21.15.118:0/3561965605 >> 172.21.15.118:0/3561965605 conn(0x7f6550063cc0 msgr2=0x7f65500cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:35.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.579+0000 7f65551ff700 1 -- 172.21.15.118:0/3561965605 shutdown_connections 2023-09-28T04:23:35.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.579+0000 7f65551ff700 1 -- 172.21.15.118:0/3561965605 wait complete. 2023-09-28T04:23:35.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.580+0000 7f65551ff700 1 Processor -- start 2023-09-28T04:23:35.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.580+0000 7f65551ff700 1 -- start start 2023-09-28T04:23:35.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.581+0000 7f65551ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6550089830 0x7f65500c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.581+0000 7f65551ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65500adf10 0x7f65500c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.581+0000 7f65551ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f655014f9f0 0x7f65501525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.581+0000 7f65551ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65500c75e0 con 0x7f6550089830 2023-09-28T04:23:35.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.581+0000 7f65551ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65500c5940 con 0x7f65500adf10 2023-09-28T04:23:35.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.581+0000 7f65551ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65501663b0 con 0x7f655014f9f0 2023-09-28T04:23:35.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.581+0000 7f654ed9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6550089830 0x7f65500c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.581+0000 7f654ed9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6550089830 0x7f65500c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51220/0 (socket says 172.21.15.118:51220) 2023-09-28T04:23:35.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.581+0000 7f654ed9d700 1 -- 172.21.15.118:0/648524852 learned_addr learned my addr 172.21.15.118:0/648524852 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:35.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.581+0000 7f654f59e700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f655014f9f0 0x7f65501525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.581+0000 7f654e59c700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65500adf10 0x7f65500c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.582+0000 7f654ed9d700 1 -- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f655014f9f0 msgr2=0x7f65501525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.582+0000 7f654ed9d700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f655014f9f0 0x7f65501525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.582+0000 7f654ed9d700 1 -- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65500adf10 msgr2=0x7f65500c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.582+0000 7f654ed9d700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65500adf10 0x7f65500c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.582+0000 7f654ed9d700 1 -- 172.21.15.118:0/648524852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6540009420 con 0x7f6550089830 2023-09-28T04:23:35.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.582+0000 7f654ed9d700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6550089830 0x7f65500c47e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f654001cfd0 tx=0x7f6540016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:35.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.582+0000 7f6536ffd700 1 -- 172.21.15.118:0/648524852 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540011b10 con 0x7f6550089830 2023-09-28T04:23:35.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.582+0000 7f6536ffd700 1 -- 172.21.15.118:0/648524852 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6540024410 con 0x7f6550089830 2023-09-28T04:23:35.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.582+0000 7f6536ffd700 1 -- 172.21.15.118:0/648524852 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65400247b0 con 0x7f6550089830 2023-09-28T04:23:35.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.582+0000 7f65551ff700 1 -- 172.21.15.118:0/648524852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65500c63b0 con 0x7f6550089830 2023-09-28T04:23:35.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.582+0000 7f65551ff700 1 -- 172.21.15.118:0/648524852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6550168eb0 con 0x7f6550089830 2023-09-28T04:23:35.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.583+0000 7f65551ff700 1 -- 172.21.15.118:0/648524852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65500c4630 con 0x7f6550089830 2023-09-28T04:23:35.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.584+0000 7f6536ffd700 1 -- 172.21.15.118:0/648524852 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f654001a450 con 0x7f6550089830 2023-09-28T04:23:35.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.585+0000 7f6536ffd700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f653c067330 0x7f653c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.585+0000 7f6536ffd700 1 -- 172.21.15.118:0/648524852 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6540086840 con 0x7f6550089830 2023-09-28T04:23:35.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.586+0000 7f654e59c700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f653c067330 0x7f653c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.586+0000 7f654e59c700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f653c067330 0x7f653c0697e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f65500cbdd0 tx=0x7f6544007e60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:35.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.589+0000 7f6536ffd700 1 -- 172.21.15.118:0/648524852 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f65400536a0 con 0x7f6550089830 2023-09-28T04:23:35.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.782+0000 7f65551ff700 1 -- 172.21.15.118:0/648524852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6550071980 con 0x7f6550089830 2023-09-28T04:23:35.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.782+0000 7f6536ffd700 1 -- 172.21.15.118:0/648524852 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6540056cc0 con 0x7f6550089830 2023-09-28T04:23:35.783 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2023-09-28T04:23:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.785+0000 7f65551ff700 1 -- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f653c067330 msgr2=0x7f653c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.785+0000 7f65551ff700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f653c067330 0x7f653c0697e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f65500cbdd0 tx=0x7f6544007e60 comp rx=0 tx=0).stop 2023-09-28T04:23:35.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.785+0000 7f65551ff700 1 -- 172.21.15.118:0/648524852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6550089830 msgr2=0x7f65500c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.785+0000 7f65551ff700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6550089830 0x7f65500c47e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f654001cfd0 tx=0x7f6540016000 comp rx=0 tx=0).stop 2023-09-28T04:23:35.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.785+0000 7f65551ff700 1 -- 172.21.15.118:0/648524852 shutdown_connections 2023-09-28T04:23:35.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.785+0000 7f65551ff700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f653c067330 0x7f653c0697e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.785+0000 7f65551ff700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f655014f9f0 0x7f65501525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.785+0000 7f65551ff700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6550089830 0x7f65500c47e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.785+0000 7f65551ff700 1 --2- 172.21.15.118:0/648524852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f65500adf10 0x7f65500c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.785+0000 7f65551ff700 1 -- 172.21.15.118:0/648524852 >> 172.21.15.118:0/648524852 conn(0x7f6550063cc0 msgr2=0x7f655014d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:35.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.785+0000 7f65551ff700 1 -- 172.21.15.118:0/648524852 shutdown_connections 2023-09-28T04:23:35.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.785+0000 7f65551ff700 1 -- 172.21.15.118:0/648524852 wait complete. 2023-09-28T04:23:35.802 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T04:23:35.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.991+0000 7f121adff700 1 Processor -- start 2023-09-28T04:23:35.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.991+0000 7f121adff700 1 -- start start 2023-09-28T04:23:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.992+0000 7f121adff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f121414fa90 0x7f1214156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.992+0000 7f121adff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12140c8030 con 0x7f121414fe60 2023-09-28T04:23:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.992+0000 7f121adff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12140c7180 con 0x7f12140c84c0 2023-09-28T04:23:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.992+0000 7f121adff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12140c7420 con 0x7f121414fa90 2023-09-28T04:23:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.992+0000 7f1218b9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f121414fa90 0x7f1214156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.993+0000 7f1213fff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f121414fe60 0x7f12140cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47920/0 (socket says 172.21.15.118:47920) 2023-09-28T04:23:35.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.993+0000 7f1213fff700 1 -- 172.21.15.118:0/2972606780 learned_addr learned my addr 172.21.15.118:0/2972606780 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.993+0000 7f1218b9b700 1 -- 172.21.15.118:0/2972606780 >> v1:172.21.15.174:6789/0 conn(0x7f12140c84c0 legacy=0x7f12140adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.993+0000 7f1218b9b700 1 -- 172.21.15.118:0/2972606780 >> v1:172.21.15.118:6789/0 conn(0x7f121414fe60 legacy=0x7f12140cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.993+0000 7f1218b9b700 1 -- 172.21.15.118:0/2972606780 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12140c7700 con 0x7f121414fa90 2023-09-28T04:23:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.993+0000 7f1218b9b700 1 --2- 172.21.15.118:0/2972606780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121414fa90 0x7f1214156430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f12080098e0 tx=0x7f12080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a86e769736aa054 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.993+0000 7f12137fe700 1 -- 172.21.15.118:0/2972606780 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208009e80 con 0x7f121414fa90 2023-09-28T04:23:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.993+0000 7f12137fe700 1 -- 172.21.15.118:0/2972606780 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120800b860 con 0x7f121414fa90 2023-09-28T04:23:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.993+0000 7f12137fe700 1 -- 172.21.15.118:0/2972606780 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120800bbe0 con 0x7f121414fa90 2023-09-28T04:23:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.994+0000 7f121adff700 1 -- 172.21.15.118:0/2972606780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121414fa90 msgr2=0x7f1214156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.994+0000 7f121adff700 1 --2- 172.21.15.118:0/2972606780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121414fa90 0x7f1214156430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f12080098e0 tx=0x7f12080091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.994+0000 7f121adff700 1 -- 172.21.15.118:0/2972606780 shutdown_connections 2023-09-28T04:23:35.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.994+0000 7f121adff700 1 --2- 172.21.15.118:0/2972606780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121414fa90 0x7f1214156430 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.994+0000 7f121adff700 1 -- 172.21.15.118:0/2972606780 >> 172.21.15.118:0/2972606780 conn(0x7f1214063cd0 msgr2=0x7f12140cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.994+0000 7f121adff700 1 -- 172.21.15.118:0/2972606780 shutdown_connections 2023-09-28T04:23:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.994+0000 7f121adff700 1 -- 172.21.15.118:0/2972606780 wait complete. 2023-09-28T04:23:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.995+0000 7f121adff700 1 Processor -- start 2023-09-28T04:23:35.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.996+0000 7f121adff700 1 -- start start 2023-09-28T04:23:35.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.996+0000 7f121adff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12140c84c0 0x7f12140cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.996+0000 7f121adff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f121414fa90 0x7f12140cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f121adff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121414fe60 0x7f1214169b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:35.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f121adff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140c5d60 con 0x7f121414fe60 2023-09-28T04:23:35.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f121adff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140c9e30 con 0x7f12140c84c0 2023-09-28T04:23:35.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f121adff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12141696f0 con 0x7f121414fa90 2023-09-28T04:23:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f121939c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121414fe60 0x7f1214169b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f121939c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121414fe60 0x7f1214169b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51244/0 (socket says 172.21.15.118:51244) 2023-09-28T04:23:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f121939c700 1 -- 172.21.15.118:0/916890534 learned_addr learned my addr 172.21.15.118:0/916890534 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f1218b9b700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12140c84c0 0x7f12140cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f1213fff700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f121414fa90 0x7f12140cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f121939c700 1 -- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f121414fa90 msgr2=0x7f12140cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f121939c700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f121414fa90 0x7f12140cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f121939c700 1 -- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12140c84c0 msgr2=0x7f12140cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f121939c700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12140c84c0 0x7f12140cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:35.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f121939c700 1 -- 172.21.15.118:0/916890534 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1208009420 con 0x7f121414fe60 2023-09-28T04:23:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f1218b9b700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12140c84c0 0x7f12140cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.997+0000 7f121939c700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121414fe60 0x7f1214169b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f120c00c8e0 tx=0x7f120c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.998+0000 7f1210ff9700 1 -- 172.21.15.118:0/916890534 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c00a650 con 0x7f121414fe60 2023-09-28T04:23:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.998+0000 7f1210ff9700 1 -- 172.21.15.118:0/916890534 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c00a7b0 con 0x7f121414fe60 2023-09-28T04:23:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.998+0000 7f121adff700 1 -- 172.21.15.118:0/916890534 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12140c4e50 con 0x7f121414fe60 2023-09-28T04:23:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.998+0000 7f1210ff9700 1 -- 172.21.15.118:0/916890534 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c00ab70 con 0x7f121414fe60 2023-09-28T04:23:36.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.998+0000 7f121adff700 1 -- 172.21.15.118:0/916890534 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12140bf740 con 0x7f121414fe60 2023-09-28T04:23:36.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.999+0000 7f121adff700 1 -- 172.21.15.118:0/916890534 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121414d2a0 con 0x7f121414fe60 2023-09-28T04:23:36.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:35.999+0000 7f1210ff9700 1 -- 172.21.15.118:0/916890534 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f120c012420 con 0x7f121414fe60 2023-09-28T04:23:36.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.000+0000 7f1210ff9700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f11f8067360 0x7f11f8069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:36.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.000+0000 7f1210ff9700 1 -- 172.21.15.118:0/916890534 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f120c084f20 con 0x7f121414fe60 2023-09-28T04:23:36.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.000+0000 7f1218b9b700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f11f8067360 0x7f11f8069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:36.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.001+0000 7f1218b9b700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f11f8067360 0x7f11f8069810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f12080093f0 tx=0x7f1208017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:36.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.004+0000 7f1210ff9700 1 -- 172.21.15.118:0/916890534 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f120c051d80 con 0x7f121414fe60 2023-09-28T04:23:36.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.235+0000 7f121adff700 1 -- 172.21.15.118:0/916890534 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12140c5130 con 0x7f121414fe60 2023-09-28T04:23:36.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.235+0000 7f1210ff9700 1 -- 172.21.15.118:0/916890534 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6147 (secure 0 0 0) 0x7f120c0553a0 con 0x7f121414fe60 2023-09-28T04:23:36.236 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:36.236 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3635601230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3635601230},{"type":"v1","addr":"172.21.15.174:6837","nonce":3635601230}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2662305504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2662305504},{"type":"v1","addr":"172.21.15.174:6839","nonce":2662305504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/524044984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":524044984},{"type":"v1","addr":"172.21.15.118:6833","nonce":524044984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T04:23:18.370081+0000","modified":"2023-09-28T04:23:33.491193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4303,"mds_1":4300,"mds_2":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6836/1739320088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1739320088},{"type":"v1","addr":"172.21.15.174:6836","nonce":1739320088}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4300":{"gid":4300,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6835/2977056141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2977056141},{"type":"v1","addr":"172.21.15.118:6835","nonce":2977056141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4303":{"gid":4303,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6837/233759601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":233759601},{"type":"v1","addr":"172.21.15.118:6837","nonce":233759601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T04:23:36.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.237+0000 7f121adff700 1 -- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f11f8067360 msgr2=0x7f11f8069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.237+0000 7f121adff700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f11f8067360 0x7f11f8069810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f12080093f0 tx=0x7f1208017000 comp rx=0 tx=0).stop 2023-09-28T04:23:36.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.237+0000 7f121adff700 1 -- 172.21.15.118:0/916890534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121414fe60 msgr2=0x7f1214169b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.237+0000 7f121adff700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121414fe60 0x7f1214169b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f120c00c8e0 tx=0x7f120c001710 comp rx=0 tx=0).stop 2023-09-28T04:23:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.237+0000 7f121adff700 1 -- 172.21.15.118:0/916890534 shutdown_connections 2023-09-28T04:23:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.237+0000 7f121adff700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f11f8067360 0x7f11f8069810 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.237+0000 7f121adff700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f121414fe60 0x7f1214169b80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.237+0000 7f121adff700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12140c84c0 0x7f12140cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.237+0000 7f121adff700 1 --2- 172.21.15.118:0/916890534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f121414fa90 0x7f12140cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.237+0000 7f121adff700 1 -- 172.21.15.118:0/916890534 >> 172.21.15.118:0/916890534 conn(0x7f1214063cd0 msgr2=0x7f121414b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.238+0000 7f121adff700 1 -- 172.21.15.118:0/916890534 shutdown_connections 2023-09-28T04:23:36.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.238+0000 7f121adff700 1 -- 172.21.15.118:0/916890534 wait complete. 2023-09-28T04:23:36.240 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 12 2023-09-28T04:23:36.256 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.444+0000 7fee47dff700 1 Processor -- start 2023-09-28T04:23:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.444+0000 7fee47dff700 1 -- start start 2023-09-28T04:23:36.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.445+0000 7fee47dff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee400ca6c0 0x7fee40156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:36.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.445+0000 7fee47dff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee400c73e0 con 0x7fee400c4ab0 2023-09-28T04:23:36.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.445+0000 7fee47dff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee400c0b60 con 0x7fee400c5e30 2023-09-28T04:23:36.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.445+0000 7fee47dff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee400c67d0 con 0x7fee400ca6c0 2023-09-28T04:23:36.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.445+0000 7fee4639c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fee400c4ab0 0x7fee4014f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47932/0 (socket says 172.21.15.118:47932) 2023-09-28T04:23:36.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.445+0000 7fee4639c700 1 -- 172.21.15.118:0/3452368871 learned_addr learned my addr 172.21.15.118:0/3452368871 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:36.446 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.446+0000 7fee4539a700 1 --2- 172.21.15.118:0/3452368871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee400ca6c0 0x7fee40156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:36.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.446+0000 7fee44b99700 1 -- 172.21.15.118:0/3452368871 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893518592 0 0) 0x7fee400c73e0 con 0x7fee400c4ab0 2023-09-28T04:23:36.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.446+0000 7fee44b99700 1 -- 172.21.15.118:0/3452368871 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee2c003570 con 0x7fee400c4ab0 2023-09-28T04:23:36.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.446+0000 7fee44b99700 1 -- 172.21.15.118:0/3452368871 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847438416 0 0) 0x7fee400c0b60 con 0x7fee400c5e30 2023-09-28T04:23:36.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.446+0000 7fee4539a700 1 -- 172.21.15.118:0/3452368871 >> v1:172.21.15.174:6789/0 conn(0x7fee400c5e30 legacy=0x7fee400c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.446+0000 7fee4539a700 1 -- 172.21.15.118:0/3452368871 >> v1:172.21.15.118:6789/0 conn(0x7fee400c4ab0 legacy=0x7fee4014f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.446+0000 7fee4539a700 1 -- 172.21.15.118:0/3452368871 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee400c6ab0 con 0x7fee400ca6c0 2023-09-28T04:23:36.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.446+0000 7fee4539a700 1 --2- 172.21.15.118:0/3452368871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee400ca6c0 0x7fee40156570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee30009910 tx=0x7fee300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e32c34db49d71376 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:36.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.446+0000 7fee44b99700 1 -- 172.21.15.118:0/3452368871 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3000b710 con 0x7fee400ca6c0 2023-09-28T04:23:36.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.446+0000 7fee44b99700 1 -- 172.21.15.118:0/3452368871 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3000b870 con 0x7fee400ca6c0 2023-09-28T04:23:36.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.446+0000 7fee44b99700 1 -- 172.21.15.118:0/3452368871 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3000bc30 con 0x7fee400ca6c0 2023-09-28T04:23:36.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.447+0000 7fee47dff700 1 -- 172.21.15.118:0/3452368871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee400ca6c0 msgr2=0x7fee40156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.447+0000 7fee47dff700 1 --2- 172.21.15.118:0/3452368871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee400ca6c0 0x7fee40156570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee30009910 tx=0x7fee300091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.447+0000 7fee47dff700 1 -- 172.21.15.118:0/3452368871 shutdown_connections 2023-09-28T04:23:36.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.447+0000 7fee47dff700 1 --2- 172.21.15.118:0/3452368871 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee400ca6c0 0x7fee40156570 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.447+0000 7fee47dff700 1 -- 172.21.15.118:0/3452368871 >> 172.21.15.118:0/3452368871 conn(0x7fee40063230 msgr2=0x7fee40063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:36.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.447+0000 7fee47dff700 1 -- 172.21.15.118:0/3452368871 shutdown_connections 2023-09-28T04:23:36.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.447+0000 7fee47dff700 1 -- 172.21.15.118:0/3452368871 wait complete. 2023-09-28T04:23:36.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.449+0000 7fee47dff700 1 Processor -- start 2023-09-28T04:23:36.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.449+0000 7fee47dff700 1 -- start start 2023-09-28T04:23:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.449+0000 7fee47dff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee400c4ab0 0x7fee40165c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.449+0000 7fee47dff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee400c5e30 0x7fee4014c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee47dff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee400ca6c0 0x7fee4014cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee47dff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee400ad3d0 con 0x7fee400ca6c0 2023-09-28T04:23:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee47dff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee40165780 con 0x7fee400c5e30 2023-09-28T04:23:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee47dff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee40156150 con 0x7fee400c4ab0 2023-09-28T04:23:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee4639c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee400ca6c0 0x7fee4014cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee4539a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee400c5e30 0x7fee4014c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee4639c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee400ca6c0 0x7fee4014cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51246/0 (socket says 172.21.15.118:51246) 2023-09-28T04:23:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee4639c700 1 -- 172.21.15.118:0/1281720166 learned_addr learned my addr 172.21.15.118:0/1281720166 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee45b9b700 1 --2- 172.21.15.118:0/1281720166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee400c4ab0 0x7fee40165c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee4639c700 1 -- 172.21.15.118:0/1281720166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee400c4ab0 msgr2=0x7fee40165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee4639c700 1 --2- 172.21.15.118:0/1281720166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee400c4ab0 0x7fee40165c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee4639c700 1 -- 172.21.15.118:0/1281720166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee400c5e30 msgr2=0x7fee4014c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee4639c700 1 --2- 172.21.15.118:0/1281720166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee400c5e30 0x7fee4014c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee4639c700 1 -- 172.21.15.118:0/1281720166 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee30009420 con 0x7fee400ca6c0 2023-09-28T04:23:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.450+0000 7fee4639c700 1 --2- 172.21.15.118:0/1281720166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee400ca6c0 0x7fee4014cb40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fee38001460 tx=0x7fee38001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.451+0000 7fee35ffb700 1 -- 172.21.15.118:0/1281720166 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3800a900 con 0x7fee400ca6c0 2023-09-28T04:23:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.451+0000 7fee35ffb700 1 -- 172.21.15.118:0/1281720166 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3800aa60 con 0x7fee400ca6c0 2023-09-28T04:23:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.451+0000 7fee47dff700 1 -- 172.21.15.118:0/1281720166 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee40165430 con 0x7fee400ca6c0 2023-09-28T04:23:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.451+0000 7fee35ffb700 1 -- 172.21.15.118:0/1281720166 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3800ade0 con 0x7fee400ca6c0 2023-09-28T04:23:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.451+0000 7fee47dff700 1 -- 172.21.15.118:0/1281720166 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee401563f0 con 0x7fee400ca6c0 2023-09-28T04:23:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.452+0000 7fee47dff700 1 -- 172.21.15.118:0/1281720166 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee400713a0 con 0x7fee400ca6c0 2023-09-28T04:23:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.453+0000 7fee35ffb700 1 -- 172.21.15.118:0/1281720166 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fee38007300 con 0x7fee400ca6c0 2023-09-28T04:23:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.454+0000 7fee35ffb700 1 --2- 172.21.15.118:0/1281720166 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fee24067330 0x7fee240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.454+0000 7fee35ffb700 1 -- 172.21.15.118:0/1281720166 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fee38084fb0 con 0x7fee400ca6c0 2023-09-28T04:23:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.454+0000 7fee45b9b700 1 --2- 172.21.15.118:0/1281720166 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fee24067330 0x7fee240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.455+0000 7fee45b9b700 1 --2- 172.21.15.118:0/1281720166 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fee24067330 0x7fee240697e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fee3c007fd0 tx=0x7fee3c007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.458+0000 7fee35ffb700 1 -- 172.21.15.118:0/1281720166 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fee38051ea0 con 0x7fee400ca6c0 2023-09-28T04:23:36.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.647+0000 7fee47dff700 1 -- 172.21.15.118:0/1281720166 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee4014d0e0 con 0x7fee400ca6c0 2023-09-28T04:23:36.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.648+0000 7fee35ffb700 1 -- 172.21.15.118:0/1281720166 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17010 (secure 0 0 0) 0x7fee380554c0 con 0x7fee400ca6c0 2023-09-28T04:23:36.649 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:36.649 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:19.371938+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T04:23:10.586895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T04:23:10.697802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T04:23:16.491417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T04:23:17.349188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:07.142219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.951857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.911133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.882482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.688096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.764671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.767264+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.763816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.651+0000 7fee47dff700 1 -- 172.21.15.118:0/1281720166 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fee24067330 msgr2=0x7fee240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.651+0000 7fee47dff700 1 --2- 172.21.15.118:0/1281720166 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fee24067330 0x7fee240697e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fee3c007fd0 tx=0x7fee3c007d10 comp rx=0 tx=0).stop 2023-09-28T04:23:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.651+0000 7fee47dff700 1 -- 172.21.15.118:0/1281720166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee400ca6c0 msgr2=0x7fee4014cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.651+0000 7fee47dff700 1 --2- 172.21.15.118:0/1281720166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee400ca6c0 0x7fee4014cb40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fee38001460 tx=0x7fee38001a40 comp rx=0 tx=0).stop 2023-09-28T04:23:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.651+0000 7fee47dff700 1 -- 172.21.15.118:0/1281720166 shutdown_connections 2023-09-28T04:23:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.651+0000 7fee47dff700 1 --2- 172.21.15.118:0/1281720166 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fee24067330 0x7fee240697e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.651+0000 7fee47dff700 1 --2- 172.21.15.118:0/1281720166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee400ca6c0 0x7fee4014cb40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.651+0000 7fee47dff700 1 --2- 172.21.15.118:0/1281720166 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee400c4ab0 0x7fee40165c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.651+0000 7fee47dff700 1 --2- 172.21.15.118:0/1281720166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee400c5e30 0x7fee4014c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.651+0000 7fee47dff700 1 -- 172.21.15.118:0/1281720166 >> 172.21.15.118:0/1281720166 conn(0x7fee40063230 msgr2=0x7fee400c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.651+0000 7fee47dff700 1 -- 172.21.15.118:0/1281720166 shutdown_connections 2023-09-28T04:23:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.651+0000 7fee47dff700 1 -- 172.21.15.118:0/1281720166 wait complete. 2023-09-28T04:23:36.669 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T04:23:36.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.857+0000 7f03eddff700 1 Processor -- start 2023-09-28T04:23:36.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.858+0000 7f03eddff700 1 -- start start 2023-09-28T04:23:36.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.859+0000 7f03eddff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f03e80c4ab0 0x7f03e8156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:36.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.859+0000 7f03eddff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e80c73e0 con 0x7f03e80ca6c0 2023-09-28T04:23:36.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.859+0000 7f03eddff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e80c0b60 con 0x7f03e80c5e30 2023-09-28T04:23:36.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.859+0000 7f03eddff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e80c67d0 con 0x7f03e80c4ab0 2023-09-28T04:23:36.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.859+0000 7f03e6ffd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f03e80ca6c0 0x7f03e814f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47940/0 (socket says 172.21.15.118:47940) 2023-09-28T04:23:36.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.859+0000 7f03e6ffd700 1 -- 172.21.15.118:0/3045370258 learned_addr learned my addr 172.21.15.118:0/3045370258 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:36.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.859+0000 7f03e7fff700 1 --2- 172.21.15.118:0/3045370258 >> v2:172.21.15.174:3300/0 conn(0x7f03e80c4ab0 0x7f03e8156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:36.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.860+0000 7f03e67fc700 1 -- 172.21.15.118:0/3045370258 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548884674 0 0) 0x7f03e80c73e0 con 0x7f03e80ca6c0 2023-09-28T04:23:36.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.860+0000 7f03e67fc700 1 -- 172.21.15.118:0/3045370258 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d0003570 con 0x7f03e80ca6c0 2023-09-28T04:23:36.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.860+0000 7f03e67fc700 1 -- 172.21.15.118:0/3045370258 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869846539 0 0) 0x7f03e80c0b60 con 0x7f03e80c5e30 2023-09-28T04:23:36.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.860+0000 7f03e67fc700 1 -- 172.21.15.118:0/3045370258 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03e80c73e0 con 0x7f03e80c5e30 2023-09-28T04:23:36.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.860+0000 7f03e7fff700 1 -- 172.21.15.118:0/3045370258 >> v1:172.21.15.174:6789/0 conn(0x7f03e80c5e30 legacy=0x7f03e80c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.860+0000 7f03e7fff700 1 -- 172.21.15.118:0/3045370258 >> v1:172.21.15.118:6789/0 conn(0x7f03e80ca6c0 legacy=0x7f03e814f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.860+0000 7f03e7fff700 1 -- 172.21.15.118:0/3045370258 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e80c6ab0 con 0x7f03e80c4ab0 2023-09-28T04:23:36.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.860+0000 7f03e7fff700 1 --2- 172.21.15.118:0/3045370258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e80c4ab0 0x7f03e8156570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009e60 tx=0x7f03e0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c3a423698b9f9a server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:36.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.860+0000 7f03e67fc700 1 -- 172.21.15.118:0/3045370258 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e000e070 con 0x7f03e80c4ab0 2023-09-28T04:23:36.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.860+0000 7f03e67fc700 1 -- 172.21.15.118:0/3045370258 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e000bb40 con 0x7f03e80c4ab0 2023-09-28T04:23:36.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.860+0000 7f03e67fc700 1 -- 172.21.15.118:0/3045370258 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0012430 con 0x7f03e80c4ab0 2023-09-28T04:23:36.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.861+0000 7f03eddff700 1 -- 172.21.15.118:0/3045370258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e80c4ab0 msgr2=0x7f03e8156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.861+0000 7f03eddff700 1 --2- 172.21.15.118:0/3045370258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e80c4ab0 0x7f03e8156570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009e60 tx=0x7f03e0009780 comp rx=0 tx=0).stop 2023-09-28T04:23:36.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.861+0000 7f03eddff700 1 -- 172.21.15.118:0/3045370258 shutdown_connections 2023-09-28T04:23:36.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.861+0000 7f03eddff700 1 --2- 172.21.15.118:0/3045370258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e80c4ab0 0x7f03e8156570 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.861+0000 7f03eddff700 1 -- 172.21.15.118:0/3045370258 >> 172.21.15.118:0/3045370258 conn(0x7f03e8063230 msgr2=0x7f03e8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:36.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.861+0000 7f03eddff700 1 -- 172.21.15.118:0/3045370258 shutdown_connections 2023-09-28T04:23:36.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.861+0000 7f03eddff700 1 -- 172.21.15.118:0/3045370258 wait complete. 2023-09-28T04:23:36.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.863+0000 7f03eddff700 1 Processor -- start 2023-09-28T04:23:36.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.863+0000 7f03eddff700 1 -- start start 2023-09-28T04:23:36.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.864+0000 7f03eddff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03e80c4ab0 0x7f03e80ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:36.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.864+0000 7f03eddff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03e80c5e30 0x7f03e80af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:36.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.864+0000 7f03eddff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e80ca6c0 0x7f03e8154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:36.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.864+0000 7f03eddff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e80af280 con 0x7f03e80c5e30 2023-09-28T04:23:36.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.864+0000 7f03eddff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e80aecb0 con 0x7f03e80ca6c0 2023-09-28T04:23:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.864+0000 7f03eddff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e8155ec0 con 0x7f03e80c4ab0 2023-09-28T04:23:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03e6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03e80c5e30 0x7f03e80af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03e6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03e80c5e30 0x7f03e80af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51252/0 (socket says 172.21.15.118:51252) 2023-09-28T04:23:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03e6ffd700 1 -- 172.21.15.118:0/951782470 learned_addr learned my addr 172.21.15.118:0/951782470 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03e77fe700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03e80c4ab0 0x7f03e80ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03e7fff700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e80ca6c0 0x7f03e8154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03e6ffd700 1 -- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03e80c4ab0 msgr2=0x7f03e80ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03e6ffd700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03e80c4ab0 0x7f03e80ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03e6ffd700 1 -- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e80ca6c0 msgr2=0x7f03e8154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03e6ffd700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e80ca6c0 0x7f03e8154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03e6ffd700 1 -- 172.21.15.118:0/951782470 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e0009a20 con 0x7f03e80c5e30 2023-09-28T04:23:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03e6ffd700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03e80c5e30 0x7f03e80af710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00c580 tx=0x7f03dc007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03cf7fe700 1 -- 172.21.15.118:0/951782470 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc005b30 con 0x7f03e80c5e30 2023-09-28T04:23:36.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03cf7fe700 1 -- 172.21.15.118:0/951782470 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc005cb0 con 0x7f03e80c5e30 2023-09-28T04:23:36.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.865+0000 7f03cf7fe700 1 -- 172.21.15.118:0/951782470 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc007320 con 0x7f03e80c5e30 2023-09-28T04:23:36.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.866+0000 7f03eddff700 1 -- 172.21.15.118:0/951782470 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e81561a0 con 0x7f03e80c5e30 2023-09-28T04:23:36.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.866+0000 7f03eddff700 1 -- 172.21.15.118:0/951782470 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e80aef10 con 0x7f03e80c5e30 2023-09-28T04:23:36.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.867+0000 7f03eddff700 1 -- 172.21.15.118:0/951782470 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e80713a0 con 0x7f03e80c5e30 2023-09-28T04:23:36.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.867+0000 7f03cf7fe700 1 -- 172.21.15.118:0/951782470 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f03dc01b3b0 con 0x7f03e80c5e30 2023-09-28T04:23:36.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.868+0000 7f03cf7fe700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f03d4067330 0x7f03d40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:36.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.868+0000 7f03cf7fe700 1 -- 172.21.15.118:0/951782470 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f03dc083ff0 con 0x7f03e80c5e30 2023-09-28T04:23:36.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.868+0000 7f03e77fe700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f03d4067330 0x7f03d40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:36.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.869+0000 7f03e77fe700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f03d4067330 0x7f03d40697e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03d8003ae0 tx=0x7f03d8007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:36.873 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:36.872+0000 7f03cf7fe700 1 -- 172.21.15.118:0/951782470 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f03dc050eb0 con 0x7f03e80c5e30 2023-09-28T04:23:37.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.107+0000 7f03eddff700 1 -- 172.21.15.118:0/951782470 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03e8071980 con 0x7f03e80c5e30 2023-09-28T04:23:37.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.107+0000 7f03cf7fe700 1 -- 172.21.15.118:0/951782470 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6147 (secure 0 0 0) 0x7f03dc017090 con 0x7f03e80c5e30 2023-09-28T04:23:37.108 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:37.108 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3635601230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3635601230},{"type":"v1","addr":"172.21.15.174:6837","nonce":3635601230}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2662305504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2662305504},{"type":"v1","addr":"172.21.15.174:6839","nonce":2662305504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/524044984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":524044984},{"type":"v1","addr":"172.21.15.118:6833","nonce":524044984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T04:23:18.370081+0000","modified":"2023-09-28T04:23:33.491193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4303,"mds_1":4300,"mds_2":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6836/1739320088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1739320088},{"type":"v1","addr":"172.21.15.174:6836","nonce":1739320088}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4300":{"gid":4300,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6835/2977056141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2977056141},{"type":"v1","addr":"172.21.15.118:6835","nonce":2977056141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4303":{"gid":4303,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6837/233759601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":233759601},{"type":"v1","addr":"172.21.15.118:6837","nonce":233759601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T04:23:37.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.110+0000 7f03eddff700 1 -- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f03d4067330 msgr2=0x7f03d40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:37.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.110+0000 7f03eddff700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f03d4067330 0x7f03d40697e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03d8003ae0 tx=0x7f03d8007d40 comp rx=0 tx=0).stop 2023-09-28T04:23:37.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.110+0000 7f03eddff700 1 -- 172.21.15.118:0/951782470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03e80c5e30 msgr2=0x7f03e80af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:37.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.110+0000 7f03eddff700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03e80c5e30 0x7f03e80af710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00c580 tx=0x7f03dc007e20 comp rx=0 tx=0).stop 2023-09-28T04:23:37.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.110+0000 7f03eddff700 1 -- 172.21.15.118:0/951782470 shutdown_connections 2023-09-28T04:23:37.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.110+0000 7f03eddff700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f03d4067330 0x7f03d40697e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.110+0000 7f03eddff700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03e80ca6c0 0x7f03e8154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.110+0000 7f03eddff700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03e80c4ab0 0x7f03e80ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.110+0000 7f03eddff700 1 --2- 172.21.15.118:0/951782470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03e80c5e30 0x7f03e80af710 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.110+0000 7f03eddff700 1 -- 172.21.15.118:0/951782470 >> 172.21.15.118:0/951782470 conn(0x7f03e8063230 msgr2=0x7f03e8063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:37.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.110+0000 7f03eddff700 1 -- 172.21.15.118:0/951782470 shutdown_connections 2023-09-28T04:23:37.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.110+0000 7f03eddff700 1 -- 172.21.15.118:0/951782470 wait complete. 2023-09-28T04:23:37.112 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 12 2023-09-28T04:23:37.730 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-28T04:23:18.370081+0000', 'modified': '2023-09-28T04:23:33.491193+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4303, 'mds_1': 4300, 'mds_2': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'b', 'rank': 2, 'incarnation': 11, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.174:6836/1739320088', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6834', 'nonce': 1739320088}, {'type': 'v1', 'addr': '172.21.15.174:6836', 'nonce': 1739320088}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4300': {'gid': 4300, 'name': 'e', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.118:6835/2977056141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6834', 'nonce': 2977056141}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 2977056141}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4303': {'gid': 4303, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.118:6837/233759601', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6836', 'nonce': 233759601}, {'type': 'v1', 'addr': '172.21.15.118:6837', 'nonce': 233759601}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-28T04:23:37.730 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-09-28T04:23:37.730 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-28T04:23:37.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.922+0000 7f249bbff700 1 Processor -- start 2023-09-28T04:23:37.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.922+0000 7f249bbff700 1 -- start start 2023-09-28T04:23:37.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.923+0000 7f249bbff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f249414fa90 0x7f2494156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.923+0000 7f249bbff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f249414fe60 0x7f2494068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.923+0000 7f249bbff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24940c84c0 0x7f24940cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.923+0000 7f249bbff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24940c8030 con 0x7f249414fa90 2023-09-28T04:23:37.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.923+0000 7f249bbff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24940c7180 con 0x7f249414fe60 2023-09-28T04:23:37.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.923+0000 7f249bbff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24940c7420 con 0x7f24940c84c0 2023-09-28T04:23:37.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.924+0000 7f249999b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f249414fa90 0x7f2494156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.924+0000 7f249999b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f249414fa90 0x7f2494156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54334/0 (socket says 172.21.15.118:54334) 2023-09-28T04:23:37.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.924+0000 7f249999b700 1 -- 172.21.15.118:0/2471985951 learned_addr learned my addr 172.21.15.118:0/2471985951 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:37.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.924+0000 7f249a19c700 1 --2- 172.21.15.118:0/2471985951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24940c84c0 0x7f24940cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.924+0000 7f249919a700 1 --2- 172.21.15.118:0/2471985951 >> v2:172.21.15.174:3300/0 conn(0x7f249414fe60 0x7f2494068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.925 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.924+0000 7f249999b700 1 -- 172.21.15.118:0/2471985951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24940c84c0 msgr2=0x7f24940cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:37.926 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.924+0000 7f249999b700 1 --2- 172.21.15.118:0/2471985951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24940c84c0 0x7f24940cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.926 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.924+0000 7f249999b700 1 -- 172.21.15.118:0/2471985951 >> v2:172.21.15.174:3300/0 conn(0x7f249414fe60 msgr2=0x7f2494068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:37.926 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.924+0000 7f249999b700 1 --2- 172.21.15.118:0/2471985951 >> v2:172.21.15.174:3300/0 conn(0x7f249414fe60 0x7f2494068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.926 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.924+0000 7f249999b700 1 -- 172.21.15.118:0/2471985951 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24940c7700 con 0x7f249414fa90 2023-09-28T04:23:37.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.924+0000 7f249999b700 1 --2- 172.21.15.118:0/2471985951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f249414fa90 0x7f2494156430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2494070fb0 tx=0x7f2490009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790f2daf42c5c7a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:37.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.925+0000 7f2498999700 1 -- 172.21.15.118:0/2471985951 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000b640 con 0x7f249414fa90 2023-09-28T04:23:37.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.925+0000 7f2498999700 1 -- 172.21.15.118:0/2471985951 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249000b7a0 con 0x7f249414fa90 2023-09-28T04:23:37.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.925+0000 7f2498999700 1 -- 172.21.15.118:0/2471985951 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000bb60 con 0x7f249414fa90 2023-09-28T04:23:37.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.925+0000 7f249bbff700 1 -- 172.21.15.118:0/2471985951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f249414fa90 msgr2=0x7f2494156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:37.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.925+0000 7f249bbff700 1 --2- 172.21.15.118:0/2471985951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f249414fa90 0x7f2494156430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2494070fb0 tx=0x7f2490009250 comp rx=0 tx=0).stop 2023-09-28T04:23:37.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.925+0000 7f249bbff700 1 -- 172.21.15.118:0/2471985951 shutdown_connections 2023-09-28T04:23:37.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.925+0000 7f249bbff700 1 --2- 172.21.15.118:0/2471985951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24940c84c0 0x7f24940cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.925+0000 7f249bbff700 1 --2- 172.21.15.118:0/2471985951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f249414fa90 0x7f2494156430 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.925+0000 7f249bbff700 1 --2- 172.21.15.118:0/2471985951 >> v2:172.21.15.174:3300/0 conn(0x7f249414fe60 0x7f2494068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.925+0000 7f249bbff700 1 -- 172.21.15.118:0/2471985951 >> 172.21.15.118:0/2471985951 conn(0x7f2494063cd0 msgr2=0x7f24940cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:37.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.925+0000 7f249bbff700 1 -- 172.21.15.118:0/2471985951 shutdown_connections 2023-09-28T04:23:37.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.925+0000 7f249bbff700 1 -- 172.21.15.118:0/2471985951 wait complete. 2023-09-28T04:23:37.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.927+0000 7f249bbff700 1 Processor -- start 2023-09-28T04:23:37.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.927+0000 7f249bbff700 1 -- start start 2023-09-28T04:23:37.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.928+0000 7f249bbff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24940c84c0 0x7f249414e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.928+0000 7f249bbff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f249414fa90 0x7f24940bffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.928+0000 7f249bbff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f249414fe60 0x7f24940c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.928+0000 7f249bbff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24940c5a90 con 0x7f249414fa90 2023-09-28T04:23:37.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.928+0000 7f249bbff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24940bfb10 con 0x7f24940c84c0 2023-09-28T04:23:37.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.928+0000 7f249bbff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24940c57f0 con 0x7f249414fe60 2023-09-28T04:23:37.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.928+0000 7f249919a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f249414fa90 0x7f24940bffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.928+0000 7f249999b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24940c84c0 0x7f249414e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.928+0000 7f249919a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f249414fa90 0x7f24940bffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54338/0 (socket says 172.21.15.118:54338) 2023-09-28T04:23:37.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.928+0000 7f249919a700 1 -- 172.21.15.118:0/3554712673 learned_addr learned my addr 172.21.15.118:0/3554712673 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:37.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.928+0000 7f249a19c700 1 --2- 172.21.15.118:0/3554712673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f249414fe60 0x7f24940c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.929+0000 7f249919a700 1 -- 172.21.15.118:0/3554712673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f249414fe60 msgr2=0x7f24940c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:37.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.929+0000 7f249919a700 1 --2- 172.21.15.118:0/3554712673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f249414fe60 0x7f24940c04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.929+0000 7f249919a700 1 -- 172.21.15.118:0/3554712673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24940c84c0 msgr2=0x7f249414e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:37.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.929+0000 7f249919a700 1 --2- 172.21.15.118:0/3554712673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24940c84c0 0x7f249414e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.929+0000 7f249919a700 1 -- 172.21.15.118:0/3554712673 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24900094f0 con 0x7f249414fa90 2023-09-28T04:23:37.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.929+0000 7f249919a700 1 --2- 172.21.15.118:0/3554712673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f249414fa90 0x7f24940bffa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f248400e900 tx=0x7f24840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:37.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.929+0000 7f2489ffb700 1 -- 172.21.15.118:0/3554712673 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484013680 con 0x7f249414fa90 2023-09-28T04:23:37.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.929+0000 7f2489ffb700 1 -- 172.21.15.118:0/3554712673 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24840137e0 con 0x7f249414fa90 2023-09-28T04:23:37.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.929+0000 7f249bbff700 1 -- 172.21.15.118:0/3554712673 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24940c4330 con 0x7f249414fa90 2023-09-28T04:23:37.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.929+0000 7f2489ffb700 1 -- 172.21.15.118:0/3554712673 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484013ba0 con 0x7f249414fa90 2023-09-28T04:23:37.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.929+0000 7f249bbff700 1 -- 172.21.15.118:0/3554712673 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24940c48d0 con 0x7f249414fa90 2023-09-28T04:23:37.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.931+0000 7f2489ffb700 1 -- 172.21.15.118:0/3554712673 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f24840123d0 con 0x7f249414fa90 2023-09-28T04:23:37.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.933+0000 7f2489ffb700 1 --2- 172.21.15.118:0/3554712673 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2478067330 0x7f24780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.933+0000 7f2489ffb700 1 -- 172.21.15.118:0/3554712673 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2484084cc0 con 0x7f249414fa90 2023-09-28T04:23:37.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.933+0000 7f249999b700 1 --2- 172.21.15.118:0/3554712673 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2478067330 0x7f24780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.934+0000 7f249999b700 1 --2- 172.21.15.118:0/3554712673 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2478067330 0x7f24780697e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2494070fb0 tx=0x7f2490017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:37.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.935+0000 7f24aa27ab80 1 Processor -- start 2023-09-28T04:23:37.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.935+0000 7f24aa27ab80 1 -- start start 2023-09-28T04:23:37.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.935+0000 7f24aa27ab80 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3041f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.935+0000 7f24aa27ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 0x55adab307910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.935+0000 7f24aa27ab80 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab307e50 0x55adab33f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f24aa27ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adab21e310 con 0x55adab306b50 2023-09-28T04:23:37.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f24aa27ab80 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adab25b130 con 0x55adab303e20 2023-09-28T04:23:37.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f24aa27ab80 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adab258af0 con 0x55adab307e50 2023-09-28T04:23:37.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f249999b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f249919a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 0x55adab307910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f249999b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3041f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:38140/0 (socket says 172.21.15.118:38140) 2023-09-28T04:23:37.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f249a19c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab307e50 0x55adab33f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f249999b700 1 -- 172.21.15.118:0/3262574342 learned_addr learned my addr 172.21.15.118:0/3262574342 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:37.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f249919a700 1 --2- 172.21.15.118:0/3262574342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 0x55adab307910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54344/0 (socket says 172.21.15.118:54344) 2023-09-28T04:23:37.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f249919a700 1 -- 172.21.15.118:0/3262574342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab307e50 msgr2=0x55adab33f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:37.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f249919a700 1 --2- 172.21.15.118:0/3262574342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab307e50 0x55adab33f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f249919a700 1 -- 172.21.15.118:0/3262574342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 msgr2=0x55adab3041f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:37.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f249919a700 1 --2- 172.21.15.118:0/3262574342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3041f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f249919a700 1 -- 172.21.15.118:0/3262574342 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adab05a790 con 0x55adab306b50 2023-09-28T04:23:37.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.936+0000 7f249919a700 1 --2- 172.21.15.118:0/3262574342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 0x55adab307910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2484083040 tx=0x7f2484082f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c21c6e9aa8dfe9f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:37.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.937+0000 7f247effd700 1 -- 172.21.15.118:0/3262574342 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24840557e0 con 0x55adab306b50 2023-09-28T04:23:37.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.937+0000 7f247effd700 1 -- 172.21.15.118:0/3262574342 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2484058a30 con 0x55adab306b50 2023-09-28T04:23:37.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.937+0000 7f247effd700 1 -- 172.21.15.118:0/3262574342 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248405c780 con 0x55adab306b50 2023-09-28T04:23:37.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.937+0000 7f24aa27ab80 1 -- 172.21.15.118:0/3262574342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 msgr2=0x55adab307910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:37.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.937+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/3262574342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 0x55adab307910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2484083040 tx=0x7f2484082f40 comp rx=0 tx=0).stop 2023-09-28T04:23:37.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.937+0000 7f24aa27ab80 1 -- 172.21.15.118:0/3262574342 shutdown_connections 2023-09-28T04:23:37.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.937+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/3262574342 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab307e50 0x55adab33f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.937+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/3262574342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.937+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/3262574342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 0x55adab307910 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.937+0000 7f24aa27ab80 1 -- 172.21.15.118:0/3262574342 >> 172.21.15.118:0/3262574342 conn(0x55adab302bf0 msgr2=0x55adab3061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:37.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.937+0000 7f24aa27ab80 1 -- 172.21.15.118:0/3262574342 shutdown_connections 2023-09-28T04:23:37.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.937+0000 7f24aa27ab80 1 -- 172.21.15.118:0/3262574342 wait complete. 2023-09-28T04:23:37.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.938+0000 7f24aa27ab80 1 -- start start 2023-09-28T04:23:37.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.938+0000 7f24aa27ab80 1 Processor -- start 2023-09-28T04:23:37.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.939+0000 7f24aa27ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab303e20 0x55adab3490a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.939+0000 7f24aa27ab80 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab306b50 0x55adab333090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.939+0000 7f24aa27ab80 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab307e50 0x55adab346780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.939+0000 7f24aa27ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adab2548e0 con 0x55adab303e20 2023-09-28T04:23:37.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.939+0000 7f24aa27ab80 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adab200980 con 0x55adab307e50 2023-09-28T04:23:37.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.939+0000 7f24aa27ab80 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adab200620 con 0x55adab306b50 2023-09-28T04:23:37.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.939+0000 7f24aa27ab80 10 client.0 _ll_register_callbacks cb 0x55adab063a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T04:23:37.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.939+0000 7f249999b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab303e20 0x55adab3490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.939+0000 7f249919a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab306b50 0x55adab333090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.939+0000 7f249a19c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab307e50 0x55adab346780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.939+0000 7f249a19c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab307e50 0x55adab346780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:38154/0 (socket says 172.21.15.118:38154) 2023-09-28T04:23:37.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f249919a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab306b50 0x55adab333090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:34432/0 (socket says 172.21.15.118:34432) 2023-09-28T04:23:37.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f249999b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab303e20 0x55adab3490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54354/0 (socket says 172.21.15.118:54354) 2023-09-28T04:23:37.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f249a19c700 1 -- 172.21.15.118:0/1251813913 learned_addr learned my addr 172.21.15.118:0/1251813913 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:37.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f249999b700 1 -- 172.21.15.118:0/1251813913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab306b50 msgr2=0x55adab333090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:37.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f249999b700 1 --2- 172.21.15.118:0/1251813913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab306b50 0x55adab333090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f249999b700 1 -- 172.21.15.118:0/1251813913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab307e50 msgr2=0x55adab346780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:37.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f249999b700 1 --2- 172.21.15.118:0/1251813913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab307e50 0x55adab346780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:37.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f249999b700 1 -- 172.21.15.118:0/1251813913 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24940c48d0 con 0x55adab303e20 2023-09-28T04:23:37.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f249a19c700 1 --2- 172.21.15.118:0/1251813913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab307e50 0x55adab346780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:37.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f249999b700 1 --2- 172.21.15.118:0/1251813913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab303e20 0x55adab3490a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f24900094c0 tx=0x7f2490021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d9376bd82755d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:37.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f2473fff700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-09-28T04:23:37.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f2473fff700 1 -- 172.21.15.118:0/1251813913 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249002d040 con 0x55adab303e20 2023-09-28T04:23:37.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f2473fff700 1 -- 172.21.15.118:0/1251813913 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f249001ad70 con 0x55adab303e20 2023-09-28T04:23:37.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.940+0000 7f24aa27ab80 1 -- 172.21.15.118:0/1251813913 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55adab2f8e50 con 0x55adab303e20 2023-09-28T04:23:37.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.941+0000 7f2473fff700 1 -- 172.21.15.118:0/1251813913 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2490021070 con 0x55adab303e20 2023-09-28T04:23:37.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.941+0000 7f24aa27ab80 10 client.4596 fetch_fsmap learned FSMap version 12 2023-09-28T04:23:37.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.941+0000 7f24aa27ab80 1 -- 172.21.15.118:0/1251813913 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x55adab1470a0 con 0x55adab303e20 2023-09-28T04:23:37.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.941+0000 7f2473fff700 1 -- 172.21.15.118:0/1251813913 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55adab2f8e50 con 0x55adab303e20 2023-09-28T04:23:37.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.941+0000 7f2473fff700 1 -- 172.21.15.118:0/1251813913 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 12) v1 ==== 4214+0+0 (secure 0 0 0) 0x7f249003d560 con 0x55adab303e20 2023-09-28T04:23:37.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.941+0000 7f24aa27ab80 10 client.4596 fetch_fsmap finished waiting for FSMap version 12 2023-09-28T04:23:37.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.941+0000 7f24aa27ab80 10 client.4596 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-28T04:23:37.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.941+0000 7f24aa27ab80 20 client.4596 populate_metadata read hostname 'smithi118' 2023-09-28T04:23:37.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.941+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/1251813913 >> [v2:172.21.15.174:6834/1739320088,v1:172.21.15.174:6836/1739320088] conn(0x55adab359170 0x55adab359540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:37.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.941+0000 7f24aa27ab80 4 client.4596 mds_command: new command op to 4279 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-28T04:23:37.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.941+0000 7f24aa27ab80 1 -- 172.21.15.118:0/1251813913 --> [v2:172.21.15.174:6834/1739320088,v1:172.21.15.174:6836/1739320088] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55adab2d5c20 con 0x55adab359170 2023-09-28T04:23:37.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.941+0000 7f249919a700 1 --2- 172.21.15.118:0/1251813913 >> [v2:172.21.15.174:6834/1739320088,v1:172.21.15.174:6836/1739320088] conn(0x55adab359170 0x55adab359540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:37.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.942+0000 7f2473fff700 10 client.4596 ms_handle_connect on v2:172.21.15.174:6834/1739320088 2023-09-28T04:23:37.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:37.942+0000 7f249919a700 1 --2- 172.21.15.118:0/1251813913 >> [v2:172.21.15.174:6834/1739320088,v1:172.21.15.174:6836/1739320088] conn(0x55adab359170 0x55adab359540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=687421751eb23e35 server_cookie=67c1c39525197abe in_seq=0 out_seq=0 2023-09-28T04:23:38.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.499+0000 7f2473fff700 1 -- 172.21.15.118:0/1251813913 <== mds.2 v2:172.21.15.174:6834/1739320088 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55adab2d5c20 con 0x55adab359170 2023-09-28T04:23:38.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.499+0000 7f2473fff700 10 client.4596 handle_command_reply: tid=0 2023-09-28T04:23:38.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.499+0000 7f24aa27ab80 1 client.4596 shutdown 2023-09-28T04:23:38.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.500+0000 7f24aa27ab80 1 -- 172.21.15.118:0/1251813913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab303e20 msgr2=0x55adab3490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.500+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/1251813913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab303e20 0x55adab3490a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f24900094c0 tx=0x7f2490021000 comp rx=0 tx=0).stop 2023-09-28T04:23:38.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.500+0000 7f24aa27ab80 1 -- 172.21.15.118:0/1251813913 shutdown_connections 2023-09-28T04:23:38.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.500+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/1251813913 >> [v2:172.21.15.174:6834/1739320088,v1:172.21.15.174:6836/1739320088] conn(0x55adab359170 0x55adab359540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.500+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/1251813913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab307e50 0x55adab346780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.500+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/1251813913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab303e20 0x55adab3490a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.500+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/1251813913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab306b50 0x55adab333090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.500+0000 7f2473fff700 0 client.4596 ms_handle_reset on v2:172.21.15.174:6834/1739320088 2023-09-28T04:23:38.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.500+0000 7f24aa27ab80 1 -- 172.21.15.118:0/1251813913 >> 172.21.15.118:0/1251813913 conn(0x55adab302bf0 msgr2=0x55adab33b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:38.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.500+0000 7f24aa27ab80 1 -- 172.21.15.118:0/1251813913 shutdown_connections 2023-09-28T04:23:38.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.500+0000 7f24aa27ab80 1 -- 172.21.15.118:0/1251813913 wait complete. 2023-09-28T04:23:38.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.500+0000 7f24aa27ab80 20 client.4596 trim_cache size 0 max 16384 2023-09-28T04:23:38.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.518+0000 7f24aa27ab80 1 Processor -- start 2023-09-28T04:23:38.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.519+0000 7f24aa27ab80 1 -- start start 2023-09-28T04:23:38.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.519+0000 7f24aa27ab80 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3490a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.519+0000 7f24aa27ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 0x55adab3495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.519+0000 7f24aa27ab80 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab307e50 0x55adab342e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.519+0000 7f24aa27ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adab0ec1e0 con 0x55adab306b50 2023-09-28T04:23:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.519+0000 7f24aa27ab80 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adab368ac0 con 0x55adab303e20 2023-09-28T04:23:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.519+0000 7f24aa27ab80 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adab301980 con 0x55adab307e50 2023-09-28T04:23:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.520+0000 7f249919a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 0x55adab3495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.520+0000 7f249919a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 0x55adab3495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54364/0 (socket says 172.21.15.118:54364) 2023-09-28T04:23:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.520+0000 7f249919a700 1 -- 172.21.15.118:0/1560169340 learned_addr learned my addr 172.21.15.118:0/1560169340 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.520+0000 7f249999b700 1 --2- 172.21.15.118:0/1560169340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.520+0000 7f249a19c700 1 --2- 172.21.15.118:0/1560169340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab307e50 0x55adab342e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.520+0000 7f249919a700 1 -- 172.21.15.118:0/1560169340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab307e50 msgr2=0x55adab342e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.520+0000 7f249919a700 1 --2- 172.21.15.118:0/1560169340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab307e50 0x55adab342e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.520+0000 7f249919a700 1 -- 172.21.15.118:0/1560169340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 msgr2=0x55adab3490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.520+0000 7f249919a700 1 --2- 172.21.15.118:0/1560169340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.520+0000 7f249919a700 1 -- 172.21.15.118:0/1560169340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adab2233c0 con 0x55adab306b50 2023-09-28T04:23:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.520+0000 7f249919a700 1 --2- 172.21.15.118:0/1560169340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 0x55adab3495e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2484006b00 tx=0x7f248407f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e5e7a14800626c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.521+0000 7f247f7fe700 1 -- 172.21.15.118:0/1560169340 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484070040 con 0x55adab306b50 2023-09-28T04:23:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.521+0000 7f247f7fe700 1 -- 172.21.15.118:0/1560169340 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248405c780 con 0x55adab306b50 2023-09-28T04:23:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.521+0000 7f247f7fe700 1 -- 172.21.15.118:0/1560169340 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24840557e0 con 0x55adab306b50 2023-09-28T04:23:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.521+0000 7f24aa27ab80 1 -- 172.21.15.118:0/1560169340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 msgr2=0x55adab3495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.521+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/1560169340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 0x55adab3495e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2484006b00 tx=0x7f248407f000 comp rx=0 tx=0).stop 2023-09-28T04:23:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.522+0000 7f24aa27ab80 1 -- 172.21.15.118:0/1560169340 shutdown_connections 2023-09-28T04:23:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.522+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/1560169340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab307e50 0x55adab342e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.522+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/1560169340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.522+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/1560169340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab306b50 0x55adab3495e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.522+0000 7f24aa27ab80 1 -- 172.21.15.118:0/1560169340 >> 172.21.15.118:0/1560169340 conn(0x55adab302bf0 msgr2=0x55adab2fac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.522+0000 7f24aa27ab80 1 -- 172.21.15.118:0/1560169340 shutdown_connections 2023-09-28T04:23:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.522+0000 7f24aa27ab80 1 -- 172.21.15.118:0/1560169340 wait complete. 2023-09-28T04:23:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.522+0000 7f24aa27ab80 1 -- start start 2023-09-28T04:23:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.523+0000 7f24aa27ab80 1 Processor -- start 2023-09-28T04:23:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f24aa27ab80 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f24aa27ab80 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab306b50 0x55adab348040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f24aa27ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab307e50 0x55adab35f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f24aa27ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adab3ab310 con 0x55adab307e50 2023-09-28T04:23:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f24aa27ab80 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adab3aea90 con 0x55adab303e20 2023-09-28T04:23:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f24aa27ab80 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adab336e50 con 0x55adab306b50 2023-09-28T04:23:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f24aa27ab80 10 client.0 _ll_register_callbacks cb 0x7f249000b950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T04:23:38.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f249a19c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab307e50 0x55adab35f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f249a19c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab307e50 0x55adab35f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54372/0 (socket says 172.21.15.118:54372) 2023-09-28T04:23:38.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f249a19c700 1 -- 172.21.15.118:0/3307715567 learned_addr learned my addr 172.21.15.118:0/3307715567 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:38.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f249999b700 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f249919a700 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab306b50 0x55adab348040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f249999b700 1 -- 172.21.15.118:0/3307715567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab306b50 msgr2=0x55adab348040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:38.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f249999b700 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab306b50 0x55adab348040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f249999b700 1 -- 172.21.15.118:0/3307715567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab307e50 msgr2=0x55adab35f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:38.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f249999b700 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab307e50 0x55adab35f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.524+0000 7f249999b700 1 -- 172.21.15.118:0/3307715567 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55adab05a790 con 0x55adab303e20 2023-09-28T04:23:38.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.525+0000 7f249a19c700 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab307e50 0x55adab35f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:38.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.525+0000 7f249999b700 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3aaac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2490009290 tx=0x7f249002e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=459468d40e8c1740 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:38.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.525+0000 7f2473fff700 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2023-09-28T04:23:38.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.525+0000 7f2473fff700 1 -- 172.21.15.118:0/3307715567 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490021070 con 0x55adab303e20 2023-09-28T04:23:38.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.525+0000 7f24aa27ab80 1 -- 172.21.15.118:0/3307715567 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2484058a30 con 0x55adab303e20 2023-09-28T04:23:38.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.525+0000 7f2473fff700 1 -- 172.21.15.118:0/3307715567 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f249003dac0 con 0x55adab303e20 2023-09-28T04:23:38.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.525+0000 7f2473fff700 1 -- 172.21.15.118:0/3307715567 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f249002d040 con 0x55adab303e20 2023-09-28T04:23:38.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.525+0000 7f24aa27ab80 10 client.4738 fetch_fsmap learned FSMap version 12 2023-09-28T04:23:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.525+0000 7f24aa27ab80 1 -- 172.21.15.118:0/3307715567 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x55adab0bb1d0 con 0x55adab303e20 2023-09-28T04:23:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.525+0000 7f2473fff700 1 -- 172.21.15.118:0/3307715567 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2484058a30 con 0x55adab303e20 2023-09-28T04:23:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.526+0000 7f2473fff700 1 -- 172.21.15.118:0/3307715567 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 12) v1 ==== 4214+0+0 (secure 0 0 0) 0x7f249003d460 con 0x55adab303e20 2023-09-28T04:23:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.526+0000 7f24aa27ab80 10 client.4738 fetch_fsmap finished waiting for FSMap version 12 2023-09-28T04:23:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.526+0000 7f24aa27ab80 10 client.4738 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-28T04:23:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.526+0000 7f24aa27ab80 20 client.4738 populate_metadata read hostname 'smithi118' 2023-09-28T04:23:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.526+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.174:6834/1739320088,v1:172.21.15.174:6836/1739320088] conn(0x55adab35ff50 0x55adab3a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.526+0000 7f24aa27ab80 4 client.4738 mds_command: new command op to 4279 tid=0[{"prefix": "status"}] 2023-09-28T04:23:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.526+0000 7f24aa27ab80 1 -- 172.21.15.118:0/3307715567 --> [v2:172.21.15.174:6834/1739320088,v1:172.21.15.174:6836/1739320088] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55adab1f78d0 con 0x55adab35ff50 2023-09-28T04:23:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.526+0000 7f249919a700 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.174:6834/1739320088,v1:172.21.15.174:6836/1739320088] conn(0x55adab35ff50 0x55adab3a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.526+0000 7f249919a700 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.174:6834/1739320088,v1:172.21.15.174:6836/1739320088] conn(0x55adab35ff50 0x55adab3a43a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a18a61a681fb2085 server_cookie=925b4b3b05e551b9 in_seq=0 out_seq=0 2023-09-28T04:23:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.526+0000 7f2473fff700 10 client.4738 ms_handle_connect on v2:172.21.15.174:6834/1739320088 2023-09-28T04:23:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f2473fff700 1 -- 172.21.15.118:0/3307715567 <== mds.2 v2:172.21.15.174:6834/1739320088 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55adab1f78d0 con 0x55adab35ff50 2023-09-28T04:23:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f2473fff700 10 client.4738 handle_command_reply: tid=0 2023-09-28T04:23:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f24aa27ab80 1 client.4738 shutdown 2023-09-28T04:23:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f24aa27ab80 1 -- 172.21.15.118:0/3307715567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 msgr2=0x55adab3aaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3aaac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2490009290 tx=0x7f249002e000 comp rx=0 tx=0).stop 2023-09-28T04:23:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f24aa27ab80 1 -- 172.21.15.118:0/3307715567 shutdown_connections 2023-09-28T04:23:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.174:6834/1739320088,v1:172.21.15.174:6836/1739320088] conn(0x55adab35ff50 0x55adab3a43a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adab307e50 0x55adab35f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55adab303e20 0x55adab3aaac0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f24aa27ab80 1 --2- 172.21.15.118:0/3307715567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55adab306b50 0x55adab348040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f2473fff700 0 client.4738 ms_handle_reset on v2:172.21.15.174:6834/1739320088 2023-09-28T04:23:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f24aa27ab80 1 -- 172.21.15.118:0/3307715567 >> 172.21.15.118:0/3307715567 conn(0x55adab302bf0 msgr2=0x55adab3490a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f24aa27ab80 1 -- 172.21.15.118:0/3307715567 shutdown_connections 2023-09-28T04:23:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f24aa27ab80 1 -- 172.21.15.118:0/3307715567 wait complete. 2023-09-28T04:23:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.527+0000 7f24aa27ab80 20 client.4738 trim_cache size 0 max 16384 2023-09-28T04:23:38.537 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-09-28T04:23:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "aedcea83-ad1a-46d9-8a4a-210ffd422a84", 2023-09-28T04:23:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 2, 2023-09-28T04:23:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4279, 2023-09-28T04:23:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2023-09-28T04:23:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2023-09-28T04:23:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2023-09-28T04:23:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 10.097664401999999, 2023-09-28T04:23:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 12, 2023-09-28T04:23:38.538 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 21, 2023-09-28T04:23:38.539 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 21, 2023-09-28T04:23:38.539 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 25.808025968999999 2023-09-28T04:23:38.539 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-09-28T04:23:38.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.528+0000 7f249bbff700 1 -- 172.21.15.118:0/3554712673 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2478067330 msgr2=0x7f24780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.528+0000 7f249bbff700 1 --2- 172.21.15.118:0/3554712673 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2478067330 0x7f24780697e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2494070fb0 tx=0x7f2490017000 comp rx=0 tx=0).stop 2023-09-28T04:23:38.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.528+0000 7f249bbff700 1 -- 172.21.15.118:0/3554712673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f249414fa90 msgr2=0x7f24940bffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.528+0000 7f249bbff700 1 --2- 172.21.15.118:0/3554712673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f249414fa90 0x7f24940bffa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f248400e900 tx=0x7f24840091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.528+0000 7f249bbff700 1 -- 172.21.15.118:0/3554712673 shutdown_connections 2023-09-28T04:23:38.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.528+0000 7f249bbff700 1 --2- 172.21.15.118:0/3554712673 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2478067330 0x7f24780697e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.528+0000 7f249bbff700 1 --2- 172.21.15.118:0/3554712673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f249414fe60 0x7f24940c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.528+0000 7f249bbff700 1 --2- 172.21.15.118:0/3554712673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24940c84c0 0x7f249414e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.528+0000 7f249bbff700 1 --2- 172.21.15.118:0/3554712673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f249414fa90 0x7f24940bffa0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.528+0000 7f249bbff700 1 -- 172.21.15.118:0/3554712673 >> 172.21.15.118:0/3554712673 conn(0x7f2494063cd0 msgr2=0x7f249414dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:38.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.528+0000 7f249bbff700 1 -- 172.21.15.118:0/3554712673 shutdown_connections 2023-09-28T04:23:38.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.528+0000 7f249bbff700 1 -- 172.21.15.118:0/3554712673 wait complete. 2023-09-28T04:23:38.548 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-09-28T04:23:38.740 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.739+0000 7fb107fff700 1 Processor -- start 2023-09-28T04:23:38.740 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.739+0000 7fb107fff700 1 -- start start 2023-09-28T04:23:38.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.740+0000 7fb107fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10014fe60 0x7fb100156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.740+0000 7fb107fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb1000c84c0 0x7fb100068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.740+0000 7fb107fff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1000c8030 con 0x7fb10014fa90 2023-09-28T04:23:38.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.740+0000 7fb107fff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1000c7180 con 0x7fb1000c84c0 2023-09-28T04:23:38.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.740+0000 7fb107fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1000c7420 con 0x7fb10014fe60 2023-09-28T04:23:38.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.741+0000 7fb105d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb10014fa90 0x7fb1000cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45928/0 (socket says 172.21.15.118:45928) 2023-09-28T04:23:38.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.741+0000 7fb10659c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb1000c84c0 0x7fb100068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.741+0000 7fb105d9b700 1 -- 172.21.15.118:0/554631717 learned_addr learned my addr 172.21.15.118:0/554631717 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:38.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.741+0000 7fb10559a700 1 --2- 172.21.15.118:0/554631717 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10014fe60 0x7fb100156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.741+0000 7fb104d99700 1 -- 172.21.15.118:0/554631717 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201307192 0 0) 0x7fb1000c8030 con 0x7fb10014fa90 2023-09-28T04:23:38.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.741+0000 7fb104d99700 1 -- 172.21.15.118:0/554631717 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0ec003570 con 0x7fb10014fa90 2023-09-28T04:23:38.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.741+0000 7fb10659c700 1 -- 172.21.15.118:0/554631717 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10014fe60 msgr2=0x7fb100156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:38.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.741+0000 7fb10659c700 1 --2- 172.21.15.118:0/554631717 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10014fe60 0x7fb100156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.741+0000 7fb10659c700 1 -- 172.21.15.118:0/554631717 >> v1:172.21.15.118:6789/0 conn(0x7fb10014fa90 legacy=0x7fb1000cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.741+0000 7fb10659c700 1 -- 172.21.15.118:0/554631717 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1000c7700 con 0x7fb1000c84c0 2023-09-28T04:23:38.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.741+0000 7fb10659c700 1 --2- 172.21.15.118:0/554631717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1000c84c0 0x7fb100068b90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009e60 tx=0x7fb0f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f000e5a5d86d51 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:38.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.742+0000 7fb104d99700 1 -- 172.21.15.118:0/554631717 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800e070 con 0x7fb1000c84c0 2023-09-28T04:23:38.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.742+0000 7fb104d99700 1 -- 172.21.15.118:0/554631717 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f800bab0 con 0x7fb1000c84c0 2023-09-28T04:23:38.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.742+0000 7fb104d99700 1 -- 172.21.15.118:0/554631717 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800be70 con 0x7fb1000c84c0 2023-09-28T04:23:38.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.742+0000 7fb107fff700 1 -- 172.21.15.118:0/554631717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1000c84c0 msgr2=0x7fb100068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.742+0000 7fb107fff700 1 --2- 172.21.15.118:0/554631717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1000c84c0 0x7fb100068b90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009e60 tx=0x7fb0f8009780 comp rx=0 tx=0).stop 2023-09-28T04:23:38.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.742+0000 7fb107fff700 1 -- 172.21.15.118:0/554631717 shutdown_connections 2023-09-28T04:23:38.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.742+0000 7fb107fff700 1 --2- 172.21.15.118:0/554631717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1000c84c0 0x7fb100068b90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.742+0000 7fb107fff700 1 --2- 172.21.15.118:0/554631717 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10014fe60 0x7fb100156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.742+0000 7fb107fff700 1 -- 172.21.15.118:0/554631717 >> 172.21.15.118:0/554631717 conn(0x7fb100063cd0 msgr2=0x7fb1000cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:38.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.742+0000 7fb107fff700 1 -- 172.21.15.118:0/554631717 shutdown_connections 2023-09-28T04:23:38.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.742+0000 7fb107fff700 1 -- 172.21.15.118:0/554631717 wait complete. 2023-09-28T04:23:38.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.744+0000 7fb107fff700 1 Processor -- start 2023-09-28T04:23:38.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.744+0000 7fb107fff700 1 -- start start 2023-09-28T04:23:38.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb107fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1000c84c0 0x7fb10015b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb107fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10014fa90 0x7fb1001542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb107fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb10014fe60 0x7fb100154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb107fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1000cb560 con 0x7fb1000c84c0 2023-09-28T04:23:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb107fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1000cbb20 con 0x7fb10014fe60 2023-09-28T04:23:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb107fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1000bf760 con 0x7fb10014fa90 2023-09-28T04:23:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb105d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1000c84c0 0x7fb10015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb105d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1000c84c0 0x7fb10015b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54386/0 (socket says 172.21.15.118:54386) 2023-09-28T04:23:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb105d9b700 1 -- 172.21.15.118:0/4118631813 learned_addr learned my addr 172.21.15.118:0/4118631813 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb10559a700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10014fa90 0x7fb1001542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb10659c700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb10014fe60 0x7fb100154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb105d9b700 1 -- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10014fa90 msgr2=0x7fb1001542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb105d9b700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10014fa90 0x7fb1001542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb105d9b700 1 -- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb10014fe60 msgr2=0x7fb100154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb105d9b700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb10014fe60 0x7fb100154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb105d9b700 1 -- 172.21.15.118:0/4118631813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f8009a20 con 0x7fb1000c84c0 2023-09-28T04:23:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.745+0000 7fb10659c700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb10014fe60 0x7fb100154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.746+0000 7fb105d9b700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1000c84c0 0x7fb10015b640 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00c5c0 tx=0x7fb0fc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.746+0000 7fb0f5ffb700 1 -- 172.21.15.118:0/4118631813 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc005b30 con 0x7fb1000c84c0 2023-09-28T04:23:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.746+0000 7fb0f5ffb700 1 -- 172.21.15.118:0/4118631813 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc005c90 con 0x7fb1000c84c0 2023-09-28T04:23:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.746+0000 7fb0f5ffb700 1 -- 172.21.15.118:0/4118631813 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc007300 con 0x7fb1000c84c0 2023-09-28T04:23:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.746+0000 7fb107fff700 1 -- 172.21.15.118:0/4118631813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb100169bd0 con 0x7fb1000c84c0 2023-09-28T04:23:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.746+0000 7fb107fff700 1 -- 172.21.15.118:0/4118631813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1000ca200 con 0x7fb1000c84c0 2023-09-28T04:23:38.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.748+0000 7fb0f5ffb700 1 -- 172.21.15.118:0/4118631813 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb0fc01b3b0 con 0x7fb1000c84c0 2023-09-28T04:23:38.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.749+0000 7fb0f5ffb700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb0e4067330 0x7fb0e40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.749+0000 7fb0f5ffb700 1 -- 172.21.15.118:0/4118631813 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb0fc083ff0 con 0x7fb1000c84c0 2023-09-28T04:23:38.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.750+0000 7fb10559a700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb0e4067330 0x7fb0e40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.750+0000 7fb10559a700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb0e4067330 0x7fb0e40697e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1000cbee0 tx=0x7fb0f00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:38.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.751+0000 7fb1166afb80 1 Processor -- start 2023-09-28T04:23:38.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.751+0000 7fb1166afb80 1 -- start start 2023-09-28T04:23:38.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.752+0000 7fb1166afb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd8fcb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.752+0000 7fb1166afb80 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 0x560dd8fce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.752+0000 7fb1166afb80 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcee50 0x560dd9006570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.752+0000 7fb1166afb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dd8ee5310 con 0x560dd8fcae20 2023-09-28T04:23:38.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.752+0000 7fb1166afb80 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dd8f22130 con 0x560dd8fcee50 2023-09-28T04:23:38.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.752+0000 7fb1166afb80 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x560dd8f1faf0 con 0x560dd8fcdb50 2023-09-28T04:23:38.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb105d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd8fcb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb10659c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcee50 0x560dd9006570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb10559a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 0x560dd8fce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb10559a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 0x560dd8fce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:34464/0 (socket says 172.21.15.118:34464) 2023-09-28T04:23:38.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb10659c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcee50 0x560dd9006570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:38192/0 (socket says 172.21.15.118:38192) 2023-09-28T04:23:38.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb10659c700 1 -- 172.21.15.118:0/688357560 learned_addr learned my addr 172.21.15.118:0/688357560 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:38.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb105d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd8fcb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54390/0 (socket says 172.21.15.118:54390) 2023-09-28T04:23:38.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb105d9b700 1 -- 172.21.15.118:0/688357560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 msgr2=0x560dd8fce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:38.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb105d9b700 1 --2- 172.21.15.118:0/688357560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 0x560dd8fce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb105d9b700 1 -- 172.21.15.118:0/688357560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcee50 msgr2=0x560dd9006570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:38.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb105d9b700 1 --2- 172.21.15.118:0/688357560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcee50 0x560dd9006570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb105d9b700 1 -- 172.21.15.118:0/688357560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dd8d21790 con 0x560dd8fcae20 2023-09-28T04:23:38.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb10659c700 1 --2- 172.21.15.118:0/688357560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcee50 0x560dd9006570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:38.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb105d9b700 1 --2- 172.21.15.118:0/688357560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd8fcb1f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00cc60 tx=0x7fb0fc0822d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106b8a36c6d06b65 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:38.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb0e2ffd700 1 -- 172.21.15.118:0/688357560 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc054b70 con 0x560dd8fcae20 2023-09-28T04:23:38.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb0e2ffd700 1 -- 172.21.15.118:0/688357560 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc057dc0 con 0x560dd8fcae20 2023-09-28T04:23:38.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.753+0000 7fb0e2ffd700 1 -- 172.21.15.118:0/688357560 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc05bb10 con 0x560dd8fcae20 2023-09-28T04:23:38.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.754+0000 7fb1166afb80 1 -- 172.21.15.118:0/688357560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 msgr2=0x560dd8fcb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.754+0000 7fb1166afb80 1 --2- 172.21.15.118:0/688357560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd8fcb1f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00cc60 tx=0x7fb0fc0822d0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.754+0000 7fb1166afb80 1 -- 172.21.15.118:0/688357560 shutdown_connections 2023-09-28T04:23:38.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.754+0000 7fb1166afb80 1 --2- 172.21.15.118:0/688357560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcee50 0x560dd9006570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.754+0000 7fb1166afb80 1 --2- 172.21.15.118:0/688357560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd8fcb1f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.754+0000 7fb1166afb80 1 --2- 172.21.15.118:0/688357560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 0x560dd8fce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.754+0000 7fb1166afb80 1 -- 172.21.15.118:0/688357560 >> 172.21.15.118:0/688357560 conn(0x560dd8fc9bf0 msgr2=0x560dd8fcd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:38.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.754+0000 7fb1166afb80 1 -- 172.21.15.118:0/688357560 shutdown_connections 2023-09-28T04:23:38.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.754+0000 7fb1166afb80 1 -- 172.21.15.118:0/688357560 wait complete. 2023-09-28T04:23:38.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.755+0000 7fb1166afb80 1 -- start start 2023-09-28T04:23:38.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.755+0000 7fb1166afb80 1 Processor -- start 2023-09-28T04:23:38.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb1166afb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd90210f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb1166afb80 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcdb50 0x560dd90102c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb1166afb80 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcee50 0x560dd8ff6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb1166afb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dd8f1b8e0 con 0x560dd8fcae20 2023-09-28T04:23:38.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb1166afb80 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dd8ec7980 con 0x560dd8fcdb50 2023-09-28T04:23:38.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb1166afb80 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x560dd8ec7620 con 0x560dd8fcee50 2023-09-28T04:23:38.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb1166afb80 10 client.0 _ll_register_callbacks cb 0x560dd8d2aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T04:23:38.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb105d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd90210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb105d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd90210f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54396/0 (socket says 172.21.15.118:54396) 2023-09-28T04:23:38.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb105d9b700 1 -- 172.21.15.118:0/3002131190 learned_addr learned my addr 172.21.15.118:0/3002131190 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:38.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb10559a700 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcdb50 0x560dd90102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb10659c700 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcee50 0x560dd8ff6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb105d9b700 1 -- 172.21.15.118:0/3002131190 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcee50 msgr2=0x560dd8ff6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:38.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb105d9b700 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcee50 0x560dd8ff6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb105d9b700 1 -- 172.21.15.118:0/3002131190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcdb50 msgr2=0x560dd90102c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:38.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb105d9b700 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcdb50 0x560dd90102c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.756+0000 7fb105d9b700 1 -- 172.21.15.118:0/3002131190 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1000c7700 con 0x560dd8fcae20 2023-09-28T04:23:38.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb10659c700 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcee50 0x560dd8ff6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T04:23:38.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb10559a700 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcdb50 0x560dd90102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T04:23:38.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb105d9b700 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd90210f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc054b00 tx=0x7fb0fc07d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9ca5ab9a12baec server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:38.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb0dbfff700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-09-28T04:23:38.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb0dbfff700 1 -- 172.21.15.118:0/3002131190 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc005e00 con 0x560dd8fcae20 2023-09-28T04:23:38.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb0dbfff700 1 -- 172.21.15.118:0/3002131190 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb0fc06c030 con 0x560dd8fcae20 2023-09-28T04:23:38.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb1166afb80 1 -- 172.21.15.118:0/3002131190 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560dd8fbfe50 con 0x560dd8fcae20 2023-09-28T04:23:38.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb0dbfff700 1 -- 172.21.15.118:0/3002131190 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0fc05b680 con 0x560dd8fcae20 2023-09-28T04:23:38.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb1166afb80 10 client.4617 fetch_fsmap learned FSMap version 12 2023-09-28T04:23:38.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb1166afb80 1 -- 172.21.15.118:0/3002131190 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x7fb1000ca200 con 0x560dd8fcae20 2023-09-28T04:23:38.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb0dbfff700 1 -- 172.21.15.118:0/3002131190 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560dd8fbfe50 con 0x560dd8fcae20 2023-09-28T04:23:38.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb0dbfff700 1 -- 172.21.15.118:0/3002131190 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 12) v1 ==== 4214+0+0 (secure 0 0 0) 0x7fb0fc055b80 con 0x560dd8fcae20 2023-09-28T04:23:38.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb1166afb80 10 client.4617 fetch_fsmap finished waiting for FSMap version 12 2023-09-28T04:23:38.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb1166afb80 10 client.4617 resolve_mds: resolved name 'e' to daemon mds.e 2023-09-28T04:23:38.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb1166afb80 20 client.4617 populate_metadata read hostname 'smithi118' 2023-09-28T04:23:38.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb1166afb80 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.118:6834/2977056141,v1:172.21.15.118:6835/2977056141] conn(0x560dd901e4a0 0x560dd901e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb1166afb80 4 client.4617 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-28T04:23:38.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.757+0000 7fb1166afb80 1 -- 172.21.15.118:0/3002131190 --> [v2:172.21.15.118:6834/2977056141,v1:172.21.15.118:6835/2977056141] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560dd8f9cc20 con 0x560dd901e4a0 2023-09-28T04:23:38.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.758+0000 7fb10559a700 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.118:6834/2977056141,v1:172.21.15.118:6835/2977056141] conn(0x560dd901e4a0 0x560dd901e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.758+0000 7fb0dbfff700 10 client.4617 ms_handle_connect on v2:172.21.15.118:6834/2977056141 2023-09-28T04:23:38.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.758+0000 7fb10559a700 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.118:6834/2977056141,v1:172.21.15.118:6835/2977056141] conn(0x560dd901e4a0 0x560dd901e870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cdfd24f9151b7ec2 server_cookie=992b7075011cc97a in_seq=0 out_seq=0 2023-09-28T04:23:38.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.759+0000 7fb0dbfff700 1 -- 172.21.15.118:0/3002131190 <== mds.1 v2:172.21.15.118:6834/2977056141 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560dd8f9cc20 con 0x560dd901e4a0 2023-09-28T04:23:38.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.759+0000 7fb0dbfff700 10 client.4617 handle_command_reply: tid=0 2023-09-28T04:23:38.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.759+0000 7fb1166afb80 1 client.4617 shutdown 2023-09-28T04:23:38.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.759+0000 7fb1166afb80 1 -- 172.21.15.118:0/3002131190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 msgr2=0x560dd90210f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.759+0000 7fb1166afb80 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd90210f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc054b00 tx=0x7fb0fc07d000 comp rx=0 tx=0).stop 2023-09-28T04:23:38.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.759+0000 7fb1166afb80 1 -- 172.21.15.118:0/3002131190 shutdown_connections 2023-09-28T04:23:38.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.759+0000 7fb1166afb80 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcee50 0x560dd8ff6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.759+0000 7fb1166afb80 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd90210f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.759+0000 7fb1166afb80 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.118:6834/2977056141,v1:172.21.15.118:6835/2977056141] conn(0x560dd901e4a0 0x560dd901e870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.759+0000 7fb1166afb80 1 --2- 172.21.15.118:0/3002131190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcdb50 0x560dd90102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.759+0000 7fb0dbfff700 0 client.4617 ms_handle_reset on v2:172.21.15.118:6834/2977056141 2023-09-28T04:23:38.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.759+0000 7fb1166afb80 1 -- 172.21.15.118:0/3002131190 >> 172.21.15.118:0/3002131190 conn(0x560dd8fc9bf0 msgr2=0x560dd8fcd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:38.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.759+0000 7fb1166afb80 1 -- 172.21.15.118:0/3002131190 shutdown_connections 2023-09-28T04:23:38.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.760+0000 7fb1166afb80 1 -- 172.21.15.118:0/3002131190 wait complete. 2023-09-28T04:23:38.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.760+0000 7fb1166afb80 20 client.4617 trim_cache size 0 max 16384 2023-09-28T04:23:38.777 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.777+0000 7fb1166afb80 1 Processor -- start 2023-09-28T04:23:38.777 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.777+0000 7fb1166afb80 1 -- start start 2023-09-28T04:23:38.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.778+0000 7fb1166afb80 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcae20 0x560dd9005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.778+0000 7fb1166afb80 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 0x560dd8fcb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.778+0000 7fb1166afb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcee50 0x560dd900b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.778+0000 7fb1166afb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dd8db31e0 con 0x560dd8fcee50 2023-09-28T04:23:38.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.778+0000 7fb1166afb80 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dd9002460 con 0x560dd8fcae20 2023-09-28T04:23:38.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.778+0000 7fb1166afb80 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x560dd900ced0 con 0x560dd8fcdb50 2023-09-28T04:23:38.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.778+0000 7fb10659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcee50 0x560dd900b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.778+0000 7fb10659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcee50 0x560dd900b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54410/0 (socket says 172.21.15.118:54410) 2023-09-28T04:23:38.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.778+0000 7fb10659c700 1 -- 172.21.15.118:0/3870777557 learned_addr learned my addr 172.21.15.118:0/3870777557 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:38.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.778+0000 7fb10559a700 1 --2- 172.21.15.118:0/3870777557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 0x560dd8fcb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.778+0000 7fb105d9b700 1 --2- 172.21.15.118:0/3870777557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcae20 0x560dd9005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.778+0000 7fb10659c700 1 -- 172.21.15.118:0/3870777557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 msgr2=0x560dd8fcb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:38.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.778+0000 7fb10659c700 1 --2- 172.21.15.118:0/3870777557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 0x560dd8fcb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.779+0000 7fb10659c700 1 -- 172.21.15.118:0/3870777557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcae20 msgr2=0x560dd9005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:38.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.779+0000 7fb10659c700 1 --2- 172.21.15.118:0/3870777557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcae20 0x560dd9005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.779+0000 7fb10659c700 1 -- 172.21.15.118:0/3870777557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dd8e0e0a0 con 0x560dd8fcee50 2023-09-28T04:23:38.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.779+0000 7fb10659c700 1 --2- 172.21.15.118:0/3870777557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcee50 0x560dd900b370 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb100064880 tx=0x7fb0f8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861d23bfadbc398 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:38.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.779+0000 7fb0e37fe700 1 -- 172.21.15.118:0/3870777557 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8012640 con 0x560dd8fcee50 2023-09-28T04:23:38.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.779+0000 7fb0e37fe700 1 -- 172.21.15.118:0/3870777557 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f8023040 con 0x560dd8fcee50 2023-09-28T04:23:38.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.779+0000 7fb0e37fe700 1 -- 172.21.15.118:0/3870777557 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8012a10 con 0x560dd8fcee50 2023-09-28T04:23:38.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.780+0000 7fb1166afb80 1 -- 172.21.15.118:0/3870777557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcee50 msgr2=0x560dd900b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.780+0000 7fb1166afb80 1 --2- 172.21.15.118:0/3870777557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcee50 0x560dd900b370 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb100064880 tx=0x7fb0f8019000 comp rx=0 tx=0).stop 2023-09-28T04:23:38.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.780+0000 7fb1166afb80 1 -- 172.21.15.118:0/3870777557 shutdown_connections 2023-09-28T04:23:38.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.780+0000 7fb1166afb80 1 --2- 172.21.15.118:0/3870777557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcee50 0x560dd900b370 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.780+0000 7fb1166afb80 1 --2- 172.21.15.118:0/3870777557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcae20 0x560dd9005040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.780+0000 7fb1166afb80 1 --2- 172.21.15.118:0/3870777557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 0x560dd8fcb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.780+0000 7fb1166afb80 1 -- 172.21.15.118:0/3870777557 >> 172.21.15.118:0/3870777557 conn(0x560dd8fc9bf0 msgr2=0x560dd8fcd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:38.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.780+0000 7fb1166afb80 1 -- 172.21.15.118:0/3870777557 shutdown_connections 2023-09-28T04:23:38.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.780+0000 7fb1166afb80 1 -- 172.21.15.118:0/3870777557 wait complete. 2023-09-28T04:23:38.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.780+0000 7fb1166afb80 1 -- start start 2023-09-28T04:23:38.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.781+0000 7fb1166afb80 1 Processor -- start 2023-09-28T04:23:38.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.781+0000 7fb1166afb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd906c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.781+0000 7fb1166afb80 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 0x560dd8fcbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.781+0000 7fb1166afb80 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcee50 0x560dd8fcc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.781+0000 7fb1166afb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dd901fc00 con 0x560dd8fcae20 2023-09-28T04:23:38.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.781+0000 7fb1166afb80 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dd906cdd0 con 0x560dd8fcee50 2023-09-28T04:23:38.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.781+0000 7fb1166afb80 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x560dd9072d50 con 0x560dd8fcdb50 2023-09-28T04:23:38.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb1166afb80 10 client.0 _ll_register_callbacks cb 0x560dd8d2aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T04:23:38.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb105d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd906c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb105d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd906c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54424/0 (socket says 172.21.15.118:54424) 2023-09-28T04:23:38.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb105d9b700 1 -- 172.21.15.118:0/171513734 learned_addr learned my addr 172.21.15.118:0/171513734 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:38.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb10659c700 1 --2- 172.21.15.118:0/171513734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcee50 0x560dd8fcc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb10559a700 1 --2- 172.21.15.118:0/171513734 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 0x560dd8fcbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb105d9b700 1 -- 172.21.15.118:0/171513734 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 msgr2=0x560dd8fcbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb105d9b700 1 --2- 172.21.15.118:0/171513734 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 0x560dd8fcbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb105d9b700 1 -- 172.21.15.118:0/171513734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcee50 msgr2=0x560dd8fcc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb105d9b700 1 --2- 172.21.15.118:0/171513734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcee50 0x560dd8fcc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb105d9b700 1 -- 172.21.15.118:0/171513734 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f800bdb0 con 0x560dd8fcae20 2023-09-28T04:23:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb105d9b700 1 --2- 172.21.15.118:0/171513734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd906c890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc007dd0 tx=0x7fb0fc082000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec24d52d1bbf6a5e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb0dbfff700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-09-28T04:23:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb0dbfff700 1 -- 172.21.15.118:0/171513734 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc054940 con 0x560dd8fcae20 2023-09-28T04:23:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb0dbfff700 1 -- 172.21.15.118:0/171513734 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb0fc06c040 con 0x560dd8fcae20 2023-09-28T04:23:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.782+0000 7fb1166afb80 1 -- 172.21.15.118:0/171513734 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb0fc057dc0 con 0x560dd8fcae20 2023-09-28T04:23:38.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.783+0000 7fb0dbfff700 1 -- 172.21.15.118:0/171513734 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0fc05bb10 con 0x560dd8fcae20 2023-09-28T04:23:38.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.783+0000 7fb1166afb80 10 client.4623 fetch_fsmap learned FSMap version 12 2023-09-28T04:23:38.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.783+0000 7fb1166afb80 1 -- 172.21.15.118:0/171513734 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x560dd8eea3c0 con 0x560dd8fcae20 2023-09-28T04:23:38.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.783+0000 7fb0dbfff700 1 -- 172.21.15.118:0/171513734 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc057dc0 con 0x560dd8fcae20 2023-09-28T04:23:38.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.783+0000 7fb0dbfff700 1 -- 172.21.15.118:0/171513734 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 12) v1 ==== 4214+0+0 (secure 0 0 0) 0x7fb0fc058b00 con 0x560dd8fcae20 2023-09-28T04:23:38.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.783+0000 7fb1166afb80 10 client.4623 fetch_fsmap finished waiting for FSMap version 12 2023-09-28T04:23:38.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.783+0000 7fb1166afb80 10 client.4623 resolve_mds: resolved name 'e' to daemon mds.e 2023-09-28T04:23:38.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.783+0000 7fb1166afb80 20 client.4623 populate_metadata read hostname 'smithi118' 2023-09-28T04:23:38.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.783+0000 7fb1166afb80 1 --2- 172.21.15.118:0/171513734 >> [v2:172.21.15.118:6834/2977056141,v1:172.21.15.118:6835/2977056141] conn(0x560dd90725e0 0x560dd9000c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.783+0000 7fb1166afb80 4 client.4623 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2023-09-28T04:23:38.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.783+0000 7fb1166afb80 1 -- 172.21.15.118:0/171513734 --> [v2:172.21.15.118:6834/2977056141,v1:172.21.15.118:6835/2977056141] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560dd8ebe8d0 con 0x560dd90725e0 2023-09-28T04:23:38.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.783+0000 7fb10559a700 1 --2- 172.21.15.118:0/171513734 >> [v2:172.21.15.118:6834/2977056141,v1:172.21.15.118:6835/2977056141] conn(0x560dd90725e0 0x560dd9000c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb10559a700 1 --2- 172.21.15.118:0/171513734 >> [v2:172.21.15.118:6834/2977056141,v1:172.21.15.118:6835/2977056141] conn(0x560dd90725e0 0x560dd9000c50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=12539a7a143769b7 server_cookie=cf432b69c8a52fbb in_seq=0 out_seq=0 2023-09-28T04:23:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb0dbfff700 10 client.4623 ms_handle_connect on v2:172.21.15.118:6834/2977056141 2023-09-28T04:23:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb0dbfff700 1 -- 172.21.15.118:0/171513734 <== mds.1 v2:172.21.15.118:6834/2977056141 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x560dd8ebe8d0 con 0x560dd90725e0 2023-09-28T04:23:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb0dbfff700 10 client.4623 handle_command_reply: tid=0 2023-09-28T04:23:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb1166afb80 1 client.4623 shutdown 2023-09-28T04:23:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb1166afb80 1 -- 172.21.15.118:0/171513734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 msgr2=0x560dd906c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb1166afb80 1 --2- 172.21.15.118:0/171513734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd906c890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc007dd0 tx=0x7fb0fc082000 comp rx=0 tx=0).stop 2023-09-28T04:23:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb1166afb80 1 -- 172.21.15.118:0/171513734 shutdown_connections 2023-09-28T04:23:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb1166afb80 1 --2- 172.21.15.118:0/171513734 >> [v2:172.21.15.118:6834/2977056141,v1:172.21.15.118:6835/2977056141] conn(0x560dd90725e0 0x560dd9000c50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb1166afb80 1 --2- 172.21.15.118:0/171513734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560dd8fcee50 0x560dd8fcc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb1166afb80 1 --2- 172.21.15.118:0/171513734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560dd8fcae20 0x560dd906c890 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb1166afb80 1 --2- 172.21.15.118:0/171513734 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x560dd8fcdb50 0x560dd8fcbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb0dbfff700 0 client.4623 ms_handle_reset on v2:172.21.15.118:6834/2977056141 2023-09-28T04:23:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb1166afb80 1 -- 172.21.15.118:0/171513734 >> 172.21.15.118:0/171513734 conn(0x560dd8fc9bf0 msgr2=0x560dd900c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb1166afb80 1 -- 172.21.15.118:0/171513734 shutdown_connections 2023-09-28T04:23:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb1166afb80 1 -- 172.21.15.118:0/171513734 wait complete. 2023-09-28T04:23:38.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.784+0000 7fb1166afb80 20 client.4623 trim_cache size 0 max 16384 2023-09-28T04:23:38.791 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-09-28T04:23:38.791 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "aedcea83-ad1a-46d9-8a4a-210ffd422a84", 2023-09-28T04:23:38.791 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 1, 2023-09-28T04:23:38.791 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4300, 2023-09-28T04:23:38.792 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2023-09-28T04:23:38.792 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2023-09-28T04:23:38.792 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2023-09-28T04:23:38.792 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 15.384461389, 2023-09-28T04:23:38.792 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 12, 2023-09-28T04:23:38.792 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 21, 2023-09-28T04:23:38.792 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 21, 2023-09-28T04:23:38.792 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 25.976086697 2023-09-28T04:23:38.792 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-09-28T04:23:38.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.785+0000 7fb107fff700 1 -- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb0e4067330 msgr2=0x7fb0e40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.785+0000 7fb107fff700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb0e4067330 0x7fb0e40697e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1000cbee0 tx=0x7fb0f00091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.785+0000 7fb107fff700 1 -- 172.21.15.118:0/4118631813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1000c84c0 msgr2=0x7fb10015b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.785+0000 7fb107fff700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1000c84c0 0x7fb10015b640 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00c5c0 tx=0x7fb0fc007e00 comp rx=0 tx=0).stop 2023-09-28T04:23:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.785+0000 7fb107fff700 1 -- 172.21.15.118:0/4118631813 shutdown_connections 2023-09-28T04:23:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.785+0000 7fb107fff700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb0e4067330 0x7fb0e40697e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.785+0000 7fb107fff700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb10014fe60 0x7fb100154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.785+0000 7fb107fff700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1000c84c0 0x7fb10015b640 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.785+0000 7fb107fff700 1 --2- 172.21.15.118:0/4118631813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb10014fa90 0x7fb1001542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.785+0000 7fb107fff700 1 -- 172.21.15.118:0/4118631813 >> 172.21.15.118:0/4118631813 conn(0x7fb100063cd0 msgr2=0x7fb10014a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.785+0000 7fb107fff700 1 -- 172.21.15.118:0/4118631813 shutdown_connections 2023-09-28T04:23:38.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.785+0000 7fb107fff700 1 -- 172.21.15.118:0/4118631813 wait complete. 2023-09-28T04:23:38.802 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-28T04:23:38.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.993+0000 7efdfa7ff700 1 Processor -- start 2023-09-28T04:23:38.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.993+0000 7efdfa7ff700 1 -- start start 2023-09-28T04:23:38.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.994+0000 7efdfa7ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efdf40ae320 0x7efdf4156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:38.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.994+0000 7efdfa7ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf40c8030 con 0x7efdf414fa90 2023-09-28T04:23:38.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.994+0000 7efdfa7ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf40c7180 con 0x7efdf414fe60 2023-09-28T04:23:38.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.994+0000 7efdfa7ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40c7420 con 0x7efdf40ae320 2023-09-28T04:23:38.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.994+0000 7efdf3fff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7efdf414fa90 0x7efdf40cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45934/0 (socket says 172.21.15.118:45934) 2023-09-28T04:23:38.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.994+0000 7efdf3fff700 1 -- 172.21.15.118:0/2504443167 learned_addr learned my addr 172.21.15.118:0/2504443167 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:38.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.994+0000 7efdf8d9c700 1 --2- 172.21.15.118:0/2504443167 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efdf40ae320 0x7efdf4156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:38.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.994+0000 7efdf2ffd700 1 -- 172.21.15.118:0/2504443167 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564254440 0 0) 0x7efdf40c8030 con 0x7efdf414fa90 2023-09-28T04:23:38.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.995+0000 7efdf2ffd700 1 -- 172.21.15.118:0/2504443167 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efddc003570 con 0x7efdf414fa90 2023-09-28T04:23:38.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.995+0000 7efdf2ffd700 1 -- 172.21.15.118:0/2504443167 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845671780 0 0) 0x7efdf40c7180 con 0x7efdf414fe60 2023-09-28T04:23:38.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.995+0000 7efdf2ffd700 1 -- 172.21.15.118:0/2504443167 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf40c8030 con 0x7efdf414fe60 2023-09-28T04:23:38.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.995+0000 7efdf8d9c700 1 -- 172.21.15.118:0/2504443167 >> v1:172.21.15.174:6789/0 conn(0x7efdf414fe60 legacy=0x7efdf40adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.995+0000 7efdf8d9c700 1 -- 172.21.15.118:0/2504443167 >> v1:172.21.15.118:6789/0 conn(0x7efdf414fa90 legacy=0x7efdf40cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.995+0000 7efdf8d9c700 1 -- 172.21.15.118:0/2504443167 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf40c7700 con 0x7efdf40ae320 2023-09-28T04:23:38.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.995+0000 7efdf8d9c700 1 --2- 172.21.15.118:0/2504443167 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efdf40ae320 0x7efdf4156430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efdec009e90 tx=0x7efdec009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b42366ffaff38bf8 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:38.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.995+0000 7efdf2ffd700 1 -- 172.21.15.118:0/2504443167 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00e070 con 0x7efdf40ae320 2023-09-28T04:23:38.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.995+0000 7efdf2ffd700 1 -- 172.21.15.118:0/2504443167 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec00bb80 con 0x7efdf40ae320 2023-09-28T04:23:38.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.995+0000 7efdf2ffd700 1 -- 172.21.15.118:0/2504443167 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec012430 con 0x7efdf40ae320 2023-09-28T04:23:38.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.996+0000 7efdfa7ff700 1 -- 172.21.15.118:0/2504443167 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efdf40ae320 msgr2=0x7efdf4156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:38.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.996+0000 7efdfa7ff700 1 --2- 172.21.15.118:0/2504443167 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efdf40ae320 0x7efdf4156430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efdec009e90 tx=0x7efdec009780 comp rx=0 tx=0).stop 2023-09-28T04:23:38.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.996+0000 7efdfa7ff700 1 -- 172.21.15.118:0/2504443167 shutdown_connections 2023-09-28T04:23:38.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.996+0000 7efdfa7ff700 1 --2- 172.21.15.118:0/2504443167 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efdf40ae320 0x7efdf4156430 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:38.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.996+0000 7efdfa7ff700 1 -- 172.21.15.118:0/2504443167 >> 172.21.15.118:0/2504443167 conn(0x7efdf4063cd0 msgr2=0x7efdf40cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:38.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.996+0000 7efdfa7ff700 1 -- 172.21.15.118:0/2504443167 shutdown_connections 2023-09-28T04:23:38.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.996+0000 7efdfa7ff700 1 -- 172.21.15.118:0/2504443167 wait complete. 2023-09-28T04:23:38.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.998+0000 7efdfa7ff700 1 Processor -- start 2023-09-28T04:23:38.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.998+0000 7efdfa7ff700 1 -- start start 2023-09-28T04:23:39.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.999+0000 7efdfa7ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdf40ae320 0x7efdf41668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.999+0000 7efdfa7ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf414fa90 0x7efdf4151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.999+0000 7efdfa7ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efdf414fe60 0x7efdf41591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.999+0000 7efdfa7ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf41508e0 con 0x7efdf40ae320 2023-09-28T04:23:39.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.999+0000 7efdfa7ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4151ec0 con 0x7efdf414fa90 2023-09-28T04:23:39.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:38.999+0000 7efdfa7ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf41514f0 con 0x7efdf414fe60 2023-09-28T04:23:39.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.000+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdf40ae320 0x7efdf41668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.000+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdf40ae320 0x7efdf41668d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54438/0 (socket says 172.21.15.118:54438) 2023-09-28T04:23:39.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.000+0000 7efdf3fff700 1 -- 172.21.15.118:0/3407095503 learned_addr learned my addr 172.21.15.118:0/3407095503 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:39.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.000+0000 7efdf37fe700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf414fa90 0x7efdf4151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.000+0000 7efdf8d9c700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efdf414fe60 0x7efdf41591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.000+0000 7efdf3fff700 1 -- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efdf414fe60 msgr2=0x7efdf41591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.000+0000 7efdf3fff700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efdf414fe60 0x7efdf41591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.000+0000 7efdf3fff700 1 -- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf414fa90 msgr2=0x7efdf4151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.000+0000 7efdf3fff700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf414fa90 0x7efdf4151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.000+0000 7efdf3fff700 1 -- 172.21.15.118:0/3407095503 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec009a20 con 0x7efdf40ae320 2023-09-28T04:23:39.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.000+0000 7efdf3fff700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdf40ae320 0x7efdf41668d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efde400c7c0 tx=0x7efde4007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:39.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.000+0000 7efddbfff700 1 -- 172.21.15.118:0/3407095503 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4005b30 con 0x7efdf40ae320 2023-09-28T04:23:39.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.001+0000 7efddbfff700 1 -- 172.21.15.118:0/3407095503 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde4005cd0 con 0x7efdf40ae320 2023-09-28T04:23:39.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.001+0000 7efdfa7ff700 1 -- 172.21.15.118:0/3407095503 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf4150340 con 0x7efdf40ae320 2023-09-28T04:23:39.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.001+0000 7efddbfff700 1 -- 172.21.15.118:0/3407095503 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4007320 con 0x7efdf40ae320 2023-09-28T04:23:39.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.001+0000 7efdfa7ff700 1 -- 172.21.15.118:0/3407095503 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf4150ea0 con 0x7efdf40ae320 2023-09-28T04:23:39.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.003+0000 7efddbfff700 1 -- 172.21.15.118:0/3407095503 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efde4012400 con 0x7efdf40ae320 2023-09-28T04:23:39.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.004+0000 7efddbfff700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7efde0067330 0x7efde00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.004+0000 7efddbfff700 1 -- 172.21.15.118:0/3407095503 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efde4083ff0 con 0x7efdf40ae320 2023-09-28T04:23:39.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.005+0000 7efdf37fe700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7efde0067330 0x7efde00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.005+0000 7efdf37fe700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7efde0067330 0x7efde00697e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efdf414d960 tx=0x7efde8007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:39.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.006+0000 7efe08e41b80 1 Processor -- start 2023-09-28T04:23:39.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.006+0000 7efe08e41b80 1 -- start start 2023-09-28T04:23:39.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.007+0000 7efe08e41b80 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b4e20 0x561b047b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.007+0000 7efe08e41b80 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 0x561b047b8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.007+0000 7efe08e41b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b8e50 0x561b047f0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.007+0000 7efe08e41b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b046cf310 con 0x561b047b8e50 2023-09-28T04:23:39.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.007+0000 7efe08e41b80 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0470c130 con 0x561b047b4e20 2023-09-28T04:23:39.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.008+0000 7efe08e41b80 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b04709af0 con 0x561b047b7b50 2023-09-28T04:23:39.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.008+0000 7efdf8d9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b8e50 0x561b047f0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.008+0000 7efdf8d9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b8e50 0x561b047f0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54450/0 (socket says 172.21.15.118:54450) 2023-09-28T04:23:39.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.008+0000 7efdf8d9c700 1 -- 172.21.15.118:0/2323619332 learned_addr learned my addr 172.21.15.118:0/2323619332 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:39.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.008+0000 7efdf3fff700 1 --2- 172.21.15.118:0/2323619332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b4e20 0x561b047b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.008+0000 7efdf37fe700 1 --2- 172.21.15.118:0/2323619332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 0x561b047b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.008+0000 7efdf8d9c700 1 -- 172.21.15.118:0/2323619332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 msgr2=0x561b047b8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:39.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.008+0000 7efdf8d9c700 1 --2- 172.21.15.118:0/2323619332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 0x561b047b8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.008+0000 7efdf8d9c700 1 -- 172.21.15.118:0/2323619332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b4e20 msgr2=0x561b047b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:39.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.008+0000 7efdf8d9c700 1 --2- 172.21.15.118:0/2323619332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b4e20 0x561b047b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.008+0000 7efdf8d9c700 1 -- 172.21.15.118:0/2323619332 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b0450b790 con 0x561b047b8e50 2023-09-28T04:23:39.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.008+0000 7efdf3fff700 1 --2- 172.21.15.118:0/2323619332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b4e20 0x561b047b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:39.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.008+0000 7efdf8d9c700 1 --2- 172.21.15.118:0/2323619332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b8e50 0x561b047f0570 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efdec013000 tx=0x7efdec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c057b8f67d04aee4 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:39.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.009+0000 7efdd97fa700 1 -- 172.21.15.118:0/2323619332 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec022070 con 0x561b047b8e50 2023-09-28T04:23:39.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.009+0000 7efdd97fa700 1 -- 172.21.15.118:0/2323619332 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec00bcf0 con 0x561b047b8e50 2023-09-28T04:23:39.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.009+0000 7efdd97fa700 1 -- 172.21.15.118:0/2323619332 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec012a40 con 0x561b047b8e50 2023-09-28T04:23:39.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.009+0000 7efe08e41b80 1 -- 172.21.15.118:0/2323619332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b8e50 msgr2=0x561b047f0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.009+0000 7efe08e41b80 1 --2- 172.21.15.118:0/2323619332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b8e50 0x561b047f0570 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efdec013000 tx=0x7efdec019000 comp rx=0 tx=0).stop 2023-09-28T04:23:39.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.009+0000 7efe08e41b80 1 -- 172.21.15.118:0/2323619332 shutdown_connections 2023-09-28T04:23:39.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.009+0000 7efe08e41b80 1 --2- 172.21.15.118:0/2323619332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b8e50 0x561b047f0570 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.009+0000 7efe08e41b80 1 --2- 172.21.15.118:0/2323619332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b4e20 0x561b047b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.009+0000 7efe08e41b80 1 --2- 172.21.15.118:0/2323619332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 0x561b047b8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.009+0000 7efe08e41b80 1 -- 172.21.15.118:0/2323619332 >> 172.21.15.118:0/2323619332 conn(0x561b047b3bf0 msgr2=0x561b047b71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:39.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.009+0000 7efe08e41b80 1 -- 172.21.15.118:0/2323619332 shutdown_connections 2023-09-28T04:23:39.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.009+0000 7efe08e41b80 1 -- 172.21.15.118:0/2323619332 wait complete. 2023-09-28T04:23:39.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.010+0000 7efe08e41b80 1 -- start start 2023-09-28T04:23:39.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.010+0000 7efe08e41b80 1 Processor -- start 2023-09-28T04:23:39.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.011+0000 7efe08e41b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 0x561b047f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.011+0000 7efe08e41b80 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 0x561b0480a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.011+0000 7efe08e41b80 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 0x561b0480ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.011+0000 7efe08e41b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b047058e0 con 0x561b047b4e20 2023-09-28T04:23:39.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.011+0000 7efe08e41b80 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b046b1980 con 0x561b047b8e50 2023-09-28T04:23:39.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.011+0000 7efe08e41b80 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b046b1620 con 0x561b047b7b50 2023-09-28T04:23:39.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.011+0000 7efe08e41b80 10 client.0 _ll_register_callbacks cb 0x561b04514a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T04:23:39.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 0x561b047f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 0x561b047f7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54458/0 (socket says 172.21.15.118:54458) 2023-09-28T04:23:39.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdf3fff700 1 -- 172.21.15.118:0/3083772283 learned_addr learned my addr 172.21.15.118:0/3083772283 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:39.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdf37fe700 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 0x561b0480a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdf8d9c700 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 0x561b0480ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdf3fff700 1 -- 172.21.15.118:0/3083772283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 msgr2=0x561b0480a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:39.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdf3fff700 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 0x561b0480a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdf3fff700 1 -- 172.21.15.118:0/3083772283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 msgr2=0x561b0480ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:39.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdf3fff700 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 0x561b0480ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdf3fff700 1 -- 172.21.15.118:0/3083772283 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf40c7700 con 0x561b047b4e20 2023-09-28T04:23:39.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdf8d9c700 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 0x561b0480ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:39.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdf3fff700 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 0x561b047f7ac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efde4001400 tx=0x7efde40822b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a081c6f84e571d84 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:39.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdd27fc700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-09-28T04:23:39.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdd27fc700 1 -- 172.21.15.118:0/3083772283 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde405baf0 con 0x561b047b4e20 2023-09-28T04:23:39.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efdd27fc700 1 -- 172.21.15.118:0/3083772283 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efde4052fa0 con 0x561b047b4e20 2023-09-28T04:23:39.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.012+0000 7efe08e41b80 1 -- 172.21.15.118:0/3083772283 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b047a9e50 con 0x561b047b4e20 2023-09-28T04:23:39.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.013+0000 7efdd27fc700 1 -- 172.21.15.118:0/3083772283 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7efde405b870 con 0x561b047b4e20 2023-09-28T04:23:39.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.013+0000 7efe08e41b80 10 client.4635 fetch_fsmap learned FSMap version 12 2023-09-28T04:23:39.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.013+0000 7efe08e41b80 1 -- 172.21.15.118:0/3083772283 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x561b045f80a0 con 0x561b047b4e20 2023-09-28T04:23:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.013+0000 7efdd27fc700 1 -- 172.21.15.118:0/3083772283 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b047a9e50 con 0x561b047b4e20 2023-09-28T04:23:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.013+0000 7efdd27fc700 1 -- 172.21.15.118:0/3083772283 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 12) v1 ==== 4214+0+0 (secure 0 0 0) 0x7efde4055b60 con 0x561b047b4e20 2023-09-28T04:23:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.013+0000 7efe08e41b80 10 client.4635 fetch_fsmap finished waiting for FSMap version 12 2023-09-28T04:23:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.013+0000 7efe08e41b80 10 client.4635 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-28T04:23:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.013+0000 7efe08e41b80 20 client.4635 populate_metadata read hostname 'smithi118' 2023-09-28T04:23:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.013+0000 7efe08e41b80 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.118:6836/233759601,v1:172.21.15.118:6837/233759601] conn(0x561b047f52b0 0x561b047ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.013+0000 7efe08e41b80 4 client.4635 mds_command: new command op to 4303 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-28T04:23:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.013+0000 7efe08e41b80 1 -- 172.21.15.118:0/3083772283 --> [v2:172.21.15.118:6836/233759601,v1:172.21.15.118:6837/233759601] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b04786c20 con 0x561b047f52b0 2023-09-28T04:23:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.013+0000 7efdf37fe700 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.118:6836/233759601,v1:172.21.15.118:6837/233759601] conn(0x561b047f52b0 0x561b047ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.014+0000 7efdf37fe700 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.118:6836/233759601,v1:172.21.15.118:6837/233759601] conn(0x561b047f52b0 0x561b047ecdb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47c879df5651a7b0 server_cookie=6e017c858f28082c in_seq=0 out_seq=0 2023-09-28T04:23:39.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.014+0000 7efdd27fc700 10 client.4635 ms_handle_connect on v2:172.21.15.118:6836/233759601 2023-09-28T04:23:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.014+0000 7efdd27fc700 1 -- 172.21.15.118:0/3083772283 <== mds.0 v2:172.21.15.118:6836/233759601 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561b04786c20 con 0x561b047f52b0 2023-09-28T04:23:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.014+0000 7efdd27fc700 10 client.4635 handle_command_reply: tid=0 2023-09-28T04:23:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.015+0000 7efe08e41b80 1 client.4635 shutdown 2023-09-28T04:23:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.015+0000 7efe08e41b80 1 -- 172.21.15.118:0/3083772283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 msgr2=0x561b047f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.015+0000 7efe08e41b80 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 0x561b047f7ac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efde4001400 tx=0x7efde40822b0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.015+0000 7efe08e41b80 1 -- 172.21.15.118:0/3083772283 shutdown_connections 2023-09-28T04:23:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.015+0000 7efe08e41b80 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.118:6836/233759601,v1:172.21.15.118:6837/233759601] conn(0x561b047f52b0 0x561b047ecdb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.015+0000 7efe08e41b80 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 0x561b0480ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.015+0000 7efe08e41b80 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 0x561b047f7ac0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.015+0000 7efe08e41b80 1 --2- 172.21.15.118:0/3083772283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 0x561b0480a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.015+0000 7efdd27fc700 0 client.4635 ms_handle_reset on v2:172.21.15.118:6836/233759601 2023-09-28T04:23:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.015+0000 7efe08e41b80 1 -- 172.21.15.118:0/3083772283 >> 172.21.15.118:0/3083772283 conn(0x561b047b3bf0 msgr2=0x561b047b71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:39.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.015+0000 7efe08e41b80 1 -- 172.21.15.118:0/3083772283 shutdown_connections 2023-09-28T04:23:39.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.015+0000 7efe08e41b80 1 -- 172.21.15.118:0/3083772283 wait complete. 2023-09-28T04:23:39.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.015+0000 7efe08e41b80 20 client.4635 trim_cache size 0 max 16384 2023-09-28T04:23:39.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.032+0000 7efe08e41b80 1 Processor -- start 2023-09-28T04:23:39.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.032+0000 7efe08e41b80 1 -- start start 2023-09-28T04:23:39.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efe08e41b80 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b4e20 0x561b047b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efe08e41b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b7b50 0x561b047f6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efe08e41b80 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 0x561b047f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efe08e41b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0459d1e0 con 0x561b047b7b50 2023-09-28T04:23:39.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efe08e41b80 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b047efa40 con 0x561b047b8e50 2023-09-28T04:23:39.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efe08e41b80 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b047ad790 con 0x561b047b4e20 2023-09-28T04:23:39.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efdf37fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b7b50 0x561b047f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efdf37fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b7b50 0x561b047f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54462/0 (socket says 172.21.15.118:54462) 2023-09-28T04:23:39.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efdf37fe700 1 -- 172.21.15.118:0/2588817782 learned_addr learned my addr 172.21.15.118:0/2588817782 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:39.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efdf3fff700 1 --2- 172.21.15.118:0/2588817782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b4e20 0x561b047b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efdf8d9c700 1 --2- 172.21.15.118:0/2588817782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 0x561b047f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efdf37fe700 1 -- 172.21.15.118:0/2588817782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b4e20 msgr2=0x561b047b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:39.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efdf37fe700 1 --2- 172.21.15.118:0/2588817782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b4e20 0x561b047b13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efdf37fe700 1 -- 172.21.15.118:0/2588817782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 msgr2=0x561b047f6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:39.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efdf37fe700 1 --2- 172.21.15.118:0/2588817782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 0x561b047f6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.033+0000 7efdf37fe700 1 -- 172.21.15.118:0/2588817782 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b046d43c0 con 0x561b047b7b50 2023-09-28T04:23:39.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.034+0000 7efdf37fe700 1 --2- 172.21.15.118:0/2588817782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b7b50 0x561b047f6630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efde8007fd0 tx=0x7efde8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6770893efcc49b8f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:39.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.034+0000 7efdd9ffb700 1 -- 172.21.15.118:0/2588817782 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8027660 con 0x561b047b7b50 2023-09-28T04:23:39.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.034+0000 7efdd9ffb700 1 -- 172.21.15.118:0/2588817782 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde80277c0 con 0x561b047b7b50 2023-09-28T04:23:39.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.034+0000 7efdd9ffb700 1 -- 172.21.15.118:0/2588817782 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8027b40 con 0x561b047b7b50 2023-09-28T04:23:39.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.034+0000 7efe08e41b80 1 -- 172.21.15.118:0/2588817782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b7b50 msgr2=0x561b047f6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.034+0000 7efe08e41b80 1 --2- 172.21.15.118:0/2588817782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b7b50 0x561b047f6630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efde8007fd0 tx=0x7efde8014000 comp rx=0 tx=0).stop 2023-09-28T04:23:39.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.035+0000 7efe08e41b80 1 -- 172.21.15.118:0/2588817782 shutdown_connections 2023-09-28T04:23:39.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.035+0000 7efe08e41b80 1 --2- 172.21.15.118:0/2588817782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 0x561b047f6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.035+0000 7efe08e41b80 1 --2- 172.21.15.118:0/2588817782 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b4e20 0x561b047b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.035+0000 7efe08e41b80 1 --2- 172.21.15.118:0/2588817782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b7b50 0x561b047f6630 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.035+0000 7efe08e41b80 1 -- 172.21.15.118:0/2588817782 >> 172.21.15.118:0/2588817782 conn(0x561b047b3bf0 msgr2=0x561b047f7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:39.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.035+0000 7efe08e41b80 1 -- 172.21.15.118:0/2588817782 shutdown_connections 2023-09-28T04:23:39.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.035+0000 7efe08e41b80 1 -- 172.21.15.118:0/2588817782 wait complete. 2023-09-28T04:23:39.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.035+0000 7efe08e41b80 1 -- start start 2023-09-28T04:23:39.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.035+0000 7efe08e41b80 1 Processor -- start 2023-09-28T04:23:39.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.036+0000 7efe08e41b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 0x561b047e1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.036+0000 7efe08e41b80 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 0x561b047b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.036+0000 7efe08e41b80 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 0x561b04855d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.036+0000 7efe08e41b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b047f0f30 con 0x561b047b4e20 2023-09-28T04:23:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.036+0000 7efe08e41b80 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b047e1760 con 0x561b047b8e50 2023-09-28T04:23:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.036+0000 7efe08e41b80 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b0485c0e0 con 0x561b047b7b50 2023-09-28T04:23:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.036+0000 7efe08e41b80 10 client.0 _ll_register_callbacks cb 0x561b04514a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T04:23:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 0x561b047e1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 0x561b047e1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54470/0 (socket says 172.21.15.118:54470) 2023-09-28T04:23:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdf3fff700 1 -- 172.21.15.118:0/536699123 learned_addr learned my addr 172.21.15.118:0/536699123 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdf37fe700 1 --2- 172.21.15.118:0/536699123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 0x561b047b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdf8d9c700 1 --2- 172.21.15.118:0/536699123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 0x561b04855d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdf3fff700 1 -- 172.21.15.118:0/536699123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 msgr2=0x561b047b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdf3fff700 1 --2- 172.21.15.118:0/536699123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 0x561b047b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdf3fff700 1 -- 172.21.15.118:0/536699123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 msgr2=0x561b04855d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:39.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdf3fff700 1 --2- 172.21.15.118:0/536699123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 0x561b04855d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdf3fff700 1 -- 172.21.15.118:0/536699123 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde8019040 con 0x561b047b4e20 2023-09-28T04:23:39.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdf3fff700 1 --2- 172.21.15.118:0/536699123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 0x561b047e1bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efde4051100 tx=0x7efde4081000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e308d061255100 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:39.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdd27fc700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-09-28T04:23:39.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdd27fc700 1 -- 172.21.15.118:0/536699123 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde400e040 con 0x561b047b4e20 2023-09-28T04:23:39.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efdd27fc700 1 -- 172.21.15.118:0/536699123 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efde405baf0 con 0x561b047b4e20 2023-09-28T04:23:39.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.037+0000 7efe08e41b80 1 -- 172.21.15.118:0/536699123 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efdec00bcf0 con 0x561b047b4e20 2023-09-28T04:23:39.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.038+0000 7efdd27fc700 1 -- 172.21.15.118:0/536699123 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7efde40549d0 con 0x561b047b4e20 2023-09-28T04:23:39.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.038+0000 7efe08e41b80 10 client.4641 fetch_fsmap learned FSMap version 12 2023-09-28T04:23:39.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.038+0000 7efe08e41b80 1 -- 172.21.15.118:0/536699123 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x561b0456c1d0 con 0x561b047b4e20 2023-09-28T04:23:39.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.038+0000 7efdd27fc700 1 -- 172.21.15.118:0/536699123 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec00bcf0 con 0x561b047b4e20 2023-09-28T04:23:39.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.038+0000 7efdd27fc700 1 -- 172.21.15.118:0/536699123 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 12) v1 ==== 4214+0+0 (secure 0 0 0) 0x7efde4064050 con 0x561b047b4e20 2023-09-28T04:23:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.038+0000 7efe08e41b80 10 client.4641 fetch_fsmap finished waiting for FSMap version 12 2023-09-28T04:23:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.038+0000 7efe08e41b80 10 client.4641 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-28T04:23:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.038+0000 7efe08e41b80 20 client.4641 populate_metadata read hostname 'smithi118' 2023-09-28T04:23:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.038+0000 7efe08e41b80 1 --2- 172.21.15.118:0/536699123 >> [v2:172.21.15.118:6836/233759601,v1:172.21.15.118:6837/233759601] conn(0x561b04856590 0x561b0485f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.038+0000 7efe08e41b80 4 client.4641 mds_command: new command op to 4303 tid=0[{"prefix": "status"}] 2023-09-28T04:23:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.038+0000 7efe08e41b80 1 -- 172.21.15.118:0/536699123 --> [v2:172.21.15.118:6836/233759601,v1:172.21.15.118:6837/233759601] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561b046a88d0 con 0x561b04856590 2023-09-28T04:23:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.038+0000 7efdf37fe700 1 --2- 172.21.15.118:0/536699123 >> [v2:172.21.15.118:6836/233759601,v1:172.21.15.118:6837/233759601] conn(0x561b04856590 0x561b0485f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efdf37fe700 1 --2- 172.21.15.118:0/536699123 >> [v2:172.21.15.118:6836/233759601,v1:172.21.15.118:6837/233759601] conn(0x561b04856590 0x561b0485f6b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=697b00986ee07a9 server_cookie=5744e7587c4e8932 in_seq=0 out_seq=0 2023-09-28T04:23:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efdd27fc700 10 client.4641 ms_handle_connect on v2:172.21.15.118:6836/233759601 2023-09-28T04:23:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efdd27fc700 1 -- 172.21.15.118:0/536699123 <== mds.0 v2:172.21.15.118:6836/233759601 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x561b046a88d0 con 0x561b04856590 2023-09-28T04:23:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efdd27fc700 10 client.4641 handle_command_reply: tid=0 2023-09-28T04:23:39.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efe08e41b80 1 client.4641 shutdown 2023-09-28T04:23:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efe08e41b80 1 -- 172.21.15.118:0/536699123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 msgr2=0x561b047e1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efe08e41b80 1 --2- 172.21.15.118:0/536699123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 0x561b047e1bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efde4051100 tx=0x7efde4081000 comp rx=0 tx=0).stop 2023-09-28T04:23:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efe08e41b80 1 -- 172.21.15.118:0/536699123 shutdown_connections 2023-09-28T04:23:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efe08e41b80 1 --2- 172.21.15.118:0/536699123 >> [v2:172.21.15.118:6836/233759601,v1:172.21.15.118:6837/233759601] conn(0x561b04856590 0x561b0485f6b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efe08e41b80 1 --2- 172.21.15.118:0/536699123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b047b8e50 0x561b04855d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efe08e41b80 1 --2- 172.21.15.118:0/536699123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b047b4e20 0x561b047e1bf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efe08e41b80 1 --2- 172.21.15.118:0/536699123 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561b047b7b50 0x561b047b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efdd27fc700 0 client.4641 ms_handle_reset on v2:172.21.15.118:6836/233759601 2023-09-28T04:23:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efe08e41b80 1 -- 172.21.15.118:0/536699123 >> 172.21.15.118:0/536699123 conn(0x561b047b3bf0 msgr2=0x561b047f7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efe08e41b80 1 -- 172.21.15.118:0/536699123 shutdown_connections 2023-09-28T04:23:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.039+0000 7efe08e41b80 1 -- 172.21.15.118:0/536699123 wait complete. 2023-09-28T04:23:39.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.040+0000 7efe08e41b80 20 client.4641 trim_cache size 0 max 16384 2023-09-28T04:23:39.046 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-09-28T04:23:39.046 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "aedcea83-ad1a-46d9-8a4a-210ffd422a84", 2023-09-28T04:23:39.046 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2023-09-28T04:23:39.046 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4303, 2023-09-28T04:23:39.046 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2023-09-28T04:23:39.046 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2023-09-28T04:23:39.046 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2023-09-28T04:23:39.047 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 20.667176570999999, 2023-09-28T04:23:39.047 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 12, 2023-09-28T04:23:39.047 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 21, 2023-09-28T04:23:39.047 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 21, 2023-09-28T04:23:39.047 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 26.225077524 2023-09-28T04:23:39.047 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-09-28T04:23:39.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.040+0000 7efdfa7ff700 1 -- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7efde0067330 msgr2=0x7efde00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.040+0000 7efdfa7ff700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7efde0067330 0x7efde00697e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efdf414d960 tx=0x7efde8007d50 comp rx=0 tx=0).stop 2023-09-28T04:23:39.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.040+0000 7efdfa7ff700 1 -- 172.21.15.118:0/3407095503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdf40ae320 msgr2=0x7efdf41668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.040+0000 7efdfa7ff700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdf40ae320 0x7efdf41668d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efde400c7c0 tx=0x7efde4007e80 comp rx=0 tx=0).stop 2023-09-28T04:23:39.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.040+0000 7efdfa7ff700 1 -- 172.21.15.118:0/3407095503 shutdown_connections 2023-09-28T04:23:39.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.040+0000 7efdfa7ff700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7efde0067330 0x7efde00697e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.040+0000 7efdfa7ff700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efdf414fe60 0x7efdf41591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.040+0000 7efdfa7ff700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdf40ae320 0x7efdf41668d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.040+0000 7efdfa7ff700 1 --2- 172.21.15.118:0/3407095503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf414fa90 0x7efdf4151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.040+0000 7efdfa7ff700 1 -- 172.21.15.118:0/3407095503 >> 172.21.15.118:0/3407095503 conn(0x7efdf4063cd0 msgr2=0x7efdf414ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:39.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.040+0000 7efdfa7ff700 1 -- 172.21.15.118:0/3407095503 shutdown_connections 2023-09-28T04:23:39.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.040+0000 7efdfa7ff700 1 -- 172.21.15.118:0/3407095503 wait complete. 2023-09-28T04:23:39.057 INFO:teuthology.run_tasks:Running task kclient... 2023-09-28T04:23:39.078 INFO:tasks.kclient:Mounting kernel clients... 2023-09-28T04:23:39.078 INFO:tasks.kclient:config is {'client.0': {}} 2023-09-28T04:23:39.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T04:23:39.078 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-09-28T04:23:39.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T04:23:39.125 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2023-09-28T04:23:39.237 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2023-09-28T04:23:39.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T04:23:39.240 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-09-28T04:23:39.241 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-28T04:23:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.428+0000 7efcc9bff700 1 Processor -- start 2023-09-28T04:23:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.428+0000 7efcc9bff700 1 -- start start 2023-09-28T04:23:39.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.430+0000 7efcc9bff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efcc4152370 0x7efcc40c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.430+0000 7efcc9bff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc40c3450 con 0x7efcc414c6a0 2023-09-28T04:23:39.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.430+0000 7efcc9bff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc414ca70 con 0x7efcc40c0ca0 2023-09-28T04:23:39.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.430+0000 7efcc9bff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc40bfbb0 con 0x7efcc4152370 2023-09-28T04:23:39.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.430+0000 7efcc37fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7efcc414c6a0 0x7efcc40c0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45950/0 (socket says 172.21.15.118:45950) 2023-09-28T04:23:39.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.430+0000 7efcc37fe700 1 -- 172.21.15.118:0/530019511 learned_addr learned my addr 172.21.15.118:0/530019511 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:39.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.430+0000 7efcc3fff700 1 --2- 172.21.15.118:0/530019511 >> v2:172.21.15.118:3300/0 conn(0x7efcc4152370 0x7efcc40c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.432 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.430+0000 7efcc27fc700 1 -- 172.21.15.118:0/530019511 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879252367 0 0) 0x7efcc414ca70 con 0x7efcc40c0ca0 2023-09-28T04:23:39.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.430+0000 7efcc27fc700 1 -- 172.21.15.118:0/530019511 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcac003570 con 0x7efcc40c0ca0 2023-09-28T04:23:39.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.430+0000 7efcc27fc700 1 -- 172.21.15.118:0/530019511 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607757423 0 0) 0x7efcc40c3450 con 0x7efcc414c6a0 2023-09-28T04:23:39.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.430+0000 7efcc3fff700 1 -- 172.21.15.118:0/530019511 >> v1:172.21.15.174:6789/0 conn(0x7efcc40c0ca0 legacy=0x7efcc40c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.430+0000 7efcc3fff700 1 -- 172.21.15.118:0/530019511 >> v1:172.21.15.118:6789/0 conn(0x7efcc414c6a0 legacy=0x7efcc40c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.430+0000 7efcc3fff700 1 -- 172.21.15.118:0/530019511 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc40c2560 con 0x7efcc4152370 2023-09-28T04:23:39.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.431+0000 7efcc3fff700 1 --2- 172.21.15.118:0/530019511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc4152370 0x7efcc40c4a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009e60 tx=0x7efcbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f366c91df4d4c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:39.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.431+0000 7efcc27fc700 1 -- 172.21.15.118:0/530019511 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc00bb60 con 0x7efcc4152370 2023-09-28T04:23:39.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.431+0000 7efcc27fc700 1 -- 172.21.15.118:0/530019511 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc00bcc0 con 0x7efcc4152370 2023-09-28T04:23:39.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.431+0000 7efcc27fc700 1 -- 172.21.15.118:0/530019511 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc011460 con 0x7efcc4152370 2023-09-28T04:23:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.431+0000 7efcc9bff700 1 -- 172.21.15.118:0/530019511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc4152370 msgr2=0x7efcc40c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.431+0000 7efcc9bff700 1 --2- 172.21.15.118:0/530019511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc4152370 0x7efcc40c4a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009e60 tx=0x7efcbc009780 comp rx=0 tx=0).stop 2023-09-28T04:23:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.431+0000 7efcc9bff700 1 -- 172.21.15.118:0/530019511 shutdown_connections 2023-09-28T04:23:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.431+0000 7efcc9bff700 1 --2- 172.21.15.118:0/530019511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc4152370 0x7efcc40c4a20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.431+0000 7efcc9bff700 1 -- 172.21.15.118:0/530019511 >> 172.21.15.118:0/530019511 conn(0x7efcc4067630 msgr2=0x7efcc4067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.432+0000 7efcc9bff700 1 -- 172.21.15.118:0/530019511 shutdown_connections 2023-09-28T04:23:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.432+0000 7efcc9bff700 1 -- 172.21.15.118:0/530019511 wait complete. 2023-09-28T04:23:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.433+0000 7efcc9bff700 1 Processor -- start 2023-09-28T04:23:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.433+0000 7efcc9bff700 1 -- start start 2023-09-28T04:23:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.434+0000 7efcc9bff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcc40c0ca0 0x7efcc41584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.434+0000 7efcc9bff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc414c6a0 0x7efcc4149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.434+0000 7efcc9bff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcc4152370 0x7efcc414a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.434+0000 7efcc9bff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc4150260 con 0x7efcc414c6a0 2023-09-28T04:23:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.434+0000 7efcc9bff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc4150f20 con 0x7efcc4152370 2023-09-28T04:23:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.434+0000 7efcc9bff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc4157ac0 con 0x7efcc40c0ca0 2023-09-28T04:23:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.434+0000 7efcc2ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc414c6a0 0x7efcc4149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.434+0000 7efcc2ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc414c6a0 0x7efcc4149cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54492/0 (socket says 172.21.15.118:54492) 2023-09-28T04:23:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.434+0000 7efcc2ffd700 1 -- 172.21.15.118:0/1554874274 learned_addr learned my addr 172.21.15.118:0/1554874274 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.434+0000 7efcc3fff700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcc4152370 0x7efcc414a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.434+0000 7efcc37fe700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcc40c0ca0 0x7efcc41584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.435+0000 7efcc3fff700 1 -- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcc40c0ca0 msgr2=0x7efcc41584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.435+0000 7efcc3fff700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcc40c0ca0 0x7efcc41584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.435+0000 7efcc3fff700 1 -- 172.21.15.118:0/1554874274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc414c6a0 msgr2=0x7efcc4149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.435+0000 7efcc3fff700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc414c6a0 0x7efcc4149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.435+0000 7efcc3fff700 1 -- 172.21.15.118:0/1554874274 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc009a20 con 0x7efcc4152370 2023-09-28T04:23:39.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.435+0000 7efcc2ffd700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc414c6a0 0x7efcc4149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:39.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.435+0000 7efcc3fff700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcc4152370 0x7efcc414a1f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efcbc018000 tx=0x7efcbc01b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:39.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.435+0000 7efcab7fe700 1 -- 172.21.15.118:0/1554874274 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc019610 con 0x7efcc4152370 2023-09-28T04:23:39.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.435+0000 7efcab7fe700 1 -- 172.21.15.118:0/1554874274 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc019790 con 0x7efcc4152370 2023-09-28T04:23:39.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.435+0000 7efcc9bff700 1 -- 172.21.15.118:0/1554874274 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc4151190 con 0x7efcc4152370 2023-09-28T04:23:39.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.435+0000 7efcab7fe700 1 -- 172.21.15.118:0/1554874274 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc019b50 con 0x7efcc4152370 2023-09-28T04:23:39.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.435+0000 7efcc9bff700 1 -- 172.21.15.118:0/1554874274 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc4151750 con 0x7efcc4152370 2023-09-28T04:23:39.439 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.436+0000 7efcc9bff700 1 -- 172.21.15.118:0/1554874274 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc4071980 con 0x7efcc4152370 2023-09-28T04:23:39.439 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.437+0000 7efcab7fe700 1 -- 172.21.15.118:0/1554874274 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efcbc02d440 con 0x7efcc4152370 2023-09-28T04:23:39.439 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.438+0000 7efcab7fe700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7efcb0067360 0x7efcb0069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:39.440 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.438+0000 7efcab7fe700 1 -- 172.21.15.118:0/1554874274 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efcbc086e00 con 0x7efcc4152370 2023-09-28T04:23:39.440 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.438+0000 7efcc37fe700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7efcb0067360 0x7efcb0069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:39.440 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.439+0000 7efcc37fe700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7efcb0067360 0x7efcb0069810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efcb4007160 tx=0x7efcb4007f50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:39.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.442+0000 7efcab7fe700 1 -- 172.21.15.118:0/1554874274 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efcbc053ce0 con 0x7efcc4152370 2023-09-28T04:23:39.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.673+0000 7efcc9bff700 1 -- 172.21.15.118:0/1554874274 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efcc40c0840 con 0x7efcc4152370 2023-09-28T04:23:39.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.673+0000 7efcab7fe700 1 -- 172.21.15.118:0/1554874274 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+73 (secure 0 0 0) 0x7efcbc028020 con 0x7efcc4152370 2023-09-28T04:23:39.674 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-28T04:23:39.676 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.675+0000 7efcc9bff700 1 -- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7efcb0067360 msgr2=0x7efcb0069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.676 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.675+0000 7efcc9bff700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7efcb0067360 0x7efcb0069810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efcb4007160 tx=0x7efcb4007f50 comp rx=0 tx=0).stop 2023-09-28T04:23:39.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.675+0000 7efcc9bff700 1 -- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcc4152370 msgr2=0x7efcc414a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:39.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.675+0000 7efcc9bff700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcc4152370 0x7efcc414a1f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efcbc018000 tx=0x7efcbc01b000 comp rx=0 tx=0).stop 2023-09-28T04:23:39.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.676+0000 7efcc9bff700 1 -- 172.21.15.118:0/1554874274 shutdown_connections 2023-09-28T04:23:39.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.676+0000 7efcc9bff700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7efcb0067360 0x7efcb0069810 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.676+0000 7efcc9bff700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcc4152370 0x7efcc414a1f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.676+0000 7efcc9bff700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efcc40c0ca0 0x7efcc41584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.676+0000 7efcc9bff700 1 --2- 172.21.15.118:0/1554874274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcc414c6a0 0x7efcc4149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:39.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.676+0000 7efcc9bff700 1 -- 172.21.15.118:0/1554874274 >> 172.21.15.118:0/1554874274 conn(0x7efcc4067630 msgr2=0x7efcc406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:39.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.676+0000 7efcc9bff700 1 -- 172.21.15.118:0/1554874274 shutdown_connections 2023-09-28T04:23:39.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:39.676+0000 7efcc9bff700 1 -- 172.21.15.118:0/1554874274 wait complete. 2023-09-28T04:23:39.693 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-28T04:23:39.693 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-28T04:23:39.693 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-09-28T04:23:39.693 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-28T04:23:39.693 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-28T04:23:39.693 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-28T04:23:39.693 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-28T04:23:39.693 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-28T04:23:39.693 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-28T04:23:39.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T04:23:39.694 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-09-28T04:23:39.740 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-28T04:23:39.740 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-28T04:23:39.740 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-09-28T04:23:39.740 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-09-28T04:23:39.740 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-09-28T04:23:39.740 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-09-28T04:23:39.740 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-28T04:23:39.741 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-09-28T04:23:39.741 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-09-28T04:23:39.741 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-28T04:23:39.741 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-09-28T04:23:39.741 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-09-28T04:23:39.741 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-28T04:23:39.741 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-09-28T04:23:39.741 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-28T04:23:39.741 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-09-28T04:23:39.741 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-28T04:23:39.742 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42296sec preferred_lft 42296sec 2023-09-28T04:23:39.742 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-09-28T04:23:39.742 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-09-28T04:23:39.743 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-28T04:23:39.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T04:23:39.743 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-09-28T04:23:39.743 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-09-28T04:23:39.743 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2023-09-28T04:23:39.744 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2023-09-28T04:23:39.744 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2023-09-28T04:23:39.744 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-28T04:23:39.744 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-09-28T04:23:40.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T04:23:40.164 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-28T04:23:40.234 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-09-28T04:23:40.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T04:23:40.237 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-09-28T04:23:40.309 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-09-28T04:23:40.309 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-28T04:23:40.309 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-28T04:23:40.309 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-28T04:23:40.309 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-28T04:23:40.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T04:23:40.311 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-09-28T04:23:40.311 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-09-28T04:23:40.311 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-28T04:23:40.311 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-28T04:23:40.311 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-28T04:23:40.311 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-09-28T04:23:41.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T04:23:41.017 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-09-28T04:23:41.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T04:23:41.065 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2023-09-28T04:23:41.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T04:23:41.111 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-09-28T04:23:41.111 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-09-28T04:23:41.111 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-28T04:23:41.111 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-28T04:23:41.111 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-09-28T04:23:41.294 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-28T04:23:41.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T04:23:41.294 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-09-28T04:23:41.294 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-09-28T04:23:41.294 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-28T04:23:41.294 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-28T04:23:41.294 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-28T04:23:41.295 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-28T04:23:41.295 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-28T04:23:41.295 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-09-28T04:23:41.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T04:23:41.566 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-09-28T04:23:41.566 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-09-28T04:23:41.566 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-09-28T04:23:41.566 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2023-09-28T04:23:41.566 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-09-28T04:23:41.737 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-28T04:23:41.737 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-28T04:23:41.783 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-28T04:23:41.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-28T04:23:41.783 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-28T04:23:41.869 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/kclient.py", line 112, in task kernel_mount.mount(mntopts=client_config.get('mntopts', [])) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 54, in mount retval = self._run_mount_cmd(mntopts, check_status) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 69, in _run_mount_cmd mount_cmd = self._get_mount_cmd(mntopts) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 118, in _get_mount_cmd stx_opt = self._make_mount_cmd_old_or_new_style() File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 91, in _make_mount_cmd_old_or_new_style assert(self.cephfs_mntpt) AssertionError 2023-09-28T04:23:41.933 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d909527ce834446795527487d6145ede Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/kclient.py", line 112, in task kernel_mount.mount(mntopts=client_config.get('mntopts', [])) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 54, in mount retval = self._run_mount_cmd(mntopts, check_status) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 69, in _run_mount_cmd mount_cmd = self._get_mount_cmd(mntopts) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 118, in _get_mount_cmd stx_opt = self._make_mount_cmd_old_or_new_style() File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 91, in _make_mount_cmd_old_or_new_style assert(self.cephfs_mntpt) AssertionError 2023-09-28T04:23:41.935 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-09-28T04:23:41.944 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-28T04:23:41.951 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-09-28T04:23:41.952 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:42.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.152+0000 7f46443ff700 1 Processor -- start 2023-09-28T04:23:42.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.152+0000 7f46443ff700 1 -- start start 2023-09-28T04:23:42.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.154+0000 7f46443ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f463c156fb0 0x7f463c0c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:42.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.154+0000 7f46443ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f463c14d4f0 0x7f463c14d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:42.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.154+0000 7f46443ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463c0bf680 con 0x7f463c0c4700 2023-09-28T04:23:42.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.154+0000 7f46443ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463c0c00e0 con 0x7f463c14d4f0 2023-09-28T04:23:42.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.154+0000 7f46443ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0c4cf0 con 0x7f463c156fb0 2023-09-28T04:23:42.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.154+0000 7f464299c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f463c14d4f0 0x7f463c14d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:42.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.154+0000 7f464219b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f463c156fb0 0x7f463c0c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:42.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.154+0000 7f464199a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f463c0c4700 0x7f463c157380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45958/0 (socket says 172.21.15.118:45958) 2023-09-28T04:23:42.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.154+0000 7f464199a700 1 -- 172.21.15.118:0/1979223993 learned_addr learned my addr 172.21.15.118:0/1979223993 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:42.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.154+0000 7f4641199700 1 -- 172.21.15.118:0/1979223993 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324238100 0 0) 0x7f463c0bf680 con 0x7f463c0c4700 2023-09-28T04:23:42.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.154+0000 7f464219b700 1 -- 172.21.15.118:0/1979223993 >> v2:172.21.15.174:3300/0 conn(0x7f463c14d4f0 msgr2=0x7f463c14d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:42.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.154+0000 7f464219b700 1 --2- 172.21.15.118:0/1979223993 >> v2:172.21.15.174:3300/0 conn(0x7f463c14d4f0 0x7f463c14d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.155+0000 7f464219b700 1 -- 172.21.15.118:0/1979223993 >> v1:172.21.15.118:6789/0 conn(0x7f463c0c4700 legacy=0x7f463c157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:42.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.155+0000 7f464219b700 1 -- 172.21.15.118:0/1979223993 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c0ca6e0 con 0x7f463c156fb0 2023-09-28T04:23:42.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.155+0000 7f464299c700 1 --2- 172.21.15.118:0/1979223993 >> v2:172.21.15.174:3300/0 conn(0x7f463c14d4f0 0x7f463c14d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:42.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.155+0000 7f464219b700 1 --2- 172.21.15.118:0/1979223993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f463c156fb0 0x7f463c0c5ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f46380098d0 tx=0x7f4638009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f62fa0c6090d99e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:42.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.155+0000 7f4641199700 1 -- 172.21.15.118:0/1979223993 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4638005c10 con 0x7f463c156fb0 2023-09-28T04:23:42.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.155+0000 7f4641199700 1 -- 172.21.15.118:0/1979223993 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4638005d70 con 0x7f463c156fb0 2023-09-28T04:23:42.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.155+0000 7f4641199700 1 -- 172.21.15.118:0/1979223993 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4638006280 con 0x7f463c156fb0 2023-09-28T04:23:42.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.156+0000 7f46443ff700 1 -- 172.21.15.118:0/1979223993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f463c156fb0 msgr2=0x7f463c0c5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:42.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.156+0000 7f46443ff700 1 --2- 172.21.15.118:0/1979223993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f463c156fb0 0x7f463c0c5ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f46380098d0 tx=0x7f4638009120 comp rx=0 tx=0).stop 2023-09-28T04:23:42.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.156+0000 7f46443ff700 1 -- 172.21.15.118:0/1979223993 shutdown_connections 2023-09-28T04:23:42.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.156+0000 7f46443ff700 1 --2- 172.21.15.118:0/1979223993 >> v2:172.21.15.174:3300/0 conn(0x7f463c14d4f0 0x7f463c14d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.156+0000 7f46443ff700 1 --2- 172.21.15.118:0/1979223993 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f463c156fb0 0x7f463c0c5ab0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.156+0000 7f46443ff700 1 -- 172.21.15.118:0/1979223993 >> 172.21.15.118:0/1979223993 conn(0x7f463c063230 msgr2=0x7f463c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:42.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.156+0000 7f46443ff700 1 -- 172.21.15.118:0/1979223993 shutdown_connections 2023-09-28T04:23:42.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.156+0000 7f46443ff700 1 -- 172.21.15.118:0/1979223993 wait complete. 2023-09-28T04:23:42.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.158+0000 7f46443ff700 1 Processor -- start 2023-09-28T04:23:42.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.158+0000 7f46443ff700 1 -- start start 2023-09-28T04:23:42.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.159+0000 7f46443ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f463c0c4700 0x7f463c150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:42.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.159+0000 7f46443ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f463c14d4f0 0x7f463c149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:42.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.159+0000 7f46443ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f463c156fb0 0x7f463c14a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:42.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.159+0000 7f46443ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0c1a70 con 0x7f463c0c4700 2023-09-28T04:23:42.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.159+0000 7f46443ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c14ff00 con 0x7f463c14d4f0 2023-09-28T04:23:42.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.159+0000 7f46443ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c150750 con 0x7f463c156fb0 2023-09-28T04:23:42.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.159+0000 7f464219b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f463c0c4700 0x7f463c150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:42.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.159+0000 7f464219b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f463c0c4700 0x7f463c150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54506/0 (socket says 172.21.15.118:54506) 2023-09-28T04:23:42.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.159+0000 7f464219b700 1 -- 172.21.15.118:0/2943882183 learned_addr learned my addr 172.21.15.118:0/2943882183 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:42.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.160+0000 7f464299c700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f463c156fb0 0x7f463c14a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:42.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.160+0000 7f464199a700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f463c14d4f0 0x7f463c149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:42.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.160+0000 7f464219b700 1 -- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f463c156fb0 msgr2=0x7f463c14a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:42.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.160+0000 7f464219b700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f463c156fb0 0x7f463c14a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.160+0000 7f464219b700 1 -- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f463c14d4f0 msgr2=0x7f463c149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:42.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.160+0000 7f464219b700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f463c14d4f0 0x7f463c149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.160+0000 7f464219b700 1 -- 172.21.15.118:0/2943882183 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4634009a20 con 0x7f463c0c4700 2023-09-28T04:23:42.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.160+0000 7f464219b700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f463c0c4700 0x7f463c150be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4638009f70 tx=0x7f4638016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:42.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.160+0000 7f46327fc700 1 -- 172.21.15.118:0/2943882183 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463801d860 con 0x7f463c0c4700 2023-09-28T04:23:42.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.160+0000 7f46327fc700 1 -- 172.21.15.118:0/2943882183 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463801d9c0 con 0x7f463c0c4700 2023-09-28T04:23:42.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.160+0000 7f46443ff700 1 -- 172.21.15.118:0/2943882183 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46380093c0 con 0x7f463c0c4700 2023-09-28T04:23:42.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.160+0000 7f46327fc700 1 -- 172.21.15.118:0/2943882183 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463801dd80 con 0x7f463c0c4700 2023-09-28T04:23:42.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.161+0000 7f46443ff700 1 -- 172.21.15.118:0/2943882183 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463c0c14d0 con 0x7f463c0c4700 2023-09-28T04:23:42.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.162+0000 7f46443ff700 1 -- 172.21.15.118:0/2943882183 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c0713a0 con 0x7f463c0c4700 2023-09-28T04:23:42.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.162+0000 7f46327fc700 1 -- 172.21.15.118:0/2943882183 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f463801b690 con 0x7f463c0c4700 2023-09-28T04:23:42.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.163+0000 7f46327fc700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4620067360 0x7f4620069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:42.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.163+0000 7f46327fc700 1 -- 172.21.15.118:0/2943882183 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f46380867b0 con 0x7f463c0c4700 2023-09-28T04:23:42.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.164+0000 7f464199a700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4620067360 0x7f4620069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:42.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.164+0000 7f464199a700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4620067360 0x7f4620069810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f463c1568d0 tx=0x7f462c007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:42.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.168+0000 7f46327fc700 1 -- 172.21.15.118:0/2943882183 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f46380536d0 con 0x7f463c0c4700 2023-09-28T04:23:42.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.358+0000 7f46443ff700 1 -- 172.21.15.118:0/2943882183 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f463c070f80 con 0x7f463c0c4700 2023-09-28T04:23:42.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.359+0000 7f46327fc700 1 -- 172.21.15.118:0/2943882183 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f4638056cf0 con 0x7f463c0c4700 2023-09-28T04:23:42.360 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:42.361 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:19.371938+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T04:23:10.586895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T04:23:10.697802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T04:23:16.491417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T04:23:17.349188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:07.142219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.951857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.911133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.882482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.688096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.764671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.767264+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.763816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:42.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.361+0000 7f46443ff700 1 -- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4620067360 msgr2=0x7f4620069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:42.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.361+0000 7f46443ff700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4620067360 0x7f4620069810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f463c1568d0 tx=0x7f462c007d30 comp rx=0 tx=0).stop 2023-09-28T04:23:42.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.361+0000 7f46443ff700 1 -- 172.21.15.118:0/2943882183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f463c0c4700 msgr2=0x7f463c150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:42.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.361+0000 7f46443ff700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f463c0c4700 0x7f463c150be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4638009f70 tx=0x7f4638016000 comp rx=0 tx=0).stop 2023-09-28T04:23:42.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.361+0000 7f46443ff700 1 -- 172.21.15.118:0/2943882183 shutdown_connections 2023-09-28T04:23:42.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.361+0000 7f46443ff700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4620067360 0x7f4620069810 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.361+0000 7f46443ff700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f463c156fb0 0x7f463c14a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.361+0000 7f46443ff700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f463c0c4700 0x7f463c150be0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.361+0000 7f46443ff700 1 --2- 172.21.15.118:0/2943882183 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f463c14d4f0 0x7f463c149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.361+0000 7f46443ff700 1 -- 172.21.15.118:0/2943882183 >> 172.21.15.118:0/2943882183 conn(0x7f463c063230 msgr2=0x7f463c14c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:42.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.362+0000 7f46443ff700 1 -- 172.21.15.118:0/2943882183 shutdown_connections 2023-09-28T04:23:42.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.362+0000 7f46443ff700 1 -- 172.21.15.118:0/2943882183 wait complete. 2023-09-28T04:23:42.380 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-28T04:23:42.380 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T04:23:42.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.572+0000 7fafde7ff700 1 Processor -- start 2023-09-28T04:23:42.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.572+0000 7fafde7ff700 1 -- start start 2023-09-28T04:23:42.574 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.573+0000 7fafde7ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fafd814fa90 0x7fafd8156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:42.574 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.573+0000 7fafde7ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fafd814fe60 0x7fafd8068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:42.574 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.573+0000 7fafde7ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafd80c84c0 0x7fafd80cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:42.574 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.573+0000 7fafde7ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd80c8030 con 0x7fafd814fe60 2023-09-28T04:23:42.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.573+0000 7fafde7ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd80c7180 con 0x7fafd814fa90 2023-09-28T04:23:42.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.573+0000 7fafde7ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80c7420 con 0x7fafd80c84c0 2023-09-28T04:23:42.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.574+0000 7fafd77fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fafd814fe60 0x7fafd8068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:42.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.574+0000 7fafdcd9c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafd80c84c0 0x7fafd80cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:42.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.574+0000 7fafd77fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fafd814fe60 0x7fafd8068b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54520/0 (socket says 172.21.15.118:54520) 2023-09-28T04:23:42.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.574+0000 7fafd7fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fafd814fa90 0x7fafd8156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:42.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.574+0000 7fafd77fe700 1 -- 172.21.15.118:0/2205128273 learned_addr learned my addr 172.21.15.118:0/2205128273 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:42.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.574+0000 7fafd77fe700 1 -- 172.21.15.118:0/2205128273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafd80c84c0 msgr2=0x7fafd80cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:42.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.574+0000 7fafd77fe700 1 --2- 172.21.15.118:0/2205128273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafd80c84c0 0x7fafd80cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.574+0000 7fafd77fe700 1 -- 172.21.15.118:0/2205128273 >> v2:172.21.15.174:3300/0 conn(0x7fafd814fa90 msgr2=0x7fafd8156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:42.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.574+0000 7fafd77fe700 1 --2- 172.21.15.118:0/2205128273 >> v2:172.21.15.174:3300/0 conn(0x7fafd814fa90 0x7fafd8156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.574+0000 7fafd77fe700 1 -- 172.21.15.118:0/2205128273 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd80c7700 con 0x7fafd814fe60 2023-09-28T04:23:42.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.574+0000 7fafdcd9c700 1 --2- 172.21.15.118:0/2205128273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafd80c84c0 0x7fafd80cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:42.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.574+0000 7fafd77fe700 1 --2- 172.21.15.118:0/2205128273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafd814fe60 0x7fafd8068b90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fafd8089480 tx=0x7fafcc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b8f55cd707fa71 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:42.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.574+0000 7fafd6ffd700 1 -- 172.21.15.118:0/2205128273 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc00b640 con 0x7fafd814fe60 2023-09-28T04:23:42.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.575+0000 7fafd6ffd700 1 -- 172.21.15.118:0/2205128273 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc00b7a0 con 0x7fafd814fe60 2023-09-28T04:23:42.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.575+0000 7fafd6ffd700 1 -- 172.21.15.118:0/2205128273 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc00bb60 con 0x7fafd814fe60 2023-09-28T04:23:42.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.575+0000 7fafde7ff700 1 -- 172.21.15.118:0/2205128273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafd814fe60 msgr2=0x7fafd8068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:42.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.575+0000 7fafde7ff700 1 --2- 172.21.15.118:0/2205128273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafd814fe60 0x7fafd8068b90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fafd8089480 tx=0x7fafcc009250 comp rx=0 tx=0).stop 2023-09-28T04:23:42.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.575+0000 7fafde7ff700 1 -- 172.21.15.118:0/2205128273 shutdown_connections 2023-09-28T04:23:42.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.575+0000 7fafde7ff700 1 --2- 172.21.15.118:0/2205128273 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafd80c84c0 0x7fafd80cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.575+0000 7fafde7ff700 1 --2- 172.21.15.118:0/2205128273 >> v2:172.21.15.174:3300/0 conn(0x7fafd814fa90 0x7fafd8156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.575+0000 7fafde7ff700 1 --2- 172.21.15.118:0/2205128273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafd814fe60 0x7fafd8068b90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.575+0000 7fafde7ff700 1 -- 172.21.15.118:0/2205128273 >> 172.21.15.118:0/2205128273 conn(0x7fafd8063cd0 msgr2=0x7fafd80cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:42.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.575+0000 7fafde7ff700 1 -- 172.21.15.118:0/2205128273 shutdown_connections 2023-09-28T04:23:42.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.575+0000 7fafde7ff700 1 -- 172.21.15.118:0/2205128273 wait complete. 2023-09-28T04:23:42.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.577+0000 7fafde7ff700 1 Processor -- start 2023-09-28T04:23:42.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.577+0000 7fafde7ff700 1 -- start start 2023-09-28T04:23:42.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafde7ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafd80c84c0 0x7fafd8146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:42.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafde7ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafd814fa90 0x7fafd80cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:42.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafde7ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafd814fe60 0x7fafd80cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:42.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafde7ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80c3580 con 0x7fafd814fe60 2023-09-28T04:23:42.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafde7ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80c3790 con 0x7fafd80c84c0 2023-09-28T04:23:42.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafde7ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8153240 con 0x7fafd814fa90 2023-09-28T04:23:42.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafdcd9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafd814fe60 0x7fafd80cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:42.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafdcd9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafd814fe60 0x7fafd80cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54530/0 (socket says 172.21.15.118:54530) 2023-09-28T04:23:42.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafdcd9c700 1 -- 172.21.15.118:0/4010344874 learned_addr learned my addr 172.21.15.118:0/4010344874 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:42.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafd77fe700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafd814fa90 0x7fafd80cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:42.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafd7fff700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafd80c84c0 0x7fafd8146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:42.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafdcd9c700 1 -- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafd814fa90 msgr2=0x7fafd80cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:42.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafdcd9c700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafd814fa90 0x7fafd80cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafdcd9c700 1 -- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafd80c84c0 msgr2=0x7fafd8146540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:42.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafdcd9c700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafd80c84c0 0x7fafd8146540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafdcd9c700 1 -- 172.21.15.118:0/4010344874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd0009a20 con 0x7fafd814fe60 2023-09-28T04:23:42.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.578+0000 7fafd77fe700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafd814fa90 0x7fafd80cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:42.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.579+0000 7fafdcd9c700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafd814fe60 0x7fafd80cc6e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009f20 tx=0x7fafd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:42.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.579+0000 7fafbffff700 1 -- 172.21.15.118:0/4010344874 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd000cc20 con 0x7fafd814fe60 2023-09-28T04:23:42.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.579+0000 7fafbffff700 1 -- 172.21.15.118:0/4010344874 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd000f040 con 0x7fafd814fe60 2023-09-28T04:23:42.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.579+0000 7fafde7ff700 1 -- 172.21.15.118:0/4010344874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc0094f0 con 0x7fafd814fe60 2023-09-28T04:23:42.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.579+0000 7fafbffff700 1 -- 172.21.15.118:0/4010344874 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0014480 con 0x7fafd814fe60 2023-09-28T04:23:42.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.579+0000 7fafde7ff700 1 -- 172.21.15.118:0/4010344874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd8167480 con 0x7fafd814fe60 2023-09-28T04:23:42.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.580+0000 7fafde7ff700 1 -- 172.21.15.118:0/4010344874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd81672e0 con 0x7fafd814fe60 2023-09-28T04:23:42.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.581+0000 7fafbffff700 1 -- 172.21.15.118:0/4010344874 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fafd0003020 con 0x7fafd814fe60 2023-09-28T04:23:42.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.582+0000 7fafbffff700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fafc4067330 0x7fafc40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:42.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.582+0000 7fafbffff700 1 -- 172.21.15.118:0/4010344874 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fafd00855a0 con 0x7fafd814fe60 2023-09-28T04:23:42.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.582+0000 7fafd7fff700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fafc4067330 0x7fafc40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:42.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.583+0000 7fafd7fff700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fafc4067330 0x7fafc40697e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009ca0 tx=0x7fafc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:42.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.586+0000 7fafbffff700 1 -- 172.21.15.118:0/4010344874 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fafd81672e0 con 0x7fafd814fe60 2023-09-28T04:23:42.771 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.770+0000 7fafde7ff700 1 -- 172.21.15.118:0/4010344874 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fafd8150820 con 0x7fafc4067330 2023-09-28T04:23:42.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.779+0000 7fafbffff700 1 -- 172.21.15.118:0/4010344874 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284733 (secure 0 0 0) 0x7fafd8150820 con 0x7fafc4067330 2023-09-28T04:23:42.786 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:42.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.783+0000 7fafde7ff700 1 -- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fafc4067330 msgr2=0x7fafc40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:42.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.783+0000 7fafde7ff700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fafc4067330 0x7fafc40697e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009ca0 tx=0x7fafc8008040 comp rx=0 tx=0).stop 2023-09-28T04:23:42.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.783+0000 7fafde7ff700 1 -- 172.21.15.118:0/4010344874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafd814fe60 msgr2=0x7fafd80cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:42.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.783+0000 7fafde7ff700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafd814fe60 0x7fafd80cc6e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009f20 tx=0x7fafd000b040 comp rx=0 tx=0).stop 2023-09-28T04:23:42.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.783+0000 7fafde7ff700 1 -- 172.21.15.118:0/4010344874 shutdown_connections 2023-09-28T04:23:42.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.783+0000 7fafde7ff700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fafc4067330 0x7fafc40697e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.783+0000 7fafde7ff700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafd814fe60 0x7fafd80cc6e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.783+0000 7fafde7ff700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafd80c84c0 0x7fafd8146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.783+0000 7fafde7ff700 1 --2- 172.21.15.118:0/4010344874 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fafd814fa90 0x7fafd80cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:42.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.783+0000 7fafde7ff700 1 -- 172.21.15.118:0/4010344874 >> 172.21.15.118:0/4010344874 conn(0x7fafd8063cd0 msgr2=0x7fafd814eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:42.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.783+0000 7fafde7ff700 1 -- 172.21.15.118:0/4010344874 shutdown_connections 2023-09-28T04:23:42.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:42.783+0000 7fafde7ff700 1 -- 172.21.15.118:0/4010344874 wait complete. 2023-09-28T04:23:42.790 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-09-28T04:23:42.801 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-09-28T04:23:42.531483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595334,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":284,"num_write_kb":2451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68480,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":66432,"kb_avail":754906240,"statfs":{"total":773094113280,"available":773023989760,"internally_reserved":0,"allocated":2031616,"data_stored":1824500,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68026368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1330,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003699"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401799+0000","last_change":"2023-09-28T04:23:18.400475+0000","last_active":"2023-09-28T04:23:18.401799+0000","last_peered":"2023-09-28T04:23:18.401799+0000","last_clean":"2023-09-28T04:23:18.401799+0000","last_became_active":"2023-09-28T04:23:18.400107+0000","last_became_peered":"2023-09-28T04:23:18.400107+0000","last_unstale":"2023-09-28T04:23:18.401799+0000","last_undegraded":"2023-09-28T04:23:18.401799+0000","last_fullsized":"2023-09-28T04:23:18.401799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:44.340279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391569+0000","last_change":"2023-09-28T04:23:18.385136+0000","last_active":"2023-09-28T04:23:18.391569+0000","last_peered":"2023-09-28T04:23:18.391569+0000","last_clean":"2023-09-28T04:23:18.391569+0000","last_became_active":"2023-09-28T04:23:18.384789+0000","last_became_peered":"2023-09-28T04:23:18.384789+0000","last_unstale":"2023-09-28T04:23:18.391569+0000","last_undegraded":"2023-09-28T04:23:18.391569+0000","last_fullsized":"2023-09-28T04:23:18.391569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397939+0000","last_change":"2023-09-28T04:23:18.393700+0000","last_active":"2023-09-28T04:23:18.397939+0000","last_peered":"2023-09-28T04:23:18.397939+0000","last_clean":"2023-09-28T04:23:18.397939+0000","last_became_active":"2023-09-28T04:23:18.390599+0000","last_became_peered":"2023-09-28T04:23:18.390599+0000","last_unstale":"2023-09-28T04:23:18.397939+0000","last_undegraded":"2023-09-28T04:23:18.397939+0000","last_fullsized":"2023-09-28T04:23:18.397939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:43:19.782618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392953+0000","last_change":"2023-09-28T04:23:18.390865+0000","last_active":"2023-09-28T04:23:18.392953+0000","last_peered":"2023-09-28T04:23:18.392953+0000","last_clean":"2023-09-28T04:23:18.392953+0000","last_became_active":"2023-09-28T04:23:18.390607+0000","last_became_peered":"2023-09-28T04:23:18.390607+0000","last_unstale":"2023-09-28T04:23:18.392953+0000","last_undegraded":"2023-09-28T04:23:18.392953+0000","last_fullsized":"2023-09-28T04:23:18.392953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.405585+0000","last_change":"2023-09-28T04:23:18.404215+0000","last_active":"2023-09-28T04:23:18.405585+0000","last_peered":"2023-09-28T04:23:18.405585+0000","last_clean":"2023-09-28T04:23:18.405585+0000","last_became_active":"2023-09-28T04:23:18.403960+0000","last_became_peered":"2023-09-28T04:23:18.403960+0000","last_unstale":"2023-09-28T04:23:18.405585+0000","last_undegraded":"2023-09-28T04:23:18.405585+0000","last_fullsized":"2023-09-28T04:23:18.405585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397969+0000","last_change":"2023-09-28T04:23:18.393987+0000","last_active":"2023-09-28T04:23:18.397969+0000","last_peered":"2023-09-28T04:23:18.397969+0000","last_clean":"2023-09-28T04:23:18.397969+0000","last_became_active":"2023-09-28T04:23:18.390575+0000","last_became_peered":"2023-09-28T04:23:18.390575+0000","last_unstale":"2023-09-28T04:23:18.397969+0000","last_undegraded":"2023-09-28T04:23:18.397969+0000","last_fullsized":"2023-09-28T04:23:18.397969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:24:51.659204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400984+0000","last_change":"2023-09-28T04:23:18.396733+0000","last_active":"2023-09-28T04:23:18.400984+0000","last_peered":"2023-09-28T04:23:18.400984+0000","last_clean":"2023-09-28T04:23:18.400984+0000","last_became_active":"2023-09-28T04:23:18.396038+0000","last_became_peered":"2023-09-28T04:23:18.396038+0000","last_unstale":"2023-09-28T04:23:18.400984+0000","last_undegraded":"2023-09-28T04:23:18.400984+0000","last_fullsized":"2023-09-28T04:23:18.400984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391542+0000","last_change":"2023-09-28T04:23:18.388208+0000","last_active":"2023-09-28T04:23:18.391542+0000","last_peered":"2023-09-28T04:23:18.391542+0000","last_clean":"2023-09-28T04:23:18.391542+0000","last_became_active":"2023-09-28T04:23:18.387260+0000","last_became_peered":"2023-09-28T04:23:18.387260+0000","last_unstale":"2023-09-28T04:23:18.391542+0000","last_undegraded":"2023-09-28T04:23:18.391542+0000","last_fullsized":"2023-09-28T04:23:18.391542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.405212+0000","last_change":"2023-09-28T04:23:18.403803+0000","last_active":"2023-09-28T04:23:18.405212+0000","last_peered":"2023-09-28T04:23:18.405212+0000","last_clean":"2023-09-28T04:23:18.405212+0000","last_became_active":"2023-09-28T04:23:18.403565+0000","last_became_peered":"2023-09-28T04:23:18.403565+0000","last_unstale":"2023-09-28T04:23:18.405212+0000","last_undegraded":"2023-09-28T04:23:18.405212+0000","last_fullsized":"2023-09-28T04:23:18.405212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397774+0000","last_change":"2023-09-28T04:23:18.392418+0000","last_active":"2023-09-28T04:23:18.397774+0000","last_peered":"2023-09-28T04:23:18.397774+0000","last_clean":"2023-09-28T04:23:18.397774+0000","last_became_active":"2023-09-28T04:23:18.390911+0000","last_became_peered":"2023-09-28T04:23:18.390911+0000","last_unstale":"2023-09-28T04:23:18.397774+0000","last_undegraded":"2023-09-28T04:23:18.397774+0000","last_fullsized":"2023-09-28T04:23:18.397774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397957+0000","last_change":"2023-09-28T04:23:18.393845+0000","last_active":"2023-09-28T04:23:18.397957+0000","last_peered":"2023-09-28T04:23:18.397957+0000","last_clean":"2023-09-28T04:23:18.397957+0000","last_became_active":"2023-09-28T04:23:18.393524+0000","last_became_peered":"2023-09-28T04:23:18.393524+0000","last_unstale":"2023-09-28T04:23:18.397957+0000","last_undegraded":"2023-09-28T04:23:18.397957+0000","last_fullsized":"2023-09-28T04:23:18.397957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:27:39.596054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390755+0000","last_change":"2023-09-28T04:23:18.385250+0000","last_active":"2023-09-28T04:23:18.390755+0000","last_peered":"2023-09-28T04:23:18.390755+0000","last_clean":"2023-09-28T04:23:18.390755+0000","last_became_active":"2023-09-28T04:23:18.384986+0000","last_became_peered":"2023-09-28T04:23:18.384986+0000","last_unstale":"2023-09-28T04:23:18.390755+0000","last_undegraded":"2023-09-28T04:23:18.390755+0000","last_fullsized":"2023-09-28T04:23:18.390755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:15.500469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404651+0000","last_change":"2023-09-28T04:23:18.402417+0000","last_active":"2023-09-28T04:23:18.404651+0000","last_peered":"2023-09-28T04:23:18.404651+0000","last_clean":"2023-09-28T04:23:18.404651+0000","last_became_active":"2023-09-28T04:23:18.402161+0000","last_became_peered":"2023-09-28T04:23:18.402161+0000","last_unstale":"2023-09-28T04:23:18.404651+0000","last_undegraded":"2023-09-28T04:23:18.404651+0000","last_fullsized":"2023-09-28T04:23:18.404651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:50.909915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391345+0000","last_change":"2023-09-28T04:23:18.387808+0000","last_active":"2023-09-28T04:23:18.391345+0000","last_peered":"2023-09-28T04:23:18.391345+0000","last_clean":"2023-09-28T04:23:18.391345+0000","last_became_active":"2023-09-28T04:23:18.387471+0000","last_became_peered":"2023-09-28T04:23:18.387471+0000","last_unstale":"2023-09-28T04:23:18.391345+0000","last_undegraded":"2023-09-28T04:23:18.391345+0000","last_fullsized":"2023-09-28T04:23:18.391345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401004+0000","last_change":"2023-09-28T04:23:18.396945+0000","last_active":"2023-09-28T04:23:18.401004+0000","last_peered":"2023-09-28T04:23:18.401004+0000","last_clean":"2023-09-28T04:23:18.401004+0000","last_became_active":"2023-09-28T04:23:18.396395+0000","last_became_peered":"2023-09-28T04:23:18.396395+0000","last_unstale":"2023-09-28T04:23:18.401004+0000","last_undegraded":"2023-09-28T04:23:18.401004+0000","last_fullsized":"2023-09-28T04:23:18.401004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397971+0000","last_change":"2023-09-28T04:23:18.393975+0000","last_active":"2023-09-28T04:23:18.397971+0000","last_peered":"2023-09-28T04:23:18.397971+0000","last_clean":"2023-09-28T04:23:18.397971+0000","last_became_active":"2023-09-28T04:23:18.393683+0000","last_became_peered":"2023-09-28T04:23:18.393683+0000","last_unstale":"2023-09-28T04:23:18.397971+0000","last_undegraded":"2023-09-28T04:23:18.397971+0000","last_fullsized":"2023-09-28T04:23:18.397971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:06:40.927453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404561+0000","last_change":"2023-09-28T04:23:18.402518+0000","last_active":"2023-09-28T04:23:18.404561+0000","last_peered":"2023-09-28T04:23:18.404561+0000","last_clean":"2023-09-28T04:23:18.404561+0000","last_became_active":"2023-09-28T04:23:18.402275+0000","last_became_peered":"2023-09-28T04:23:18.402275+0000","last_unstale":"2023-09-28T04:23:18.404561+0000","last_undegraded":"2023-09-28T04:23:18.404561+0000","last_fullsized":"2023-09-28T04:23:18.404561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400750+0000","last_change":"2023-09-28T04:23:18.395032+0000","last_active":"2023-09-28T04:23:18.400750+0000","last_peered":"2023-09-28T04:23:18.400750+0000","last_clean":"2023-09-28T04:23:18.400750+0000","last_became_active":"2023-09-28T04:23:18.390678+0000","last_became_peered":"2023-09-28T04:23:18.390678+0000","last_unstale":"2023-09-28T04:23:18.400750+0000","last_undegraded":"2023-09-28T04:23:18.400750+0000","last_fullsized":"2023-09-28T04:23:18.400750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390373+0000","last_change":"2023-09-28T04:23:18.385209+0000","last_active":"2023-09-28T04:23:18.390373+0000","last_peered":"2023-09-28T04:23:18.390373+0000","last_clean":"2023-09-28T04:23:18.390373+0000","last_became_active":"2023-09-28T04:23:18.384916+0000","last_became_peered":"2023-09-28T04:23:18.384916+0000","last_unstale":"2023-09-28T04:23:18.390373+0000","last_undegraded":"2023-09-28T04:23:18.390373+0000","last_fullsized":"2023-09-28T04:23:18.390373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:06.937552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397758+0000","last_change":"2023-09-28T04:23:18.386692+0000","last_active":"2023-09-28T04:23:18.397758+0000","last_peered":"2023-09-28T04:23:18.397758+0000","last_clean":"2023-09-28T04:23:18.397758+0000","last_became_active":"2023-09-28T04:23:18.385805+0000","last_became_peered":"2023-09-28T04:23:18.385805+0000","last_unstale":"2023-09-28T04:23:18.397758+0000","last_undegraded":"2023-09-28T04:23:18.397758+0000","last_fullsized":"2023-09-28T04:23:18.397758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:52:07.899487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401120+0000","last_change":"2023-09-28T04:23:18.400497+0000","last_active":"2023-09-28T04:23:18.401120+0000","last_peered":"2023-09-28T04:23:18.401120+0000","last_clean":"2023-09-28T04:23:18.401120+0000","last_became_active":"2023-09-28T04:23:18.400230+0000","last_became_peered":"2023-09-28T04:23:18.400230+0000","last_unstale":"2023-09-28T04:23:18.401120+0000","last_undegraded":"2023-09-28T04:23:18.401120+0000","last_fullsized":"2023-09-28T04:23:18.401120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399068+0000","last_change":"2023-09-28T04:23:18.391683+0000","last_active":"2023-09-28T04:23:18.399068+0000","last_peered":"2023-09-28T04:23:18.399068+0000","last_clean":"2023-09-28T04:23:18.399068+0000","last_became_active":"2023-09-28T04:23:18.391373+0000","last_became_peered":"2023-09-28T04:23:18.391373+0000","last_unstale":"2023-09-28T04:23:18.399068+0000","last_undegraded":"2023-09-28T04:23:18.399068+0000","last_fullsized":"2023-09-28T04:23:18.399068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402238+0000","last_change":"2023-09-28T04:23:18.393381+0000","last_active":"2023-09-28T04:23:18.402238+0000","last_peered":"2023-09-28T04:23:18.402238+0000","last_clean":"2023-09-28T04:23:18.402238+0000","last_became_active":"2023-09-28T04:23:18.392723+0000","last_became_peered":"2023-09-28T04:23:18.392723+0000","last_unstale":"2023-09-28T04:23:18.402238+0000","last_undegraded":"2023-09-28T04:23:18.402238+0000","last_fullsized":"2023-09-28T04:23:18.402238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.403069+0000","last_change":"2023-09-28T04:23:18.402467+0000","last_active":"2023-09-28T04:23:18.403069+0000","last_peered":"2023-09-28T04:23:18.403069+0000","last_clean":"2023-09-28T04:23:18.403069+0000","last_became_active":"2023-09-28T04:23:18.402197+0000","last_became_peered":"2023-09-28T04:23:18.402197+0000","last_unstale":"2023-09-28T04:23:18.403069+0000","last_undegraded":"2023-09-28T04:23:18.403069+0000","last_fullsized":"2023-09-28T04:23:18.403069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.396757+0000","last_change":"2023-09-28T04:23:18.389242+0000","last_active":"2023-09-28T04:23:18.396757+0000","last_peered":"2023-09-28T04:23:18.396757+0000","last_clean":"2023-09-28T04:23:18.396757+0000","last_became_active":"2023-09-28T04:23:18.388936+0000","last_became_peered":"2023-09-28T04:23:18.388936+0000","last_unstale":"2023-09-28T04:23:18.396757+0000","last_undegraded":"2023-09-28T04:23:18.396757+0000","last_fullsized":"2023-09-28T04:23:18.396757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:19.108476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395209+0000","last_change":"2023-09-28T04:23:18.388941+0000","last_active":"2023-09-28T04:23:18.395209+0000","last_peered":"2023-09-28T04:23:18.395209+0000","last_clean":"2023-09-28T04:23:18.395209+0000","last_became_active":"2023-09-28T04:23:18.388682+0000","last_became_peered":"2023-09-28T04:23:18.388682+0000","last_unstale":"2023-09-28T04:23:18.395209+0000","last_undegraded":"2023-09-28T04:23:18.395209+0000","last_fullsized":"2023-09-28T04:23:18.395209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395293+0000","last_change":"2023-09-28T04:23:18.391753+0000","last_active":"2023-09-28T04:23:18.395293+0000","last_peered":"2023-09-28T04:23:18.395293+0000","last_clean":"2023-09-28T04:23:18.395293+0000","last_became_active":"2023-09-28T04:23:18.391031+0000","last_became_peered":"2023-09-28T04:23:18.391031+0000","last_unstale":"2023-09-28T04:23:18.395293+0000","last_undegraded":"2023-09-28T04:23:18.395293+0000","last_fullsized":"2023-09-28T04:23:18.395293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440177+0000","last_change":"2023-09-28T04:23:17.914158+0000","last_active":"2023-09-28T04:23:33.440177+0000","last_peered":"2023-09-28T04:23:33.440177+0000","last_clean":"2023-09-28T04:23:33.440177+0000","last_became_active":"2023-09-28T04:23:17.913941+0000","last_became_peered":"2023-09-28T04:23:17.913941+0000","last_unstale":"2023-09-28T04:23:33.440177+0000","last_undegraded":"2023-09-28T04:23:33.440177+0000","last_fullsized":"2023-09-28T04:23:33.440177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401811+0000","last_change":"2023-09-28T04:23:18.390288+0000","last_active":"2023-09-28T04:23:18.401811+0000","last_peered":"2023-09-28T04:23:18.401811+0000","last_clean":"2023-09-28T04:23:18.401811+0000","last_became_active":"2023-09-28T04:23:18.390030+0000","last_became_peered":"2023-09-28T04:23:18.390030+0000","last_unstale":"2023-09-28T04:23:18.401811+0000","last_undegraded":"2023-09-28T04:23:18.401811+0000","last_fullsized":"2023-09-28T04:23:18.401811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439320+0000","last_change":"2023-09-28T04:23:17.914311+0000","last_active":"2023-09-28T04:23:33.439320+0000","last_peered":"2023-09-28T04:23:33.439320+0000","last_clean":"2023-09-28T04:23:33.439320+0000","last_became_active":"2023-09-28T04:23:17.913950+0000","last_became_peered":"2023-09-28T04:23:17.913950+0000","last_unstale":"2023-09-28T04:23:33.439320+0000","last_undegraded":"2023-09-28T04:23:33.439320+0000","last_fullsized":"2023-09-28T04:23:33.439320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399162+0000","last_change":"2023-09-28T04:23:18.393402+0000","last_active":"2023-09-28T04:23:18.399162+0000","last_peered":"2023-09-28T04:23:18.399162+0000","last_clean":"2023-09-28T04:23:18.399162+0000","last_became_active":"2023-09-28T04:23:18.393106+0000","last_became_peered":"2023-09-28T04:23:18.393106+0000","last_unstale":"2023-09-28T04:23:18.399162+0000","last_undegraded":"2023-09-28T04:23:18.399162+0000","last_fullsized":"2023-09-28T04:23:18.399162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.375882+0000","last_change":"2023-09-28T04:23:17.911104+0000","last_active":"2023-09-28T04:23:19.375882+0000","last_peered":"2023-09-28T04:23:19.375882+0000","last_clean":"2023-09-28T04:23:19.375882+0000","last_became_active":"2023-09-28T04:23:17.910766+0000","last_became_peered":"2023-09-28T04:23:17.910766+0000","last_unstale":"2023-09-28T04:23:19.375882+0000","last_undegraded":"2023-09-28T04:23:19.375882+0000","last_fullsized":"2023-09-28T04:23:19.375882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391763+0000","last_change":"2023-09-28T04:23:18.388098+0000","last_active":"2023-09-28T04:23:18.391763+0000","last_peered":"2023-09-28T04:23:18.391763+0000","last_clean":"2023-09-28T04:23:18.391763+0000","last_became_active":"2023-09-28T04:23:18.387581+0000","last_became_peered":"2023-09-28T04:23:18.387581+0000","last_unstale":"2023-09-28T04:23:18.391763+0000","last_undegraded":"2023-09-28T04:23:18.391763+0000","last_fullsized":"2023-09-28T04:23:18.391763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:11.090984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.409275+0000","last_change":"2023-09-28T04:23:17.917921+0000","last_active":"2023-09-28T04:23:28.409275+0000","last_peered":"2023-09-28T04:23:28.409275+0000","last_clean":"2023-09-28T04:23:28.409275+0000","last_became_active":"2023-09-28T04:23:17.917596+0000","last_became_peered":"2023-09-28T04:23:17.917596+0000","last_unstale":"2023-09-28T04:23:28.409275+0000","last_undegraded":"2023-09-28T04:23:28.409275+0000","last_fullsized":"2023-09-28T04:23:28.409275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402470+0000","last_change":"2023-09-28T04:23:18.394460+0000","last_active":"2023-09-28T04:23:18.402470+0000","last_peered":"2023-09-28T04:23:18.402470+0000","last_clean":"2023-09-28T04:23:18.402470+0000","last_became_active":"2023-09-28T04:23:18.391773+0000","last_became_peered":"2023-09-28T04:23:18.391773+0000","last_unstale":"2023-09-28T04:23:18.402470+0000","last_undegraded":"2023-09-28T04:23:18.402470+0000","last_fullsized":"2023-09-28T04:23:18.402470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.408519+0000","last_change":"2023-09-28T04:23:17.908875+0000","last_active":"2023-09-28T04:23:28.408519+0000","last_peered":"2023-09-28T04:23:28.408519+0000","last_clean":"2023-09-28T04:23:28.408519+0000","last_became_active":"2023-09-28T04:23:17.908599+0000","last_became_peered":"2023-09-28T04:23:17.908599+0000","last_unstale":"2023-09-28T04:23:28.408519+0000","last_undegraded":"2023-09-28T04:23:28.408519+0000","last_fullsized":"2023-09-28T04:23:28.408519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402255+0000","last_change":"2023-09-28T04:23:18.393856+0000","last_active":"2023-09-28T04:23:18.402255+0000","last_peered":"2023-09-28T04:23:18.402255+0000","last_clean":"2023-09-28T04:23:18.402255+0000","last_became_active":"2023-09-28T04:23:18.393631+0000","last_became_peered":"2023-09-28T04:23:18.393631+0000","last_unstale":"2023-09-28T04:23:18.402255+0000","last_undegraded":"2023-09-28T04:23:18.402255+0000","last_fullsized":"2023-09-28T04:23:18.402255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.385554+0000","last_change":"2023-09-28T04:23:17.911594+0000","last_active":"2023-09-28T04:23:23.385554+0000","last_peered":"2023-09-28T04:23:23.385554+0000","last_clean":"2023-09-28T04:23:23.385554+0000","last_became_active":"2023-09-28T04:23:17.911361+0000","last_became_peered":"2023-09-28T04:23:17.911361+0000","last_unstale":"2023-09-28T04:23:23.385554+0000","last_undegraded":"2023-09-28T04:23:23.385554+0000","last_fullsized":"2023-09-28T04:23:23.385554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.394029+0000","last_change":"2023-09-28T04:23:18.387908+0000","last_active":"2023-09-28T04:23:18.394029+0000","last_peered":"2023-09-28T04:23:18.394029+0000","last_clean":"2023-09-28T04:23:18.394029+0000","last_became_active":"2023-09-28T04:23:18.387672+0000","last_became_peered":"2023-09-28T04:23:18.387672+0000","last_unstale":"2023-09-28T04:23:18.394029+0000","last_undegraded":"2023-09-28T04:23:18.394029+0000","last_fullsized":"2023-09-28T04:23:18.394029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.408892+0000","last_change":"2023-09-28T04:23:17.904974+0000","last_active":"2023-09-28T04:23:28.408892+0000","last_peered":"2023-09-28T04:23:28.408892+0000","last_clean":"2023-09-28T04:23:28.408892+0000","last_became_active":"2023-09-28T04:23:17.904734+0000","last_became_peered":"2023-09-28T04:23:17.904734+0000","last_unstale":"2023-09-28T04:23:28.408892+0000","last_undegraded":"2023-09-28T04:23:28.408892+0000","last_fullsized":"2023-09-28T04:23:28.408892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397872+0000","last_change":"2023-09-28T04:23:18.389128+0000","last_active":"2023-09-28T04:23:18.397872+0000","last_peered":"2023-09-28T04:23:18.397872+0000","last_clean":"2023-09-28T04:23:18.397872+0000","last_became_active":"2023-09-28T04:23:18.388871+0000","last_became_peered":"2023-09-28T04:23:18.388871+0000","last_unstale":"2023-09-28T04:23:18.397872+0000","last_undegraded":"2023-09-28T04:23:18.397872+0000","last_fullsized":"2023-09-28T04:23:18.397872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:33:50.957431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440656+0000","last_change":"2023-09-28T04:23:17.910343+0000","last_active":"2023-09-28T04:23:33.440656+0000","last_peered":"2023-09-28T04:23:33.440656+0000","last_clean":"2023-09-28T04:23:33.440656+0000","last_became_active":"2023-09-28T04:23:17.909981+0000","last_became_peered":"2023-09-28T04:23:17.909981+0000","last_unstale":"2023-09-28T04:23:33.440656+0000","last_undegraded":"2023-09-28T04:23:33.440656+0000","last_fullsized":"2023-09-28T04:23:33.440656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:11.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402619+0000","last_change":"2023-09-28T04:23:18.391696+0000","last_active":"2023-09-28T04:23:18.402619+0000","last_peered":"2023-09-28T04:23:18.402619+0000","last_clean":"2023-09-28T04:23:18.402619+0000","last_became_active":"2023-09-28T04:23:18.391441+0000","last_became_peered":"2023-09-28T04:23:18.391441+0000","last_unstale":"2023-09-28T04:23:18.402619+0000","last_undegraded":"2023-09-28T04:23:18.402619+0000","last_fullsized":"2023-09-28T04:23:18.402619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412822+0000","last_change":"2023-09-28T04:23:17.916730+0000","last_active":"2023-09-28T04:23:28.412822+0000","last_peered":"2023-09-28T04:23:28.412822+0000","last_clean":"2023-09-28T04:23:28.412822+0000","last_became_active":"2023-09-28T04:23:17.916424+0000","last_became_peered":"2023-09-28T04:23:17.916424+0000","last_unstale":"2023-09-28T04:23:28.412822+0000","last_undegraded":"2023-09-28T04:23:28.412822+0000","last_fullsized":"2023-09-28T04:23:28.412822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392344+0000","last_change":"2023-09-28T04:23:18.391510+0000","last_active":"2023-09-28T04:23:18.392344+0000","last_peered":"2023-09-28T04:23:18.392344+0000","last_clean":"2023-09-28T04:23:18.392344+0000","last_became_active":"2023-09-28T04:23:18.390613+0000","last_became_peered":"2023-09-28T04:23:18.390613+0000","last_unstale":"2023-09-28T04:23:18.392344+0000","last_undegraded":"2023-09-28T04:23:18.392344+0000","last_fullsized":"2023-09-28T04:23:18.392344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440750+0000","last_change":"2023-09-28T04:23:17.910760+0000","last_active":"2023-09-28T04:23:33.440750+0000","last_peered":"2023-09-28T04:23:33.440750+0000","last_clean":"2023-09-28T04:23:33.440750+0000","last_became_active":"2023-09-28T04:23:17.910457+0000","last_became_peered":"2023-09-28T04:23:17.910457+0000","last_unstale":"2023-09-28T04:23:33.440750+0000","last_undegraded":"2023-09-28T04:23:33.440750+0000","last_fullsized":"2023-09-28T04:23:33.440750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:10.087083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404516+0000","last_change":"2023-09-28T04:23:18.402823+0000","last_active":"2023-09-28T04:23:18.404516+0000","last_peered":"2023-09-28T04:23:18.404516+0000","last_clean":"2023-09-28T04:23:18.404516+0000","last_became_active":"2023-09-28T04:23:18.402559+0000","last_became_peered":"2023-09-28T04:23:18.402559+0000","last_unstale":"2023-09-28T04:23:18.404516+0000","last_undegraded":"2023-09-28T04:23:18.404516+0000","last_fullsized":"2023-09-28T04:23:18.404516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'15","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440298+0000","last_change":"2023-09-28T04:23:17.910972+0000","last_active":"2023-09-28T04:23:33.440298+0000","last_peered":"2023-09-28T04:23:33.440298+0000","last_clean":"2023-09-28T04:23:33.440298+0000","last_became_active":"2023-09-28T04:23:17.910650+0000","last_became_peered":"2023-09-28T04:23:17.910650+0000","last_unstale":"2023-09-28T04:23:33.440298+0000","last_undegraded":"2023-09-28T04:23:33.440298+0000","last_fullsized":"2023-09-28T04:23:33.440298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:03:36.553513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402556+0000","last_change":"2023-09-28T04:23:18.395424+0000","last_active":"2023-09-28T04:23:18.402556+0000","last_peered":"2023-09-28T04:23:18.402556+0000","last_clean":"2023-09-28T04:23:18.402556+0000","last_became_active":"2023-09-28T04:23:18.394721+0000","last_became_peered":"2023-09-28T04:23:18.394721+0000","last_unstale":"2023-09-28T04:23:18.402556+0000","last_undegraded":"2023-09-28T04:23:18.402556+0000","last_fullsized":"2023-09-28T04:23:18.402556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.385189+0000","last_change":"2023-09-28T04:23:17.907642+0000","last_active":"2023-09-28T04:23:23.385189+0000","last_peered":"2023-09-28T04:23:23.385189+0000","last_clean":"2023-09-28T04:23:23.385189+0000","last_became_active":"2023-09-28T04:23:17.907331+0000","last_became_peered":"2023-09-28T04:23:17.907331+0000","last_unstale":"2023-09-28T04:23:23.385189+0000","last_undegraded":"2023-09-28T04:23:23.385189+0000","last_fullsized":"2023-09-28T04:23:23.385189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.393277+0000","last_change":"2023-09-28T04:23:18.390910+0000","last_active":"2023-09-28T04:23:18.393277+0000","last_peered":"2023-09-28T04:23:18.393277+0000","last_clean":"2023-09-28T04:23:18.393277+0000","last_became_active":"2023-09-28T04:23:18.390633+0000","last_became_peered":"2023-09-28T04:23:18.390633+0000","last_unstale":"2023-09-28T04:23:18.393277+0000","last_undegraded":"2023-09-28T04:23:18.393277+0000","last_fullsized":"2023-09-28T04:23:18.393277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.383758+0000","last_change":"2023-09-28T04:23:17.906320+0000","last_active":"2023-09-28T04:23:23.383758+0000","last_peered":"2023-09-28T04:23:23.383758+0000","last_clean":"2023-09-28T04:23:23.383758+0000","last_became_active":"2023-09-28T04:23:17.906036+0000","last_became_peered":"2023-09-28T04:23:17.906036+0000","last_unstale":"2023-09-28T04:23:23.383758+0000","last_undegraded":"2023-09-28T04:23:23.383758+0000","last_fullsized":"2023-09-28T04:23:23.383758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397773+0000","last_change":"2023-09-28T04:23:18.386196+0000","last_active":"2023-09-28T04:23:18.397773+0000","last_peered":"2023-09-28T04:23:18.397773+0000","last_clean":"2023-09-28T04:23:18.397773+0000","last_became_active":"2023-09-28T04:23:18.385693+0000","last_became_peered":"2023-09-28T04:23:18.385693+0000","last_unstale":"2023-09-28T04:23:18.397773+0000","last_undegraded":"2023-09-28T04:23:18.397773+0000","last_fullsized":"2023-09-28T04:23:18.397773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172978+0000","last_change":"2023-09-28T04:23:17.908768+0000","last_active":"2023-09-28T04:23:20.172978+0000","last_peered":"2023-09-28T04:23:20.172978+0000","last_clean":"2023-09-28T04:23:20.172978+0000","last_became_active":"2023-09-28T04:23:17.908493+0000","last_became_peered":"2023-09-28T04:23:17.908493+0000","last_unstale":"2023-09-28T04:23:20.172978+0000","last_undegraded":"2023-09-28T04:23:20.172978+0000","last_fullsized":"2023-09-28T04:23:20.172978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388563+0000","last_change":"2023-09-28T04:23:18.385404+0000","last_active":"2023-09-28T04:23:18.388563+0000","last_peered":"2023-09-28T04:23:18.388563+0000","last_clean":"2023-09-28T04:23:18.388563+0000","last_became_active":"2023-09-28T04:23:18.385112+0000","last_became_peered":"2023-09-28T04:23:18.385112+0000","last_unstale":"2023-09-28T04:23:18.388563+0000","last_undegraded":"2023-09-28T04:23:18.388563+0000","last_fullsized":"2023-09-28T04:23:18.388563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:06.331056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439864+0000","last_change":"2023-09-28T04:23:17.898518+0000","last_active":"2023-09-28T04:23:33.439864+0000","last_peered":"2023-09-28T04:23:33.439864+0000","last_clean":"2023-09-28T04:23:33.439864+0000","last_became_active":"2023-09-28T04:23:17.898232+0000","last_became_peered":"2023-09-28T04:23:17.898232+0000","last_unstale":"2023-09-28T04:23:33.439864+0000","last_undegraded":"2023-09-28T04:23:33.439864+0000","last_fullsized":"2023-09-28T04:23:33.439864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399188+0000","last_change":"2023-09-28T04:23:18.392206+0000","last_active":"2023-09-28T04:23:18.399188+0000","last_peered":"2023-09-28T04:23:18.399188+0000","last_clean":"2023-09-28T04:23:18.399188+0000","last_became_active":"2023-09-28T04:23:18.391963+0000","last_became_peered":"2023-09-28T04:23:18.391963+0000","last_unstale":"2023-09-28T04:23:18.399188+0000","last_undegraded":"2023-09-28T04:23:18.399188+0000","last_fullsized":"2023-09-28T04:23:18.399188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.410038+0000","last_change":"2023-09-28T04:23:17.905390+0000","last_active":"2023-09-28T04:23:28.410038+0000","last_peered":"2023-09-28T04:23:28.410038+0000","last_clean":"2023-09-28T04:23:28.410038+0000","last_became_active":"2023-09-28T04:23:17.905089+0000","last_became_peered":"2023-09-28T04:23:17.905089+0000","last_unstale":"2023-09-28T04:23:28.410038+0000","last_undegraded":"2023-09-28T04:23:28.410038+0000","last_fullsized":"2023-09-28T04:23:28.410038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401474+0000","last_change":"2023-09-28T04:23:18.400110+0000","last_active":"2023-09-28T04:23:18.401474+0000","last_peered":"2023-09-28T04:23:18.401474+0000","last_clean":"2023-09-28T04:23:18.401474+0000","last_became_active":"2023-09-28T04:23:18.399839+0000","last_became_peered":"2023-09-28T04:23:18.399839+0000","last_unstale":"2023-09-28T04:23:18.401474+0000","last_undegraded":"2023-09-28T04:23:18.401474+0000","last_fullsized":"2023-09-28T04:23:18.401474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172225+0000","last_change":"2023-09-28T04:23:17.912734+0000","last_active":"2023-09-28T04:23:20.172225+0000","last_peered":"2023-09-28T04:23:20.172225+0000","last_clean":"2023-09-28T04:23:20.172225+0000","last_became_active":"2023-09-28T04:23:17.912560+0000","last_became_peered":"2023-09-28T04:23:17.912560+0000","last_unstale":"2023-09-28T04:23:20.172225+0000","last_undegraded":"2023-09-28T04:23:20.172225+0000","last_fullsized":"2023-09-28T04:23:20.172225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397919+0000","last_change":"2023-09-28T04:23:18.393554+0000","last_active":"2023-09-28T04:23:18.397919+0000","last_peered":"2023-09-28T04:23:18.397919+0000","last_clean":"2023-09-28T04:23:18.397919+0000","last_became_active":"2023-09-28T04:23:18.390268+0000","last_became_peered":"2023-09-28T04:23:18.390268+0000","last_unstale":"2023-09-28T04:23:18.397919+0000","last_undegraded":"2023-09-28T04:23:18.397919+0000","last_fullsized":"2023-09-28T04:23:18.397919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412334+0000","last_change":"2023-09-28T04:23:17.911218+0000","last_active":"2023-09-28T04:23:28.412334+0000","last_peered":"2023-09-28T04:23:28.412334+0000","last_clean":"2023-09-28T04:23:28.412334+0000","last_became_active":"2023-09-28T04:23:17.910887+0000","last_became_peered":"2023-09-28T04:23:17.910887+0000","last_unstale":"2023-09-28T04:23:28.412334+0000","last_undegraded":"2023-09-28T04:23:28.412334+0000","last_fullsized":"2023-09-28T04:23:28.412334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397818+0000","last_change":"2023-09-28T04:23:18.387932+0000","last_active":"2023-09-28T04:23:18.397818+0000","last_peered":"2023-09-28T04:23:18.397818+0000","last_clean":"2023-09-28T04:23:18.397818+0000","last_became_active":"2023-09-28T04:23:18.387667+0000","last_became_peered":"2023-09-28T04:23:18.387667+0000","last_unstale":"2023-09-28T04:23:18.397818+0000","last_undegraded":"2023-09-28T04:23:18.397818+0000","last_fullsized":"2023-09-28T04:23:18.397818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:46:23.383130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.410224+0000","last_change":"2023-09-28T04:23:17.911764+0000","last_active":"2023-09-28T04:23:28.410224+0000","last_peered":"2023-09-28T04:23:28.410224+0000","last_clean":"2023-09-28T04:23:28.410224+0000","last_became_active":"2023-09-28T04:23:17.911458+0000","last_became_peered":"2023-09-28T04:23:17.911458+0000","last_unstale":"2023-09-28T04:23:28.410224+0000","last_undegraded":"2023-09-28T04:23:28.410224+0000","last_fullsized":"2023-09-28T04:23:28.410224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402635+0000","last_change":"2023-09-28T04:23:18.400278+0000","last_active":"2023-09-28T04:23:18.402635+0000","last_peered":"2023-09-28T04:23:18.402635+0000","last_clean":"2023-09-28T04:23:18.402635+0000","last_became_active":"2023-09-28T04:23:18.399957+0000","last_became_peered":"2023-09-28T04:23:18.399957+0000","last_unstale":"2023-09-28T04:23:18.402635+0000","last_undegraded":"2023-09-28T04:23:18.402635+0000","last_fullsized":"2023-09-28T04:23:18.402635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:01:52.295558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377068+0000","last_change":"2023-09-28T04:23:13.017727+0000","last_active":"2023-09-28T04:23:18.377068+0000","last_peered":"2023-09-28T04:23:18.377068+0000","last_clean":"2023-09-28T04:23:18.377068+0000","last_became_active":"2023-09-28T04:23:13.017362+0000","last_became_peered":"2023-09-28T04:23:13.017362+0000","last_unstale":"2023-09-28T04:23:18.377068+0000","last_undegraded":"2023-09-28T04:23:18.377068+0000","last_fullsized":"2023-09-28T04:23:18.377068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376624+0000","last_change":"2023-09-28T04:23:17.899128+0000","last_active":"2023-09-28T04:23:19.376624+0000","last_peered":"2023-09-28T04:23:19.376624+0000","last_clean":"2023-09-28T04:23:19.376624+0000","last_became_active":"2023-09-28T04:23:17.898878+0000","last_became_peered":"2023-09-28T04:23:17.898878+0000","last_unstale":"2023-09-28T04:23:19.376624+0000","last_undegraded":"2023-09-28T04:23:19.376624+0000","last_fullsized":"2023-09-28T04:23:19.376624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388439+0000","last_change":"2023-09-28T04:23:18.384565+0000","last_active":"2023-09-28T04:23:18.388439+0000","last_peered":"2023-09-28T04:23:18.388439+0000","last_clean":"2023-09-28T04:23:18.388439+0000","last_became_active":"2023-09-28T04:23:18.383969+0000","last_became_peered":"2023-09-28T04:23:18.383969+0000","last_unstale":"2023-09-28T04:23:18.388439+0000","last_undegraded":"2023-09-28T04:23:18.388439+0000","last_fullsized":"2023-09-28T04:23:18.388439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379488+0000","last_change":"2023-09-28T04:23:12.604091+0000","last_active":"2023-09-28T04:23:18.379488+0000","last_peered":"2023-09-28T04:23:18.379488+0000","last_clean":"2023-09-28T04:23:18.379488+0000","last_became_active":"2023-09-28T04:23:12.603804+0000","last_became_peered":"2023-09-28T04:23:12.603804+0000","last_unstale":"2023-09-28T04:23:18.379488+0000","last_undegraded":"2023-09-28T04:23:18.379488+0000","last_fullsized":"2023-09-28T04:23:18.379488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412473+0000","last_change":"2023-09-28T04:23:17.918999+0000","last_active":"2023-09-28T04:23:28.412473+0000","last_peered":"2023-09-28T04:23:28.412473+0000","last_clean":"2023-09-28T04:23:28.412473+0000","last_became_active":"2023-09-28T04:23:17.918740+0000","last_became_peered":"2023-09-28T04:23:17.918740+0000","last_unstale":"2023-09-28T04:23:28.412473+0000","last_undegraded":"2023-09-28T04:23:28.412473+0000","last_fullsized":"2023-09-28T04:23:28.412473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395808+0000","last_change":"2023-09-28T04:23:18.389350+0000","last_active":"2023-09-28T04:23:18.395808+0000","last_peered":"2023-09-28T04:23:18.395808+0000","last_clean":"2023-09-28T04:23:18.395808+0000","last_became_active":"2023-09-28T04:23:18.389059+0000","last_became_peered":"2023-09-28T04:23:18.389059+0000","last_unstale":"2023-09-28T04:23:18.395808+0000","last_undegraded":"2023-09-28T04:23:18.395808+0000","last_fullsized":"2023-09-28T04:23:18.395808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378640+0000","last_change":"2023-09-28T04:23:12.602100+0000","last_active":"2023-09-28T04:23:18.378640+0000","last_peered":"2023-09-28T04:23:18.378640+0000","last_clean":"2023-09-28T04:23:18.378640+0000","last_became_active":"2023-09-28T04:23:12.601652+0000","last_became_peered":"2023-09-28T04:23:12.601652+0000","last_unstale":"2023-09-28T04:23:18.378640+0000","last_undegraded":"2023-09-28T04:23:18.378640+0000","last_fullsized":"2023-09-28T04:23:18.378640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:37:16.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.438991+0000","last_change":"2023-09-28T04:23:17.911566+0000","last_active":"2023-09-28T04:23:33.438991+0000","last_peered":"2023-09-28T04:23:33.438991+0000","last_clean":"2023-09-28T04:23:33.438991+0000","last_became_active":"2023-09-28T04:23:17.911308+0000","last_became_peered":"2023-09-28T04:23:17.911308+0000","last_unstale":"2023-09-28T04:23:33.438991+0000","last_undegraded":"2023-09-28T04:23:33.438991+0000","last_fullsized":"2023-09-28T04:23:33.438991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395489+0000","last_change":"2023-09-28T04:23:18.388204+0000","last_active":"2023-09-28T04:23:18.395489+0000","last_peered":"2023-09-28T04:23:18.395489+0000","last_clean":"2023-09-28T04:23:18.395489+0000","last_became_active":"2023-09-28T04:23:18.387945+0000","last_became_peered":"2023-09-28T04:23:18.387945+0000","last_unstale":"2023-09-28T04:23:18.395489+0000","last_undegraded":"2023-09-28T04:23:18.395489+0000","last_fullsized":"2023-09-28T04:23:18.395489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378668+0000","last_change":"2023-09-28T04:23:12.604212+0000","last_active":"2023-09-28T04:23:18.378668+0000","last_peered":"2023-09-28T04:23:18.378668+0000","last_clean":"2023-09-28T04:23:18.378668+0000","last_became_active":"2023-09-28T04:23:12.603930+0000","last_became_peered":"2023-09-28T04:23:12.603930+0000","last_unstale":"2023-09-28T04:23:18.378668+0000","last_undegraded":"2023-09-28T04:23:18.378668+0000","last_fullsized":"2023-09-28T04:23:18.378668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386718+0000","last_change":"2023-09-28T04:23:11.608534+0000","last_active":"2023-09-28T04:23:18.386718+0000","last_peered":"2023-09-28T04:23:18.386718+0000","last_clean":"2023-09-28T04:23:18.386718+0000","last_became_active":"2023-09-28T04:23:11.608249+0000","last_became_peered":"2023-09-28T04:23:11.608249+0000","last_unstale":"2023-09-28T04:23:18.386718+0000","last_undegraded":"2023-09-28T04:23:18.386718+0000","last_fullsized":"2023-09-28T04:23:18.386718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_clean_scrub_stamp":"2023-09-28T04:23:10.587579+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:10.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376259+0000","last_change":"2023-09-28T04:23:17.902709+0000","last_active":"2023-09-28T04:23:19.376259+0000","last_peered":"2023-09-28T04:23:19.376259+0000","last_clean":"2023-09-28T04:23:19.376259+0000","last_became_active":"2023-09-28T04:23:17.902341+0000","last_became_peered":"2023-09-28T04:23:17.902341+0000","last_unstale":"2023-09-28T04:23:19.376259+0000","last_undegraded":"2023-09-28T04:23:19.376259+0000","last_fullsized":"2023-09-28T04:23:19.376259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392913+0000","last_change":"2023-09-28T04:23:18.389982+0000","last_active":"2023-09-28T04:23:18.392913+0000","last_peered":"2023-09-28T04:23:18.392913+0000","last_clean":"2023-09-28T04:23:18.392913+0000","last_became_active":"2023-09-28T04:23:18.389692+0000","last_became_peered":"2023-09-28T04:23:18.389692+0000","last_unstale":"2023-09-28T04:23:18.392913+0000","last_undegraded":"2023-09-28T04:23:18.392913+0000","last_fullsized":"2023-09-28T04:23:18.392913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386996+0000","last_change":"2023-09-28T04:23:12.605908+0000","last_active":"2023-09-28T04:23:18.386996+0000","last_peered":"2023-09-28T04:23:18.386996+0000","last_clean":"2023-09-28T04:23:18.386996+0000","last_became_active":"2023-09-28T04:23:12.605668+0000","last_became_peered":"2023-09-28T04:23:12.605668+0000","last_unstale":"2023-09-28T04:23:18.386996+0000","last_undegraded":"2023-09-28T04:23:18.386996+0000","last_fullsized":"2023-09-28T04:23:18.386996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440738+0000","last_change":"2023-09-28T04:23:17.918410+0000","last_active":"2023-09-28T04:23:33.440738+0000","last_peered":"2023-09-28T04:23:33.440738+0000","last_clean":"2023-09-28T04:23:33.440738+0000","last_became_active":"2023-09-28T04:23:17.918130+0000","last_became_peered":"2023-09-28T04:23:17.918130+0000","last_unstale":"2023-09-28T04:23:33.440738+0000","last_undegraded":"2023-09-28T04:23:33.440738+0000","last_fullsized":"2023-09-28T04:23:33.440738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399143+0000","last_change":"2023-09-28T04:23:18.391987+0000","last_active":"2023-09-28T04:23:18.399143+0000","last_peered":"2023-09-28T04:23:18.399143+0000","last_clean":"2023-09-28T04:23:18.399143+0000","last_became_active":"2023-09-28T04:23:18.391709+0000","last_became_peered":"2023-09-28T04:23:18.391709+0000","last_unstale":"2023-09-28T04:23:18.399143+0000","last_undegraded":"2023-09-28T04:23:18.399143+0000","last_fullsized":"2023-09-28T04:23:18.399143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386509+0000","last_change":"2023-09-28T04:23:13.017715+0000","last_active":"2023-09-28T04:23:18.386509+0000","last_peered":"2023-09-28T04:23:18.386509+0000","last_clean":"2023-09-28T04:23:18.386509+0000","last_became_active":"2023-09-28T04:23:13.017398+0000","last_became_peered":"2023-09-28T04:23:13.017398+0000","last_unstale":"2023-09-28T04:23:18.386509+0000","last_undegraded":"2023-09-28T04:23:18.386509+0000","last_fullsized":"2023-09-28T04:23:18.386509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:37:41.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377174+0000","last_change":"2023-09-28T04:23:17.912291+0000","last_active":"2023-09-28T04:23:18.377174+0000","last_peered":"2023-09-28T04:23:18.377174+0000","last_clean":"2023-09-28T04:23:18.377174+0000","last_became_active":"2023-09-28T04:23:17.912023+0000","last_became_peered":"2023-09-28T04:23:17.912023+0000","last_unstale":"2023-09-28T04:23:18.377174+0000","last_undegraded":"2023-09-28T04:23:18.377174+0000","last_fullsized":"2023-09-28T04:23:18.377174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399280+0000","last_change":"2023-09-28T04:23:18.396451+0000","last_active":"2023-09-28T04:23:18.399280+0000","last_peered":"2023-09-28T04:23:18.399280+0000","last_clean":"2023-09-28T04:23:18.399280+0000","last_became_active":"2023-09-28T04:23:18.396190+0000","last_became_peered":"2023-09-28T04:23:18.396190+0000","last_unstale":"2023-09-28T04:23:18.399280+0000","last_undegraded":"2023-09-28T04:23:18.399280+0000","last_fullsized":"2023-09-28T04:23:18.399280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.408972+0000","last_change":"2023-09-28T04:23:17.904739+0000","last_active":"2023-09-28T04:23:28.408972+0000","last_peered":"2023-09-28T04:23:28.408972+0000","last_clean":"2023-09-28T04:23:28.408972+0000","last_became_active":"2023-09-28T04:23:17.903844+0000","last_became_peered":"2023-09-28T04:23:17.903844+0000","last_unstale":"2023-09-28T04:23:28.408972+0000","last_undegraded":"2023-09-28T04:23:28.408972+0000","last_fullsized":"2023-09-28T04:23:28.408972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377634+0000","last_change":"2023-09-28T04:23:12.606496+0000","last_active":"2023-09-28T04:23:18.377634+0000","last_peered":"2023-09-28T04:23:18.377634+0000","last_clean":"2023-09-28T04:23:18.377634+0000","last_became_active":"2023-09-28T04:23:12.606143+0000","last_became_peered":"2023-09-28T04:23:12.606143+0000","last_unstale":"2023-09-28T04:23:18.377634+0000","last_undegraded":"2023-09-28T04:23:18.377634+0000","last_fullsized":"2023-09-28T04:23:18.377634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402487+0000","last_change":"2023-09-28T04:23:18.396153+0000","last_active":"2023-09-28T04:23:18.402487+0000","last_peered":"2023-09-28T04:23:18.402487+0000","last_clean":"2023-09-28T04:23:18.402487+0000","last_became_active":"2023-09-28T04:23:18.392092+0000","last_became_peered":"2023-09-28T04:23:18.392092+0000","last_unstale":"2023-09-28T04:23:18.402487+0000","last_undegraded":"2023-09-28T04:23:18.402487+0000","last_fullsized":"2023-09-28T04:23:18.402487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379277+0000","last_change":"2023-09-28T04:23:12.606390+0000","last_active":"2023-09-28T04:23:18.379277+0000","last_peered":"2023-09-28T04:23:18.379277+0000","last_clean":"2023-09-28T04:23:18.379277+0000","last_became_active":"2023-09-28T04:23:12.605965+0000","last_became_peered":"2023-09-28T04:23:12.605965+0000","last_unstale":"2023-09-28T04:23:18.379277+0000","last_undegraded":"2023-09-28T04:23:18.379277+0000","last_fullsized":"2023-09-28T04:23:18.379277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:11.833839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439531+0000","last_change":"2023-09-28T04:23:17.915114+0000","last_active":"2023-09-28T04:23:33.439531+0000","last_peered":"2023-09-28T04:23:33.439531+0000","last_clean":"2023-09-28T04:23:33.439531+0000","last_became_active":"2023-09-28T04:23:17.914697+0000","last_became_peered":"2023-09-28T04:23:17.914697+0000","last_unstale":"2023-09-28T04:23:33.439531+0000","last_undegraded":"2023-09-28T04:23:33.439531+0000","last_fullsized":"2023-09-28T04:23:33.439531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397753+0000","last_change":"2023-09-28T04:23:18.386681+0000","last_active":"2023-09-28T04:23:18.397753+0000","last_peered":"2023-09-28T04:23:18.397753+0000","last_clean":"2023-09-28T04:23:18.397753+0000","last_became_active":"2023-09-28T04:23:18.386380+0000","last_became_peered":"2023-09-28T04:23:18.386380+0000","last_unstale":"2023-09-28T04:23:18.397753+0000","last_undegraded":"2023-09-28T04:23:18.397753+0000","last_fullsized":"2023-09-28T04:23:18.397753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"21'5","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412964+0000","last_change":"2023-09-28T04:23:17.918404+0000","last_active":"2023-09-28T04:23:28.412964+0000","last_peered":"2023-09-28T04:23:28.412964+0000","last_clean":"2023-09-28T04:23:28.412964+0000","last_became_active":"2023-09-28T04:23:17.918116+0000","last_became_peered":"2023-09-28T04:23:17.918116+0000","last_unstale":"2023-09-28T04:23:28.412964+0000","last_undegraded":"2023-09-28T04:23:28.412964+0000","last_fullsized":"2023-09-28T04:23:28.412964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390737+0000","last_change":"2023-09-28T04:23:18.385213+0000","last_active":"2023-09-28T04:23:18.390737+0000","last_peered":"2023-09-28T04:23:18.390737+0000","last_clean":"2023-09-28T04:23:18.390737+0000","last_became_active":"2023-09-28T04:23:18.384930+0000","last_became_peered":"2023-09-28T04:23:18.384930+0000","last_unstale":"2023-09-28T04:23:18.390737+0000","last_undegraded":"2023-09-28T04:23:18.390737+0000","last_fullsized":"2023-09-28T04:23:18.390737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:06.681805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.384054+0000","last_change":"2023-09-28T04:23:17.905986+0000","last_active":"2023-09-28T04:23:23.384054+0000","last_peered":"2023-09-28T04:23:23.384054+0000","last_clean":"2023-09-28T04:23:23.384054+0000","last_became_active":"2023-09-28T04:23:17.905667+0000","last_became_peered":"2023-09-28T04:23:17.905667+0000","last_unstale":"2023-09-28T04:23:23.384054+0000","last_undegraded":"2023-09-28T04:23:23.384054+0000","last_fullsized":"2023-09-28T04:23:23.384054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402551+0000","last_change":"2023-09-28T04:23:18.400970+0000","last_active":"2023-09-28T04:23:18.402551+0000","last_peered":"2023-09-28T04:23:18.402551+0000","last_clean":"2023-09-28T04:23:18.402551+0000","last_became_active":"2023-09-28T04:23:18.400683+0000","last_became_peered":"2023-09-28T04:23:18.400683+0000","last_unstale":"2023-09-28T04:23:18.402551+0000","last_undegraded":"2023-09-28T04:23:18.402551+0000","last_fullsized":"2023-09-28T04:23:18.402551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:59:30.982762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440021+0000","last_change":"2023-09-28T04:23:17.905162+0000","last_active":"2023-09-28T04:23:33.440021+0000","last_peered":"2023-09-28T04:23:33.440021+0000","last_clean":"2023-09-28T04:23:33.440021+0000","last_became_active":"2023-09-28T04:23:17.904895+0000","last_became_peered":"2023-09-28T04:23:17.904895+0000","last_unstale":"2023-09-28T04:23:33.440021+0000","last_undegraded":"2023-09-28T04:23:33.440021+0000","last_fullsized":"2023-09-28T04:23:33.440021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402543+0000","last_change":"2023-09-28T04:23:18.400714+0000","last_active":"2023-09-28T04:23:18.402543+0000","last_peered":"2023-09-28T04:23:18.402543+0000","last_clean":"2023-09-28T04:23:18.402543+0000","last_became_active":"2023-09-28T04:23:18.400410+0000","last_became_peered":"2023-09-28T04:23:18.400410+0000","last_unstale":"2023-09-28T04:23:18.402543+0000","last_undegraded":"2023-09-28T04:23:18.402543+0000","last_fullsized":"2023-09-28T04:23:18.402543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:43:02.603601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.384516+0000","last_change":"2023-09-28T04:23:17.905493+0000","last_active":"2023-09-28T04:23:23.384516+0000","last_peered":"2023-09-28T04:23:23.384516+0000","last_clean":"2023-09-28T04:23:23.384516+0000","last_became_active":"2023-09-28T04:23:17.905198+0000","last_became_peered":"2023-09-28T04:23:17.905198+0000","last_unstale":"2023-09-28T04:23:23.384516+0000","last_undegraded":"2023-09-28T04:23:23.384516+0000","last_fullsized":"2023-09-28T04:23:23.384516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402220+0000","last_change":"2023-09-28T04:23:18.393194+0000","last_active":"2023-09-28T04:23:18.402220+0000","last_peered":"2023-09-28T04:23:18.402220+0000","last_clean":"2023-09-28T04:23:18.402220+0000","last_became_active":"2023-09-28T04:23:18.392400+0000","last_became_peered":"2023-09-28T04:23:18.392400+0000","last_unstale":"2023-09-28T04:23:18.402220+0000","last_undegraded":"2023-09-28T04:23:18.402220+0000","last_fullsized":"2023-09-28T04:23:18.402220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'9","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.438960+0000","last_change":"2023-09-28T04:23:17.917604+0000","last_active":"2023-09-28T04:23:33.438960+0000","last_peered":"2023-09-28T04:23:33.438960+0000","last_clean":"2023-09-28T04:23:33.438960+0000","last_became_active":"2023-09-28T04:23:17.917266+0000","last_became_peered":"2023-09-28T04:23:17.917266+0000","last_unstale":"2023-09-28T04:23:33.438960+0000","last_undegraded":"2023-09-28T04:23:33.438960+0000","last_fullsized":"2023-09-28T04:23:33.438960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395284+0000","last_change":"2023-09-28T04:23:18.386391+0000","last_active":"2023-09-28T04:23:18.395284+0000","last_peered":"2023-09-28T04:23:18.395284+0000","last_clean":"2023-09-28T04:23:18.395284+0000","last_became_active":"2023-09-28T04:23:18.386051+0000","last_became_peered":"2023-09-28T04:23:18.386051+0000","last_unstale":"2023-09-28T04:23:18.395284+0000","last_undegraded":"2023-09-28T04:23:18.395284+0000","last_fullsized":"2023-09-28T04:23:18.395284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392882+0000","last_change":"2023-09-28T04:23:18.389600+0000","last_active":"2023-09-28T04:23:18.392882+0000","last_peered":"2023-09-28T04:23:18.392882+0000","last_clean":"2023-09-28T04:23:18.392882+0000","last_became_active":"2023-09-28T04:23:18.389280+0000","last_became_peered":"2023-09-28T04:23:18.389280+0000","last_unstale":"2023-09-28T04:23:18.392882+0000","last_undegraded":"2023-09-28T04:23:18.392882+0000","last_fullsized":"2023-09-28T04:23:18.392882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:47.697305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402201+0000","last_change":"2023-09-28T04:23:18.392980+0000","last_active":"2023-09-28T04:23:18.402201+0000","last_peered":"2023-09-28T04:23:18.402201+0000","last_clean":"2023-09-28T04:23:18.402201+0000","last_became_active":"2023-09-28T04:23:18.390929+0000","last_became_peered":"2023-09-28T04:23:18.390929+0000","last_unstale":"2023-09-28T04:23:18.402201+0000","last_undegraded":"2023-09-28T04:23:18.402201+0000","last_fullsized":"2023-09-28T04:23:18.402201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397834+0000","last_change":"2023-09-28T04:23:18.387348+0000","last_active":"2023-09-28T04:23:18.397834+0000","last_peered":"2023-09-28T04:23:18.397834+0000","last_clean":"2023-09-28T04:23:18.397834+0000","last_became_active":"2023-09-28T04:23:18.385870+0000","last_became_peered":"2023-09-28T04:23:18.385870+0000","last_unstale":"2023-09-28T04:23:18.397834+0000","last_undegraded":"2023-09-28T04:23:18.397834+0000","last_fullsized":"2023-09-28T04:23:18.397834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:29:04.985060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402660+0000","last_change":"2023-09-28T04:23:18.392534+0000","last_active":"2023-09-28T04:23:18.402660+0000","last_peered":"2023-09-28T04:23:18.402660+0000","last_clean":"2023-09-28T04:23:18.402660+0000","last_became_active":"2023-09-28T04:23:18.392245+0000","last_became_peered":"2023-09-28T04:23:18.392245+0000","last_unstale":"2023-09-28T04:23:18.402660+0000","last_undegraded":"2023-09-28T04:23:18.402660+0000","last_fullsized":"2023-09-28T04:23:18.402660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395827+0000","last_change":"2023-09-28T04:23:18.391490+0000","last_active":"2023-09-28T04:23:18.395827+0000","last_peered":"2023-09-28T04:23:18.395827+0000","last_clean":"2023-09-28T04:23:18.395827+0000","last_became_active":"2023-09-28T04:23:18.391256+0000","last_became_peered":"2023-09-28T04:23:18.391256+0000","last_unstale":"2023-09-28T04:23:18.395827+0000","last_undegraded":"2023-09-28T04:23:18.395827+0000","last_fullsized":"2023-09-28T04:23:18.395827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:28:43.639301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4966,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":9932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8960,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362880,"statfs":{"total":96636764160,"available":96627589120,"internally_reserved":0,"allocated":319488,"data_stored":672443,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8356,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363484,"statfs":{"total":96636764160,"available":96628207616,"internally_reserved":0,"allocated":225280,"data_stored":79341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8412,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363428,"statfs":{"total":96636764160,"available":96628150272,"internally_reserved":0,"allocated":217088,"data_stored":79229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9020,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362820,"statfs":{"total":96636764160,"available":96627527680,"internally_reserved":0,"allocated":315392,"data_stored":671051,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8352,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363488,"statfs":{"total":96636764160,"available":96628211712,"internally_reserved":0,"allocated":221184,"data_stored":79319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8428,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363412,"statfs":{"total":96636764160,"available":96628133888,"internally_reserved":0,"allocated":233472,"data_stored":80449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8520,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363320,"statfs":{"total":96636764160,"available":96628039680,"internally_reserved":0,"allocated":262144,"data_stored":82149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8432,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363408,"statfs":{"total":96636764160,"available":96628129792,"internally_reserved":0,"allocated":237568,"data_stored":80519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T04:23:42.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T04:23:43.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.032+0000 7fdbe3bff700 1 Processor -- start 2023-09-28T04:23:43.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.032+0000 7fdbe3bff700 1 -- start start 2023-09-28T04:23:43.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.033+0000 7fdbe3bff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdbdc089830 0x7fdbdc1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.033+0000 7fdbe3bff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc0c7980 con 0x7fdbdc14f9f0 2023-09-28T04:23:43.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.033+0000 7fdbe3bff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc0ccbc0 con 0x7fdbdc0adf10 2023-09-28T04:23:43.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.033+0000 7fdbe3bff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbdc0cce60 con 0x7fdbdc089830 2023-09-28T04:23:43.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.034+0000 7fdbe119a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fdbdc14f9f0 0x7fdbdc0c7e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45970/0 (socket says 172.21.15.118:45970) 2023-09-28T04:23:43.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.034+0000 7fdbe119a700 1 -- 172.21.15.118:0/3416727956 learned_addr learned my addr 172.21.15.118:0/3416727956 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:43.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.034+0000 7fdbe219c700 1 --2- 172.21.15.118:0/3416727956 >> v2:172.21.15.174:3300/0 conn(0x7fdbdc089830 0x7fdbdc1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.034+0000 7fdbe0999700 1 -- 172.21.15.118:0/3416727956 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225615732 0 0) 0x7fdbdc0c7980 con 0x7fdbdc14f9f0 2023-09-28T04:23:43.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.034+0000 7fdbe0999700 1 -- 172.21.15.118:0/3416727956 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc8003570 con 0x7fdbdc14f9f0 2023-09-28T04:23:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.034+0000 7fdbe0999700 1 -- 172.21.15.118:0/3416727956 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075160860 0 0) 0x7fdbdc0ccbc0 con 0x7fdbdc0adf10 2023-09-28T04:23:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.034+0000 7fdbe0999700 1 -- 172.21.15.118:0/3416727956 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbdc0c7980 con 0x7fdbdc0adf10 2023-09-28T04:23:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.034+0000 7fdbe219c700 1 -- 172.21.15.118:0/3416727956 >> v1:172.21.15.174:6789/0 conn(0x7fdbdc0adf10 legacy=0x7fdbdc14f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.034+0000 7fdbe219c700 1 -- 172.21.15.118:0/3416727956 >> v1:172.21.15.118:6789/0 conn(0x7fdbdc14f9f0 legacy=0x7fdbdc0c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.034+0000 7fdbe219c700 1 -- 172.21.15.118:0/3416727956 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc0c7020 con 0x7fdbdc089830 2023-09-28T04:23:43.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.034+0000 7fdbe219c700 1 --2- 172.21.15.118:0/3416727956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbdc089830 0x7fdbdc1562b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009e60 tx=0x7fdbd4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33891bed0eed11ab server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:43.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.035+0000 7fdbe0999700 1 -- 172.21.15.118:0/3416727956 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400e070 con 0x7fdbdc089830 2023-09-28T04:23:43.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.035+0000 7fdbe0999700 1 -- 172.21.15.118:0/3416727956 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd400bab0 con 0x7fdbdc089830 2023-09-28T04:23:43.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.035+0000 7fdbe0999700 1 -- 172.21.15.118:0/3416727956 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400be70 con 0x7fdbdc089830 2023-09-28T04:23:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.035+0000 7fdbe3bff700 1 -- 172.21.15.118:0/3416727956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbdc089830 msgr2=0x7fdbdc1562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.035+0000 7fdbe3bff700 1 --2- 172.21.15.118:0/3416727956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbdc089830 0x7fdbdc1562b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009e60 tx=0x7fdbd4009780 comp rx=0 tx=0).stop 2023-09-28T04:23:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.035+0000 7fdbe3bff700 1 -- 172.21.15.118:0/3416727956 shutdown_connections 2023-09-28T04:23:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.035+0000 7fdbe3bff700 1 --2- 172.21.15.118:0/3416727956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbdc089830 0x7fdbdc1562b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.035+0000 7fdbe3bff700 1 -- 172.21.15.118:0/3416727956 >> 172.21.15.118:0/3416727956 conn(0x7fdbdc063cc0 msgr2=0x7fdbdc0cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:43.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.035+0000 7fdbe3bff700 1 -- 172.21.15.118:0/3416727956 shutdown_connections 2023-09-28T04:23:43.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.035+0000 7fdbe3bff700 1 -- 172.21.15.118:0/3416727956 wait complete. 2023-09-28T04:23:43.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.037+0000 7fdbe3bff700 1 Processor -- start 2023-09-28T04:23:43.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.037+0000 7fdbe3bff700 1 -- start start 2023-09-28T04:23:43.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe3bff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbdc089830 0x7fdbdc1502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe3bff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbdc0adf10 0x7fdbdc0b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe3bff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbdc14f9f0 0x7fdbdc0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe3bff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0c75e0 con 0x7fdbdc0adf10 2023-09-28T04:23:43.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe3bff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0afd00 con 0x7fdbdc14f9f0 2023-09-28T04:23:43.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe3bff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc152450 con 0x7fdbdc089830 2023-09-28T04:23:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe119a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbdc0adf10 0x7fdbdc0b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe119a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbdc0adf10 0x7fdbdc0b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54542/0 (socket says 172.21.15.118:54542) 2023-09-28T04:23:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe119a700 1 -- 172.21.15.118:0/1673622795 learned_addr learned my addr 172.21.15.118:0/1673622795 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe219c700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbdc14f9f0 0x7fdbdc0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe199b700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbdc089830 0x7fdbdc1502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe119a700 1 -- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbdc089830 msgr2=0x7fdbdc1502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe119a700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbdc089830 0x7fdbdc1502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe119a700 1 -- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbdc14f9f0 msgr2=0x7fdbdc0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe119a700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbdc14f9f0 0x7fdbdc0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.038+0000 7fdbe119a700 1 -- 172.21.15.118:0/1673622795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd4009a20 con 0x7fdbdc0adf10 2023-09-28T04:23:43.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.039+0000 7fdbe119a700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbdc0adf10 0x7fdbdc0b0150 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00c790 tx=0x7fdbcc007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:43.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.039+0000 7fdbd1ffb700 1 -- 172.21.15.118:0/1673622795 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc005b30 con 0x7fdbdc0adf10 2023-09-28T04:23:43.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.039+0000 7fdbd1ffb700 1 -- 172.21.15.118:0/1673622795 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc005c90 con 0x7fdbdc0adf10 2023-09-28T04:23:43.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.039+0000 7fdbd1ffb700 1 -- 172.21.15.118:0/1673622795 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0072e0 con 0x7fdbdc0adf10 2023-09-28T04:23:43.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.039+0000 7fdbe3bff700 1 -- 172.21.15.118:0/1673622795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbdc0cb080 con 0x7fdbdc0adf10 2023-09-28T04:23:43.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.039+0000 7fdbe3bff700 1 -- 172.21.15.118:0/1673622795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc0cb640 con 0x7fdbdc0adf10 2023-09-28T04:23:43.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.040+0000 7fdbe3bff700 1 -- 172.21.15.118:0/1673622795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc071980 con 0x7fdbdc0adf10 2023-09-28T04:23:43.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.041+0000 7fdbd1ffb700 1 -- 172.21.15.118:0/1673622795 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdbcc01b3b0 con 0x7fdbdc0adf10 2023-09-28T04:23:43.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.042+0000 7fdbd1ffb700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdbc0067330 0x7fdbc00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.042+0000 7fdbd1ffb700 1 -- 172.21.15.118:0/1673622795 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdbcc083ff0 con 0x7fdbdc0adf10 2023-09-28T04:23:43.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.042+0000 7fdbe199b700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdbc0067330 0x7fdbc00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.043+0000 7fdbe199b700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdbc0067330 0x7fdbc00697e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8007fd0 tx=0x7fdbd8007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:43.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.046+0000 7fdbd1ffb700 1 -- 172.21.15.118:0/1673622795 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdbcc04b570 con 0x7fdbdc0adf10 2023-09-28T04:23:43.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.231+0000 7fdbe3bff700 1 -- 172.21.15.118:0/1673622795 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbdc068970 con 0x7fdbc0067330 2023-09-28T04:23:43.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.240+0000 7fdbd1ffb700 1 -- 172.21.15.118:0/1673622795 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284733 (secure 0 0 0) 0x7fdbdc068970 con 0x7fdbc0067330 2023-09-28T04:23:43.244 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:43.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.244+0000 7fdbe3bff700 1 -- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdbc0067330 msgr2=0x7fdbc00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.244+0000 7fdbe3bff700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdbc0067330 0x7fdbc00697e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8007fd0 tx=0x7fdbd8007d10 comp rx=0 tx=0).stop 2023-09-28T04:23:43.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.244+0000 7fdbe3bff700 1 -- 172.21.15.118:0/1673622795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbdc0adf10 msgr2=0x7fdbdc0b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.244+0000 7fdbe3bff700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbdc0adf10 0x7fdbdc0b0150 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00c790 tx=0x7fdbcc007e40 comp rx=0 tx=0).stop 2023-09-28T04:23:43.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.244+0000 7fdbe3bff700 1 -- 172.21.15.118:0/1673622795 shutdown_connections 2023-09-28T04:23:43.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.244+0000 7fdbe3bff700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdbc0067330 0x7fdbc00697e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.244+0000 7fdbe3bff700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbdc14f9f0 0x7fdbdc0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.244+0000 7fdbe3bff700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbdc089830 0x7fdbdc1502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.244+0000 7fdbe3bff700 1 --2- 172.21.15.118:0/1673622795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbdc0adf10 0x7fdbdc0b0150 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.244+0000 7fdbe3bff700 1 -- 172.21.15.118:0/1673622795 >> 172.21.15.118:0/1673622795 conn(0x7fdbdc063cc0 msgr2=0x7fdbdc14c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:43.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.244+0000 7fdbe3bff700 1 -- 172.21.15.118:0/1673622795 shutdown_connections 2023-09-28T04:23:43.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.244+0000 7fdbe3bff700 1 -- 172.21.15.118:0/1673622795 wait complete. 2023-09-28T04:23:43.249 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-09-28T04:23:43.261 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-09-28T04:23:42.531483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595334,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":284,"num_write_kb":2451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68480,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":66432,"kb_avail":754906240,"statfs":{"total":773094113280,"available":773023989760,"internally_reserved":0,"allocated":2031616,"data_stored":1824500,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68026368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1330,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003699"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401799+0000","last_change":"2023-09-28T04:23:18.400475+0000","last_active":"2023-09-28T04:23:18.401799+0000","last_peered":"2023-09-28T04:23:18.401799+0000","last_clean":"2023-09-28T04:23:18.401799+0000","last_became_active":"2023-09-28T04:23:18.400107+0000","last_became_peered":"2023-09-28T04:23:18.400107+0000","last_unstale":"2023-09-28T04:23:18.401799+0000","last_undegraded":"2023-09-28T04:23:18.401799+0000","last_fullsized":"2023-09-28T04:23:18.401799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:44.340279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391569+0000","last_change":"2023-09-28T04:23:18.385136+0000","last_active":"2023-09-28T04:23:18.391569+0000","last_peered":"2023-09-28T04:23:18.391569+0000","last_clean":"2023-09-28T04:23:18.391569+0000","last_became_active":"2023-09-28T04:23:18.384789+0000","last_became_peered":"2023-09-28T04:23:18.384789+0000","last_unstale":"2023-09-28T04:23:18.391569+0000","last_undegraded":"2023-09-28T04:23:18.391569+0000","last_fullsized":"2023-09-28T04:23:18.391569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397939+0000","last_change":"2023-09-28T04:23:18.393700+0000","last_active":"2023-09-28T04:23:18.397939+0000","last_peered":"2023-09-28T04:23:18.397939+0000","last_clean":"2023-09-28T04:23:18.397939+0000","last_became_active":"2023-09-28T04:23:18.390599+0000","last_became_peered":"2023-09-28T04:23:18.390599+0000","last_unstale":"2023-09-28T04:23:18.397939+0000","last_undegraded":"2023-09-28T04:23:18.397939+0000","last_fullsized":"2023-09-28T04:23:18.397939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:43:19.782618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392953+0000","last_change":"2023-09-28T04:23:18.390865+0000","last_active":"2023-09-28T04:23:18.392953+0000","last_peered":"2023-09-28T04:23:18.392953+0000","last_clean":"2023-09-28T04:23:18.392953+0000","last_became_active":"2023-09-28T04:23:18.390607+0000","last_became_peered":"2023-09-28T04:23:18.390607+0000","last_unstale":"2023-09-28T04:23:18.392953+0000","last_undegraded":"2023-09-28T04:23:18.392953+0000","last_fullsized":"2023-09-28T04:23:18.392953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.405585+0000","last_change":"2023-09-28T04:23:18.404215+0000","last_active":"2023-09-28T04:23:18.405585+0000","last_peered":"2023-09-28T04:23:18.405585+0000","last_clean":"2023-09-28T04:23:18.405585+0000","last_became_active":"2023-09-28T04:23:18.403960+0000","last_became_peered":"2023-09-28T04:23:18.403960+0000","last_unstale":"2023-09-28T04:23:18.405585+0000","last_undegraded":"2023-09-28T04:23:18.405585+0000","last_fullsized":"2023-09-28T04:23:18.405585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397969+0000","last_change":"2023-09-28T04:23:18.393987+0000","last_active":"2023-09-28T04:23:18.397969+0000","last_peered":"2023-09-28T04:23:18.397969+0000","last_clean":"2023-09-28T04:23:18.397969+0000","last_became_active":"2023-09-28T04:23:18.390575+0000","last_became_peered":"2023-09-28T04:23:18.390575+0000","last_unstale":"2023-09-28T04:23:18.397969+0000","last_undegraded":"2023-09-28T04:23:18.397969+0000","last_fullsized":"2023-09-28T04:23:18.397969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:24:51.659204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400984+0000","last_change":"2023-09-28T04:23:18.396733+0000","last_active":"2023-09-28T04:23:18.400984+0000","last_peered":"2023-09-28T04:23:18.400984+0000","last_clean":"2023-09-28T04:23:18.400984+0000","last_became_active":"2023-09-28T04:23:18.396038+0000","last_became_peered":"2023-09-28T04:23:18.396038+0000","last_unstale":"2023-09-28T04:23:18.400984+0000","last_undegraded":"2023-09-28T04:23:18.400984+0000","last_fullsized":"2023-09-28T04:23:18.400984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391542+0000","last_change":"2023-09-28T04:23:18.388208+0000","last_active":"2023-09-28T04:23:18.391542+0000","last_peered":"2023-09-28T04:23:18.391542+0000","last_clean":"2023-09-28T04:23:18.391542+0000","last_became_active":"2023-09-28T04:23:18.387260+0000","last_became_peered":"2023-09-28T04:23:18.387260+0000","last_unstale":"2023-09-28T04:23:18.391542+0000","last_undegraded":"2023-09-28T04:23:18.391542+0000","last_fullsized":"2023-09-28T04:23:18.391542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.405212+0000","last_change":"2023-09-28T04:23:18.403803+0000","last_active":"2023-09-28T04:23:18.405212+0000","last_peered":"2023-09-28T04:23:18.405212+0000","last_clean":"2023-09-28T04:23:18.405212+0000","last_became_active":"2023-09-28T04:23:18.403565+0000","last_became_peered":"2023-09-28T04:23:18.403565+0000","last_unstale":"2023-09-28T04:23:18.405212+0000","last_undegraded":"2023-09-28T04:23:18.405212+0000","last_fullsized":"2023-09-28T04:23:18.405212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397774+0000","last_change":"2023-09-28T04:23:18.392418+0000","last_active":"2023-09-28T04:23:18.397774+0000","last_peered":"2023-09-28T04:23:18.397774+0000","last_clean":"2023-09-28T04:23:18.397774+0000","last_became_active":"2023-09-28T04:23:18.390911+0000","last_became_peered":"2023-09-28T04:23:18.390911+0000","last_unstale":"2023-09-28T04:23:18.397774+0000","last_undegraded":"2023-09-28T04:23:18.397774+0000","last_fullsized":"2023-09-28T04:23:18.397774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397957+0000","last_change":"2023-09-28T04:23:18.393845+0000","last_active":"2023-09-28T04:23:18.397957+0000","last_peered":"2023-09-28T04:23:18.397957+0000","last_clean":"2023-09-28T04:23:18.397957+0000","last_became_active":"2023-09-28T04:23:18.393524+0000","last_became_peered":"2023-09-28T04:23:18.393524+0000","last_unstale":"2023-09-28T04:23:18.397957+0000","last_undegraded":"2023-09-28T04:23:18.397957+0000","last_fullsized":"2023-09-28T04:23:18.397957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:27:39.596054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390755+0000","last_change":"2023-09-28T04:23:18.385250+0000","last_active":"2023-09-28T04:23:18.390755+0000","last_peered":"2023-09-28T04:23:18.390755+0000","last_clean":"2023-09-28T04:23:18.390755+0000","last_became_active":"2023-09-28T04:23:18.384986+0000","last_became_peered":"2023-09-28T04:23:18.384986+0000","last_unstale":"2023-09-28T04:23:18.390755+0000","last_undegraded":"2023-09-28T04:23:18.390755+0000","last_fullsized":"2023-09-28T04:23:18.390755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:15.500469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404651+0000","last_change":"2023-09-28T04:23:18.402417+0000","last_active":"2023-09-28T04:23:18.404651+0000","last_peered":"2023-09-28T04:23:18.404651+0000","last_clean":"2023-09-28T04:23:18.404651+0000","last_became_active":"2023-09-28T04:23:18.402161+0000","last_became_peered":"2023-09-28T04:23:18.402161+0000","last_unstale":"2023-09-28T04:23:18.404651+0000","last_undegraded":"2023-09-28T04:23:18.404651+0000","last_fullsized":"2023-09-28T04:23:18.404651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:50.909915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391345+0000","last_change":"2023-09-28T04:23:18.387808+0000","last_active":"2023-09-28T04:23:18.391345+0000","last_peered":"2023-09-28T04:23:18.391345+0000","last_clean":"2023-09-28T04:23:18.391345+0000","last_became_active":"2023-09-28T04:23:18.387471+0000","last_became_peered":"2023-09-28T04:23:18.387471+0000","last_unstale":"2023-09-28T04:23:18.391345+0000","last_undegraded":"2023-09-28T04:23:18.391345+0000","last_fullsized":"2023-09-28T04:23:18.391345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401004+0000","last_change":"2023-09-28T04:23:18.396945+0000","last_active":"2023-09-28T04:23:18.401004+0000","last_peered":"2023-09-28T04:23:18.401004+0000","last_clean":"2023-09-28T04:23:18.401004+0000","last_became_active":"2023-09-28T04:23:18.396395+0000","last_became_peered":"2023-09-28T04:23:18.396395+0000","last_unstale":"2023-09-28T04:23:18.401004+0000","last_undegraded":"2023-09-28T04:23:18.401004+0000","last_fullsized":"2023-09-28T04:23:18.401004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397971+0000","last_change":"2023-09-28T04:23:18.393975+0000","last_active":"2023-09-28T04:23:18.397971+0000","last_peered":"2023-09-28T04:23:18.397971+0000","last_clean":"2023-09-28T04:23:18.397971+0000","last_became_active":"2023-09-28T04:23:18.393683+0000","last_became_peered":"2023-09-28T04:23:18.393683+0000","last_unstale":"2023-09-28T04:23:18.397971+0000","last_undegraded":"2023-09-28T04:23:18.397971+0000","last_fullsized":"2023-09-28T04:23:18.397971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:06:40.927453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404561+0000","last_change":"2023-09-28T04:23:18.402518+0000","last_active":"2023-09-28T04:23:18.404561+0000","last_peered":"2023-09-28T04:23:18.404561+0000","last_clean":"2023-09-28T04:23:18.404561+0000","last_became_active":"2023-09-28T04:23:18.402275+0000","last_became_peered":"2023-09-28T04:23:18.402275+0000","last_unstale":"2023-09-28T04:23:18.404561+0000","last_undegraded":"2023-09-28T04:23:18.404561+0000","last_fullsized":"2023-09-28T04:23:18.404561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400750+0000","last_change":"2023-09-28T04:23:18.395032+0000","last_active":"2023-09-28T04:23:18.400750+0000","last_peered":"2023-09-28T04:23:18.400750+0000","last_clean":"2023-09-28T04:23:18.400750+0000","last_became_active":"2023-09-28T04:23:18.390678+0000","last_became_peered":"2023-09-28T04:23:18.390678+0000","last_unstale":"2023-09-28T04:23:18.400750+0000","last_undegraded":"2023-09-28T04:23:18.400750+0000","last_fullsized":"2023-09-28T04:23:18.400750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390373+0000","last_change":"2023-09-28T04:23:18.385209+0000","last_active":"2023-09-28T04:23:18.390373+0000","last_peered":"2023-09-28T04:23:18.390373+0000","last_clean":"2023-09-28T04:23:18.390373+0000","last_became_active":"2023-09-28T04:23:18.384916+0000","last_became_peered":"2023-09-28T04:23:18.384916+0000","last_unstale":"2023-09-28T04:23:18.390373+0000","last_undegraded":"2023-09-28T04:23:18.390373+0000","last_fullsized":"2023-09-28T04:23:18.390373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:06.937552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397758+0000","last_change":"2023-09-28T04:23:18.386692+0000","last_active":"2023-09-28T04:23:18.397758+0000","last_peered":"2023-09-28T04:23:18.397758+0000","last_clean":"2023-09-28T04:23:18.397758+0000","last_became_active":"2023-09-28T04:23:18.385805+0000","last_became_peered":"2023-09-28T04:23:18.385805+0000","last_unstale":"2023-09-28T04:23:18.397758+0000","last_undegraded":"2023-09-28T04:23:18.397758+0000","last_fullsized":"2023-09-28T04:23:18.397758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:52:07.899487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401120+0000","last_change":"2023-09-28T04:23:18.400497+0000","last_active":"2023-09-28T04:23:18.401120+0000","last_peered":"2023-09-28T04:23:18.401120+0000","last_clean":"2023-09-28T04:23:18.401120+0000","last_became_active":"2023-09-28T04:23:18.400230+0000","last_became_peered":"2023-09-28T04:23:18.400230+0000","last_unstale":"2023-09-28T04:23:18.401120+0000","last_undegraded":"2023-09-28T04:23:18.401120+0000","last_fullsized":"2023-09-28T04:23:18.401120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399068+0000","last_change":"2023-09-28T04:23:18.391683+0000","last_active":"2023-09-28T04:23:18.399068+0000","last_peered":"2023-09-28T04:23:18.399068+0000","last_clean":"2023-09-28T04:23:18.399068+0000","last_became_active":"2023-09-28T04:23:18.391373+0000","last_became_peered":"2023-09-28T04:23:18.391373+0000","last_unstale":"2023-09-28T04:23:18.399068+0000","last_undegraded":"2023-09-28T04:23:18.399068+0000","last_fullsized":"2023-09-28T04:23:18.399068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402238+0000","last_change":"2023-09-28T04:23:18.393381+0000","last_active":"2023-09-28T04:23:18.402238+0000","last_peered":"2023-09-28T04:23:18.402238+0000","last_clean":"2023-09-28T04:23:18.402238+0000","last_became_active":"2023-09-28T04:23:18.392723+0000","last_became_peered":"2023-09-28T04:23:18.392723+0000","last_unstale":"2023-09-28T04:23:18.402238+0000","last_undegraded":"2023-09-28T04:23:18.402238+0000","last_fullsized":"2023-09-28T04:23:18.402238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.403069+0000","last_change":"2023-09-28T04:23:18.402467+0000","last_active":"2023-09-28T04:23:18.403069+0000","last_peered":"2023-09-28T04:23:18.403069+0000","last_clean":"2023-09-28T04:23:18.403069+0000","last_became_active":"2023-09-28T04:23:18.402197+0000","last_became_peered":"2023-09-28T04:23:18.402197+0000","last_unstale":"2023-09-28T04:23:18.403069+0000","last_undegraded":"2023-09-28T04:23:18.403069+0000","last_fullsized":"2023-09-28T04:23:18.403069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.396757+0000","last_change":"2023-09-28T04:23:18.389242+0000","last_active":"2023-09-28T04:23:18.396757+0000","last_peered":"2023-09-28T04:23:18.396757+0000","last_clean":"2023-09-28T04:23:18.396757+0000","last_became_active":"2023-09-28T04:23:18.388936+0000","last_became_peered":"2023-09-28T04:23:18.388936+0000","last_unstale":"2023-09-28T04:23:18.396757+0000","last_undegraded":"2023-09-28T04:23:18.396757+0000","last_fullsized":"2023-09-28T04:23:18.396757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:19.108476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395209+0000","last_change":"2023-09-28T04:23:18.388941+0000","last_active":"2023-09-28T04:23:18.395209+0000","last_peered":"2023-09-28T04:23:18.395209+0000","last_clean":"2023-09-28T04:23:18.395209+0000","last_became_active":"2023-09-28T04:23:18.388682+0000","last_became_peered":"2023-09-28T04:23:18.388682+0000","last_unstale":"2023-09-28T04:23:18.395209+0000","last_undegraded":"2023-09-28T04:23:18.395209+0000","last_fullsized":"2023-09-28T04:23:18.395209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395293+0000","last_change":"2023-09-28T04:23:18.391753+0000","last_active":"2023-09-28T04:23:18.395293+0000","last_peered":"2023-09-28T04:23:18.395293+0000","last_clean":"2023-09-28T04:23:18.395293+0000","last_became_active":"2023-09-28T04:23:18.391031+0000","last_became_peered":"2023-09-28T04:23:18.391031+0000","last_unstale":"2023-09-28T04:23:18.395293+0000","last_undegraded":"2023-09-28T04:23:18.395293+0000","last_fullsized":"2023-09-28T04:23:18.395293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440177+0000","last_change":"2023-09-28T04:23:17.914158+0000","last_active":"2023-09-28T04:23:33.440177+0000","last_peered":"2023-09-28T04:23:33.440177+0000","last_clean":"2023-09-28T04:23:33.440177+0000","last_became_active":"2023-09-28T04:23:17.913941+0000","last_became_peered":"2023-09-28T04:23:17.913941+0000","last_unstale":"2023-09-28T04:23:33.440177+0000","last_undegraded":"2023-09-28T04:23:33.440177+0000","last_fullsized":"2023-09-28T04:23:33.440177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401811+0000","last_change":"2023-09-28T04:23:18.390288+0000","last_active":"2023-09-28T04:23:18.401811+0000","last_peered":"2023-09-28T04:23:18.401811+0000","last_clean":"2023-09-28T04:23:18.401811+0000","last_became_active":"2023-09-28T04:23:18.390030+0000","last_became_peered":"2023-09-28T04:23:18.390030+0000","last_unstale":"2023-09-28T04:23:18.401811+0000","last_undegraded":"2023-09-28T04:23:18.401811+0000","last_fullsized":"2023-09-28T04:23:18.401811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439320+0000","last_change":"2023-09-28T04:23:17.914311+0000","last_active":"2023-09-28T04:23:33.439320+0000","last_peered":"2023-09-28T04:23:33.439320+0000","last_clean":"2023-09-28T04:23:33.439320+0000","last_became_active":"2023-09-28T04:23:17.913950+0000","last_became_peered":"2023-09-28T04:23:17.913950+0000","last_unstale":"2023-09-28T04:23:33.439320+0000","last_undegraded":"2023-09-28T04:23:33.439320+0000","last_fullsized":"2023-09-28T04:23:33.439320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399162+0000","last_change":"2023-09-28T04:23:18.393402+0000","last_active":"2023-09-28T04:23:18.399162+0000","last_peered":"2023-09-28T04:23:18.399162+0000","last_clean":"2023-09-28T04:23:18.399162+0000","last_became_active":"2023-09-28T04:23:18.393106+0000","last_became_peered":"2023-09-28T04:23:18.393106+0000","last_unstale":"2023-09-28T04:23:18.399162+0000","last_undegraded":"2023-09-28T04:23:18.399162+0000","last_fullsized":"2023-09-28T04:23:18.399162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.375882+0000","last_change":"2023-09-28T04:23:17.911104+0000","last_active":"2023-09-28T04:23:19.375882+0000","last_peered":"2023-09-28T04:23:19.375882+0000","last_clean":"2023-09-28T04:23:19.375882+0000","last_became_active":"2023-09-28T04:23:17.910766+0000","last_became_peered":"2023-09-28T04:23:17.910766+0000","last_unstale":"2023-09-28T04:23:19.375882+0000","last_undegraded":"2023-09-28T04:23:19.375882+0000","last_fullsized":"2023-09-28T04:23:19.375882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391763+0000","last_change":"2023-09-28T04:23:18.388098+0000","last_active":"2023-09-28T04:23:18.391763+0000","last_peered":"2023-09-28T04:23:18.391763+0000","last_clean":"2023-09-28T04:23:18.391763+0000","last_became_active":"2023-09-28T04:23:18.387581+0000","last_became_peered":"2023-09-28T04:23:18.387581+0000","last_unstale":"2023-09-28T04:23:18.391763+0000","last_undegraded":"2023-09-28T04:23:18.391763+0000","last_fullsized":"2023-09-28T04:23:18.391763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:11.090984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.409275+0000","last_change":"2023-09-28T04:23:17.917921+0000","last_active":"2023-09-28T04:23:28.409275+0000","last_peered":"2023-09-28T04:23:28.409275+0000","last_clean":"2023-09-28T04:23:28.409275+0000","last_became_active":"2023-09-28T04:23:17.917596+0000","last_became_peered":"2023-09-28T04:23:17.917596+0000","last_unstale":"2023-09-28T04:23:28.409275+0000","last_undegraded":"2023-09-28T04:23:28.409275+0000","last_fullsized":"2023-09-28T04:23:28.409275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402470+0000","last_change":"2023-09-28T04:23:18.394460+0000","last_active":"2023-09-28T04:23:18.402470+0000","last_peered":"2023-09-28T04:23:18.402470+0000","last_clean":"2023-09-28T04:23:18.402470+0000","last_became_active":"2023-09-28T04:23:18.391773+0000","last_became_peered":"2023-09-28T04:23:18.391773+0000","last_unstale":"2023-09-28T04:23:18.402470+0000","last_undegraded":"2023-09-28T04:23:18.402470+0000","last_fullsized":"2023-09-28T04:23:18.402470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.408519+0000","last_change":"2023-09-28T04:23:17.908875+0000","last_active":"2023-09-28T04:23:28.408519+0000","last_peered":"2023-09-28T04:23:28.408519+0000","last_clean":"2023-09-28T04:23:28.408519+0000","last_became_active":"2023-09-28T04:23:17.908599+0000","last_became_peered":"2023-09-28T04:23:17.908599+0000","last_unstale":"2023-09-28T04:23:28.408519+0000","last_undegraded":"2023-09-28T04:23:28.408519+0000","last_fullsized":"2023-09-28T04:23:28.408519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402255+0000","last_change":"2023-09-28T04:23:18.393856+0000","last_active":"2023-09-28T04:23:18.402255+0000","last_peered":"2023-09-28T04:23:18.402255+0000","last_clean":"2023-09-28T04:23:18.402255+0000","last_became_active":"2023-09-28T04:23:18.393631+0000","last_became_peered":"2023-09-28T04:23:18.393631+0000","last_unstale":"2023-09-28T04:23:18.402255+0000","last_undegraded":"2023-09-28T04:23:18.402255+0000","last_fullsized":"2023-09-28T04:23:18.402255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.385554+0000","last_change":"2023-09-28T04:23:17.911594+0000","last_active":"2023-09-28T04:23:23.385554+0000","last_peered":"2023-09-28T04:23:23.385554+0000","last_clean":"2023-09-28T04:23:23.385554+0000","last_became_active":"2023-09-28T04:23:17.911361+0000","last_became_peered":"2023-09-28T04:23:17.911361+0000","last_unstale":"2023-09-28T04:23:23.385554+0000","last_undegraded":"2023-09-28T04:23:23.385554+0000","last_fullsized":"2023-09-28T04:23:23.385554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.394029+0000","last_change":"2023-09-28T04:23:18.387908+0000","last_active":"2023-09-28T04:23:18.394029+0000","last_peered":"2023-09-28T04:23:18.394029+0000","last_clean":"2023-09-28T04:23:18.394029+0000","last_became_active":"2023-09-28T04:23:18.387672+0000","last_became_peered":"2023-09-28T04:23:18.387672+0000","last_unstale":"2023-09-28T04:23:18.394029+0000","last_undegraded":"2023-09-28T04:23:18.394029+0000","last_fullsized":"2023-09-28T04:23:18.394029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.408892+0000","last_change":"2023-09-28T04:23:17.904974+0000","last_active":"2023-09-28T04:23:28.408892+0000","last_peered":"2023-09-28T04:23:28.408892+0000","last_clean":"2023-09-28T04:23:28.408892+0000","last_became_active":"2023-09-28T04:23:17.904734+0000","last_became_peered":"2023-09-28T04:23:17.904734+0000","last_unstale":"2023-09-28T04:23:28.408892+0000","last_undegraded":"2023-09-28T04:23:28.408892+0000","last_fullsized":"2023-09-28T04:23:28.408892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397872+0000","last_change":"2023-09-28T04:23:18.389128+0000","last_active":"2023-09-28T04:23:18.397872+0000","last_peered":"2023-09-28T04:23:18.397872+0000","last_clean":"2023-09-28T04:23:18.397872+0000","last_became_active":"2023-09-28T04:23:18.388871+0000","last_became_peered":"2023-09-28T04:23:18.388871+0000","last_unstale":"2023-09-28T04:23:18.397872+0000","last_undegraded":"2023-09-28T04:23:18.397872+0000","last_fullsized":"2023-09-28T04:23:18.397872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:33:50.957431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440656+0000","last_change":"2023-09-28T04:23:17.910343+0000","last_active":"2023-09-28T04:23:33.440656+0000","last_peered":"2023-09-28T04:23:33.440656+0000","last_clean":"2023-09-28T04:23:33.440656+0000","last_became_active":"2023-09-28T04:23:17.909981+0000","last_became_peered":"2023-09-28T04:23:17.909981+0000","last_unstale":"2023-09-28T04:23:33.440656+0000","last_undegraded":"2023-09-28T04:23:33.440656+0000","last_fullsized":"2023-09-28T04:23:33.440656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:11.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402619+0000","last_change":"2023-09-28T04:23:18.391696+0000","last_active":"2023-09-28T04:23:18.402619+0000","last_peered":"2023-09-28T04:23:18.402619+0000","last_clean":"2023-09-28T04:23:18.402619+0000","last_became_active":"2023-09-28T04:23:18.391441+0000","last_became_peered":"2023-09-28T04:23:18.391441+0000","last_unstale":"2023-09-28T04:23:18.402619+0000","last_undegraded":"2023-09-28T04:23:18.402619+0000","last_fullsized":"2023-09-28T04:23:18.402619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412822+0000","last_change":"2023-09-28T04:23:17.916730+0000","last_active":"2023-09-28T04:23:28.412822+0000","last_peered":"2023-09-28T04:23:28.412822+0000","last_clean":"2023-09-28T04:23:28.412822+0000","last_became_active":"2023-09-28T04:23:17.916424+0000","last_became_peered":"2023-09-28T04:23:17.916424+0000","last_unstale":"2023-09-28T04:23:28.412822+0000","last_undegraded":"2023-09-28T04:23:28.412822+0000","last_fullsized":"2023-09-28T04:23:28.412822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392344+0000","last_change":"2023-09-28T04:23:18.391510+0000","last_active":"2023-09-28T04:23:18.392344+0000","last_peered":"2023-09-28T04:23:18.392344+0000","last_clean":"2023-09-28T04:23:18.392344+0000","last_became_active":"2023-09-28T04:23:18.390613+0000","last_became_peered":"2023-09-28T04:23:18.390613+0000","last_unstale":"2023-09-28T04:23:18.392344+0000","last_undegraded":"2023-09-28T04:23:18.392344+0000","last_fullsized":"2023-09-28T04:23:18.392344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440750+0000","last_change":"2023-09-28T04:23:17.910760+0000","last_active":"2023-09-28T04:23:33.440750+0000","last_peered":"2023-09-28T04:23:33.440750+0000","last_clean":"2023-09-28T04:23:33.440750+0000","last_became_active":"2023-09-28T04:23:17.910457+0000","last_became_peered":"2023-09-28T04:23:17.910457+0000","last_unstale":"2023-09-28T04:23:33.440750+0000","last_undegraded":"2023-09-28T04:23:33.440750+0000","last_fullsized":"2023-09-28T04:23:33.440750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:10.087083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404516+0000","last_change":"2023-09-28T04:23:18.402823+0000","last_active":"2023-09-28T04:23:18.404516+0000","last_peered":"2023-09-28T04:23:18.404516+0000","last_clean":"2023-09-28T04:23:18.404516+0000","last_became_active":"2023-09-28T04:23:18.402559+0000","last_became_peered":"2023-09-28T04:23:18.402559+0000","last_unstale":"2023-09-28T04:23:18.404516+0000","last_undegraded":"2023-09-28T04:23:18.404516+0000","last_fullsized":"2023-09-28T04:23:18.404516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'15","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440298+0000","last_change":"2023-09-28T04:23:17.910972+0000","last_active":"2023-09-28T04:23:33.440298+0000","last_peered":"2023-09-28T04:23:33.440298+0000","last_clean":"2023-09-28T04:23:33.440298+0000","last_became_active":"2023-09-28T04:23:17.910650+0000","last_became_peered":"2023-09-28T04:23:17.910650+0000","last_unstale":"2023-09-28T04:23:33.440298+0000","last_undegraded":"2023-09-28T04:23:33.440298+0000","last_fullsized":"2023-09-28T04:23:33.440298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:03:36.553513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402556+0000","last_change":"2023-09-28T04:23:18.395424+0000","last_active":"2023-09-28T04:23:18.402556+0000","last_peered":"2023-09-28T04:23:18.402556+0000","last_clean":"2023-09-28T04:23:18.402556+0000","last_became_active":"2023-09-28T04:23:18.394721+0000","last_became_peered":"2023-09-28T04:23:18.394721+0000","last_unstale":"2023-09-28T04:23:18.402556+0000","last_undegraded":"2023-09-28T04:23:18.402556+0000","last_fullsized":"2023-09-28T04:23:18.402556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.385189+0000","last_change":"2023-09-28T04:23:17.907642+0000","last_active":"2023-09-28T04:23:23.385189+0000","last_peered":"2023-09-28T04:23:23.385189+0000","last_clean":"2023-09-28T04:23:23.385189+0000","last_became_active":"2023-09-28T04:23:17.907331+0000","last_became_peered":"2023-09-28T04:23:17.907331+0000","last_unstale":"2023-09-28T04:23:23.385189+0000","last_undegraded":"2023-09-28T04:23:23.385189+0000","last_fullsized":"2023-09-28T04:23:23.385189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.393277+0000","last_change":"2023-09-28T04:23:18.390910+0000","last_active":"2023-09-28T04:23:18.393277+0000","last_peered":"2023-09-28T04:23:18.393277+0000","last_clean":"2023-09-28T04:23:18.393277+0000","last_became_active":"2023-09-28T04:23:18.390633+0000","last_became_peered":"2023-09-28T04:23:18.390633+0000","last_unstale":"2023-09-28T04:23:18.393277+0000","last_undegraded":"2023-09-28T04:23:18.393277+0000","last_fullsized":"2023-09-28T04:23:18.393277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.383758+0000","last_change":"2023-09-28T04:23:17.906320+0000","last_active":"2023-09-28T04:23:23.383758+0000","last_peered":"2023-09-28T04:23:23.383758+0000","last_clean":"2023-09-28T04:23:23.383758+0000","last_became_active":"2023-09-28T04:23:17.906036+0000","last_became_peered":"2023-09-28T04:23:17.906036+0000","last_unstale":"2023-09-28T04:23:23.383758+0000","last_undegraded":"2023-09-28T04:23:23.383758+0000","last_fullsized":"2023-09-28T04:23:23.383758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397773+0000","last_change":"2023-09-28T04:23:18.386196+0000","last_active":"2023-09-28T04:23:18.397773+0000","last_peered":"2023-09-28T04:23:18.397773+0000","last_clean":"2023-09-28T04:23:18.397773+0000","last_became_active":"2023-09-28T04:23:18.385693+0000","last_became_peered":"2023-09-28T04:23:18.385693+0000","last_unstale":"2023-09-28T04:23:18.397773+0000","last_undegraded":"2023-09-28T04:23:18.397773+0000","last_fullsized":"2023-09-28T04:23:18.397773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172978+0000","last_change":"2023-09-28T04:23:17.908768+0000","last_active":"2023-09-28T04:23:20.172978+0000","last_peered":"2023-09-28T04:23:20.172978+0000","last_clean":"2023-09-28T04:23:20.172978+0000","last_became_active":"2023-09-28T04:23:17.908493+0000","last_became_peered":"2023-09-28T04:23:17.908493+0000","last_unstale":"2023-09-28T04:23:20.172978+0000","last_undegraded":"2023-09-28T04:23:20.172978+0000","last_fullsized":"2023-09-28T04:23:20.172978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388563+0000","last_change":"2023-09-28T04:23:18.385404+0000","last_active":"2023-09-28T04:23:18.388563+0000","last_peered":"2023-09-28T04:23:18.388563+0000","last_clean":"2023-09-28T04:23:18.388563+0000","last_became_active":"2023-09-28T04:23:18.385112+0000","last_became_peered":"2023-09-28T04:23:18.385112+0000","last_unstale":"2023-09-28T04:23:18.388563+0000","last_undegraded":"2023-09-28T04:23:18.388563+0000","last_fullsized":"2023-09-28T04:23:18.388563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:06.331056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439864+0000","last_change":"2023-09-28T04:23:17.898518+0000","last_active":"2023-09-28T04:23:33.439864+0000","last_peered":"2023-09-28T04:23:33.439864+0000","last_clean":"2023-09-28T04:23:33.439864+0000","last_became_active":"2023-09-28T04:23:17.898232+0000","last_became_peered":"2023-09-28T04:23:17.898232+0000","last_unstale":"2023-09-28T04:23:33.439864+0000","last_undegraded":"2023-09-28T04:23:33.439864+0000","last_fullsized":"2023-09-28T04:23:33.439864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399188+0000","last_change":"2023-09-28T04:23:18.392206+0000","last_active":"2023-09-28T04:23:18.399188+0000","last_peered":"2023-09-28T04:23:18.399188+0000","last_clean":"2023-09-28T04:23:18.399188+0000","last_became_active":"2023-09-28T04:23:18.391963+0000","last_became_peered":"2023-09-28T04:23:18.391963+0000","last_unstale":"2023-09-28T04:23:18.399188+0000","last_undegraded":"2023-09-28T04:23:18.399188+0000","last_fullsized":"2023-09-28T04:23:18.399188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.410038+0000","last_change":"2023-09-28T04:23:17.905390+0000","last_active":"2023-09-28T04:23:28.410038+0000","last_peered":"2023-09-28T04:23:28.410038+0000","last_clean":"2023-09-28T04:23:28.410038+0000","last_became_active":"2023-09-28T04:23:17.905089+0000","last_became_peered":"2023-09-28T04:23:17.905089+0000","last_unstale":"2023-09-28T04:23:28.410038+0000","last_undegraded":"2023-09-28T04:23:28.410038+0000","last_fullsized":"2023-09-28T04:23:28.410038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401474+0000","last_change":"2023-09-28T04:23:18.400110+0000","last_active":"2023-09-28T04:23:18.401474+0000","last_peered":"2023-09-28T04:23:18.401474+0000","last_clean":"2023-09-28T04:23:18.401474+0000","last_became_active":"2023-09-28T04:23:18.399839+0000","last_became_peered":"2023-09-28T04:23:18.399839+0000","last_unstale":"2023-09-28T04:23:18.401474+0000","last_undegraded":"2023-09-28T04:23:18.401474+0000","last_fullsized":"2023-09-28T04:23:18.401474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172225+0000","last_change":"2023-09-28T04:23:17.912734+0000","last_active":"2023-09-28T04:23:20.172225+0000","last_peered":"2023-09-28T04:23:20.172225+0000","last_clean":"2023-09-28T04:23:20.172225+0000","last_became_active":"2023-09-28T04:23:17.912560+0000","last_became_peered":"2023-09-28T04:23:17.912560+0000","last_unstale":"2023-09-28T04:23:20.172225+0000","last_undegraded":"2023-09-28T04:23:20.172225+0000","last_fullsized":"2023-09-28T04:23:20.172225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397919+0000","last_change":"2023-09-28T04:23:18.393554+0000","last_active":"2023-09-28T04:23:18.397919+0000","last_peered":"2023-09-28T04:23:18.397919+0000","last_clean":"2023-09-28T04:23:18.397919+0000","last_became_active":"2023-09-28T04:23:18.390268+0000","last_became_peered":"2023-09-28T04:23:18.390268+0000","last_unstale":"2023-09-28T04:23:18.397919+0000","last_undegraded":"2023-09-28T04:23:18.397919+0000","last_fullsized":"2023-09-28T04:23:18.397919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412334+0000","last_change":"2023-09-28T04:23:17.911218+0000","last_active":"2023-09-28T04:23:28.412334+0000","last_peered":"2023-09-28T04:23:28.412334+0000","last_clean":"2023-09-28T04:23:28.412334+0000","last_became_active":"2023-09-28T04:23:17.910887+0000","last_became_peered":"2023-09-28T04:23:17.910887+0000","last_unstale":"2023-09-28T04:23:28.412334+0000","last_undegraded":"2023-09-28T04:23:28.412334+0000","last_fullsized":"2023-09-28T04:23:28.412334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397818+0000","last_change":"2023-09-28T04:23:18.387932+0000","last_active":"2023-09-28T04:23:18.397818+0000","last_peered":"2023-09-28T04:23:18.397818+0000","last_clean":"2023-09-28T04:23:18.397818+0000","last_became_active":"2023-09-28T04:23:18.387667+0000","last_became_peered":"2023-09-28T04:23:18.387667+0000","last_unstale":"2023-09-28T04:23:18.397818+0000","last_undegraded":"2023-09-28T04:23:18.397818+0000","last_fullsized":"2023-09-28T04:23:18.397818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:46:23.383130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.410224+0000","last_change":"2023-09-28T04:23:17.911764+0000","last_active":"2023-09-28T04:23:28.410224+0000","last_peered":"2023-09-28T04:23:28.410224+0000","last_clean":"2023-09-28T04:23:28.410224+0000","last_became_active":"2023-09-28T04:23:17.911458+0000","last_became_peered":"2023-09-28T04:23:17.911458+0000","last_unstale":"2023-09-28T04:23:28.410224+0000","last_undegraded":"2023-09-28T04:23:28.410224+0000","last_fullsized":"2023-09-28T04:23:28.410224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402635+0000","last_change":"2023-09-28T04:23:18.400278+0000","last_active":"2023-09-28T04:23:18.402635+0000","last_peered":"2023-09-28T04:23:18.402635+0000","last_clean":"2023-09-28T04:23:18.402635+0000","last_became_active":"2023-09-28T04:23:18.399957+0000","last_became_peered":"2023-09-28T04:23:18.399957+0000","last_unstale":"2023-09-28T04:23:18.402635+0000","last_undegraded":"2023-09-28T04:23:18.402635+0000","last_fullsized":"2023-09-28T04:23:18.402635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:01:52.295558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377068+0000","last_change":"2023-09-28T04:23:13.017727+0000","last_active":"2023-09-28T04:23:18.377068+0000","last_peered":"2023-09-28T04:23:18.377068+0000","last_clean":"2023-09-28T04:23:18.377068+0000","last_became_active":"2023-09-28T04:23:13.017362+0000","last_became_peered":"2023-09-28T04:23:13.017362+0000","last_unstale":"2023-09-28T04:23:18.377068+0000","last_undegraded":"2023-09-28T04:23:18.377068+0000","last_fullsized":"2023-09-28T04:23:18.377068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376624+0000","last_change":"2023-09-28T04:23:17.899128+0000","last_active":"2023-09-28T04:23:19.376624+0000","last_peered":"2023-09-28T04:23:19.376624+0000","last_clean":"2023-09-28T04:23:19.376624+0000","last_became_active":"2023-09-28T04:23:17.898878+0000","last_became_peered":"2023-09-28T04:23:17.898878+0000","last_unstale":"2023-09-28T04:23:19.376624+0000","last_undegraded":"2023-09-28T04:23:19.376624+0000","last_fullsized":"2023-09-28T04:23:19.376624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388439+0000","last_change":"2023-09-28T04:23:18.384565+0000","last_active":"2023-09-28T04:23:18.388439+0000","last_peered":"2023-09-28T04:23:18.388439+0000","last_clean":"2023-09-28T04:23:18.388439+0000","last_became_active":"2023-09-28T04:23:18.383969+0000","last_became_peered":"2023-09-28T04:23:18.383969+0000","last_unstale":"2023-09-28T04:23:18.388439+0000","last_undegraded":"2023-09-28T04:23:18.388439+0000","last_fullsized":"2023-09-28T04:23:18.388439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379488+0000","last_change":"2023-09-28T04:23:12.604091+0000","last_active":"2023-09-28T04:23:18.379488+0000","last_peered":"2023-09-28T04:23:18.379488+0000","last_clean":"2023-09-28T04:23:18.379488+0000","last_became_active":"2023-09-28T04:23:12.603804+0000","last_became_peered":"2023-09-28T04:23:12.603804+0000","last_unstale":"2023-09-28T04:23:18.379488+0000","last_undegraded":"2023-09-28T04:23:18.379488+0000","last_fullsized":"2023-09-28T04:23:18.379488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412473+0000","last_change":"2023-09-28T04:23:17.918999+0000","last_active":"2023-09-28T04:23:28.412473+0000","last_peered":"2023-09-28T04:23:28.412473+0000","last_clean":"2023-09-28T04:23:28.412473+0000","last_became_active":"2023-09-28T04:23:17.918740+0000","last_became_peered":"2023-09-28T04:23:17.918740+0000","last_unstale":"2023-09-28T04:23:28.412473+0000","last_undegraded":"2023-09-28T04:23:28.412473+0000","last_fullsized":"2023-09-28T04:23:28.412473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395808+0000","last_change":"2023-09-28T04:23:18.389350+0000","last_active":"2023-09-28T04:23:18.395808+0000","last_peered":"2023-09-28T04:23:18.395808+0000","last_clean":"2023-09-28T04:23:18.395808+0000","last_became_active":"2023-09-28T04:23:18.389059+0000","last_became_peered":"2023-09-28T04:23:18.389059+0000","last_unstale":"2023-09-28T04:23:18.395808+0000","last_undegraded":"2023-09-28T04:23:18.395808+0000","last_fullsized":"2023-09-28T04:23:18.395808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378640+0000","last_change":"2023-09-28T04:23:12.602100+0000","last_active":"2023-09-28T04:23:18.378640+0000","last_peered":"2023-09-28T04:23:18.378640+0000","last_clean":"2023-09-28T04:23:18.378640+0000","last_became_active":"2023-09-28T04:23:12.601652+0000","last_became_peered":"2023-09-28T04:23:12.601652+0000","last_unstale":"2023-09-28T04:23:18.378640+0000","last_undegraded":"2023-09-28T04:23:18.378640+0000","last_fullsized":"2023-09-28T04:23:18.378640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:37:16.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.438991+0000","last_change":"2023-09-28T04:23:17.911566+0000","last_active":"2023-09-28T04:23:33.438991+0000","last_peered":"2023-09-28T04:23:33.438991+0000","last_clean":"2023-09-28T04:23:33.438991+0000","last_became_active":"2023-09-28T04:23:17.911308+0000","last_became_peered":"2023-09-28T04:23:17.911308+0000","last_unstale":"2023-09-28T04:23:33.438991+0000","last_undegraded":"2023-09-28T04:23:33.438991+0000","last_fullsized":"2023-09-28T04:23:33.438991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395489+0000","last_change":"2023-09-28T04:23:18.388204+0000","last_active":"2023-09-28T04:23:18.395489+0000","last_peered":"2023-09-28T04:23:18.395489+0000","last_clean":"2023-09-28T04:23:18.395489+0000","last_became_active":"2023-09-28T04:23:18.387945+0000","last_became_peered":"2023-09-28T04:23:18.387945+0000","last_unstale":"2023-09-28T04:23:18.395489+0000","last_undegraded":"2023-09-28T04:23:18.395489+0000","last_fullsized":"2023-09-28T04:23:18.395489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378668+0000","last_change":"2023-09-28T04:23:12.604212+0000","last_active":"2023-09-28T04:23:18.378668+0000","last_peered":"2023-09-28T04:23:18.378668+0000","last_clean":"2023-09-28T04:23:18.378668+0000","last_became_active":"2023-09-28T04:23:12.603930+0000","last_became_peered":"2023-09-28T04:23:12.603930+0000","last_unstale":"2023-09-28T04:23:18.378668+0000","last_undegraded":"2023-09-28T04:23:18.378668+0000","last_fullsized":"2023-09-28T04:23:18.378668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386718+0000","last_change":"2023-09-28T04:23:11.608534+0000","last_active":"2023-09-28T04:23:18.386718+0000","last_peered":"2023-09-28T04:23:18.386718+0000","last_clean":"2023-09-28T04:23:18.386718+0000","last_became_active":"2023-09-28T04:23:11.608249+0000","last_became_peered":"2023-09-28T04:23:11.608249+0000","last_unstale":"2023-09-28T04:23:18.386718+0000","last_undegraded":"2023-09-28T04:23:18.386718+0000","last_fullsized":"2023-09-28T04:23:18.386718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_clean_scrub_stamp":"2023-09-28T04:23:10.587579+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:10.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376259+0000","last_change":"2023-09-28T04:23:17.902709+0000","last_active":"2023-09-28T04:23:19.376259+0000","last_peered":"2023-09-28T04:23:19.376259+0000","last_clean":"2023-09-28T04:23:19.376259+0000","last_became_active":"2023-09-28T04:23:17.902341+0000","last_became_peered":"2023-09-28T04:23:17.902341+0000","last_unstale":"2023-09-28T04:23:19.376259+0000","last_undegraded":"2023-09-28T04:23:19.376259+0000","last_fullsized":"2023-09-28T04:23:19.376259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392913+0000","last_change":"2023-09-28T04:23:18.389982+0000","last_active":"2023-09-28T04:23:18.392913+0000","last_peered":"2023-09-28T04:23:18.392913+0000","last_clean":"2023-09-28T04:23:18.392913+0000","last_became_active":"2023-09-28T04:23:18.389692+0000","last_became_peered":"2023-09-28T04:23:18.389692+0000","last_unstale":"2023-09-28T04:23:18.392913+0000","last_undegraded":"2023-09-28T04:23:18.392913+0000","last_fullsized":"2023-09-28T04:23:18.392913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386996+0000","last_change":"2023-09-28T04:23:12.605908+0000","last_active":"2023-09-28T04:23:18.386996+0000","last_peered":"2023-09-28T04:23:18.386996+0000","last_clean":"2023-09-28T04:23:18.386996+0000","last_became_active":"2023-09-28T04:23:12.605668+0000","last_became_peered":"2023-09-28T04:23:12.605668+0000","last_unstale":"2023-09-28T04:23:18.386996+0000","last_undegraded":"2023-09-28T04:23:18.386996+0000","last_fullsized":"2023-09-28T04:23:18.386996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440738+0000","last_change":"2023-09-28T04:23:17.918410+0000","last_active":"2023-09-28T04:23:33.440738+0000","last_peered":"2023-09-28T04:23:33.440738+0000","last_clean":"2023-09-28T04:23:33.440738+0000","last_became_active":"2023-09-28T04:23:17.918130+0000","last_became_peered":"2023-09-28T04:23:17.918130+0000","last_unstale":"2023-09-28T04:23:33.440738+0000","last_undegraded":"2023-09-28T04:23:33.440738+0000","last_fullsized":"2023-09-28T04:23:33.440738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399143+0000","last_change":"2023-09-28T04:23:18.391987+0000","last_active":"2023-09-28T04:23:18.399143+0000","last_peered":"2023-09-28T04:23:18.399143+0000","last_clean":"2023-09-28T04:23:18.399143+0000","last_became_active":"2023-09-28T04:23:18.391709+0000","last_became_peered":"2023-09-28T04:23:18.391709+0000","last_unstale":"2023-09-28T04:23:18.399143+0000","last_undegraded":"2023-09-28T04:23:18.399143+0000","last_fullsized":"2023-09-28T04:23:18.399143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386509+0000","last_change":"2023-09-28T04:23:13.017715+0000","last_active":"2023-09-28T04:23:18.386509+0000","last_peered":"2023-09-28T04:23:18.386509+0000","last_clean":"2023-09-28T04:23:18.386509+0000","last_became_active":"2023-09-28T04:23:13.017398+0000","last_became_peered":"2023-09-28T04:23:13.017398+0000","last_unstale":"2023-09-28T04:23:18.386509+0000","last_undegraded":"2023-09-28T04:23:18.386509+0000","last_fullsized":"2023-09-28T04:23:18.386509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:37:41.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377174+0000","last_change":"2023-09-28T04:23:17.912291+0000","last_active":"2023-09-28T04:23:18.377174+0000","last_peered":"2023-09-28T04:23:18.377174+0000","last_clean":"2023-09-28T04:23:18.377174+0000","last_became_active":"2023-09-28T04:23:17.912023+0000","last_became_peered":"2023-09-28T04:23:17.912023+0000","last_unstale":"2023-09-28T04:23:18.377174+0000","last_undegraded":"2023-09-28T04:23:18.377174+0000","last_fullsized":"2023-09-28T04:23:18.377174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399280+0000","last_change":"2023-09-28T04:23:18.396451+0000","last_active":"2023-09-28T04:23:18.399280+0000","last_peered":"2023-09-28T04:23:18.399280+0000","last_clean":"2023-09-28T04:23:18.399280+0000","last_became_active":"2023-09-28T04:23:18.396190+0000","last_became_peered":"2023-09-28T04:23:18.396190+0000","last_unstale":"2023-09-28T04:23:18.399280+0000","last_undegraded":"2023-09-28T04:23:18.399280+0000","last_fullsized":"2023-09-28T04:23:18.399280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.408972+0000","last_change":"2023-09-28T04:23:17.904739+0000","last_active":"2023-09-28T04:23:28.408972+0000","last_peered":"2023-09-28T04:23:28.408972+0000","last_clean":"2023-09-28T04:23:28.408972+0000","last_became_active":"2023-09-28T04:23:17.903844+0000","last_became_peered":"2023-09-28T04:23:17.903844+0000","last_unstale":"2023-09-28T04:23:28.408972+0000","last_undegraded":"2023-09-28T04:23:28.408972+0000","last_fullsized":"2023-09-28T04:23:28.408972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377634+0000","last_change":"2023-09-28T04:23:12.606496+0000","last_active":"2023-09-28T04:23:18.377634+0000","last_peered":"2023-09-28T04:23:18.377634+0000","last_clean":"2023-09-28T04:23:18.377634+0000","last_became_active":"2023-09-28T04:23:12.606143+0000","last_became_peered":"2023-09-28T04:23:12.606143+0000","last_unstale":"2023-09-28T04:23:18.377634+0000","last_undegraded":"2023-09-28T04:23:18.377634+0000","last_fullsized":"2023-09-28T04:23:18.377634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402487+0000","last_change":"2023-09-28T04:23:18.396153+0000","last_active":"2023-09-28T04:23:18.402487+0000","last_peered":"2023-09-28T04:23:18.402487+0000","last_clean":"2023-09-28T04:23:18.402487+0000","last_became_active":"2023-09-28T04:23:18.392092+0000","last_became_peered":"2023-09-28T04:23:18.392092+0000","last_unstale":"2023-09-28T04:23:18.402487+0000","last_undegraded":"2023-09-28T04:23:18.402487+0000","last_fullsized":"2023-09-28T04:23:18.402487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379277+0000","last_change":"2023-09-28T04:23:12.606390+0000","last_active":"2023-09-28T04:23:18.379277+0000","last_peered":"2023-09-28T04:23:18.379277+0000","last_clean":"2023-09-28T04:23:18.379277+0000","last_became_active":"2023-09-28T04:23:12.605965+0000","last_became_peered":"2023-09-28T04:23:12.605965+0000","last_unstale":"2023-09-28T04:23:18.379277+0000","last_undegraded":"2023-09-28T04:23:18.379277+0000","last_fullsized":"2023-09-28T04:23:18.379277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:11.833839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439531+0000","last_change":"2023-09-28T04:23:17.915114+0000","last_active":"2023-09-28T04:23:33.439531+0000","last_peered":"2023-09-28T04:23:33.439531+0000","last_clean":"2023-09-28T04:23:33.439531+0000","last_became_active":"2023-09-28T04:23:17.914697+0000","last_became_peered":"2023-09-28T04:23:17.914697+0000","last_unstale":"2023-09-28T04:23:33.439531+0000","last_undegraded":"2023-09-28T04:23:33.439531+0000","last_fullsized":"2023-09-28T04:23:33.439531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397753+0000","last_change":"2023-09-28T04:23:18.386681+0000","last_active":"2023-09-28T04:23:18.397753+0000","last_peered":"2023-09-28T04:23:18.397753+0000","last_clean":"2023-09-28T04:23:18.397753+0000","last_became_active":"2023-09-28T04:23:18.386380+0000","last_became_peered":"2023-09-28T04:23:18.386380+0000","last_unstale":"2023-09-28T04:23:18.397753+0000","last_undegraded":"2023-09-28T04:23:18.397753+0000","last_fullsized":"2023-09-28T04:23:18.397753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"21'5","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412964+0000","last_change":"2023-09-28T04:23:17.918404+0000","last_active":"2023-09-28T04:23:28.412964+0000","last_peered":"2023-09-28T04:23:28.412964+0000","last_clean":"2023-09-28T04:23:28.412964+0000","last_became_active":"2023-09-28T04:23:17.918116+0000","last_became_peered":"2023-09-28T04:23:17.918116+0000","last_unstale":"2023-09-28T04:23:28.412964+0000","last_undegraded":"2023-09-28T04:23:28.412964+0000","last_fullsized":"2023-09-28T04:23:28.412964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390737+0000","last_change":"2023-09-28T04:23:18.385213+0000","last_active":"2023-09-28T04:23:18.390737+0000","last_peered":"2023-09-28T04:23:18.390737+0000","last_clean":"2023-09-28T04:23:18.390737+0000","last_became_active":"2023-09-28T04:23:18.384930+0000","last_became_peered":"2023-09-28T04:23:18.384930+0000","last_unstale":"2023-09-28T04:23:18.390737+0000","last_undegraded":"2023-09-28T04:23:18.390737+0000","last_fullsized":"2023-09-28T04:23:18.390737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:06.681805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.384054+0000","last_change":"2023-09-28T04:23:17.905986+0000","last_active":"2023-09-28T04:23:23.384054+0000","last_peered":"2023-09-28T04:23:23.384054+0000","last_clean":"2023-09-28T04:23:23.384054+0000","last_became_active":"2023-09-28T04:23:17.905667+0000","last_became_peered":"2023-09-28T04:23:17.905667+0000","last_unstale":"2023-09-28T04:23:23.384054+0000","last_undegraded":"2023-09-28T04:23:23.384054+0000","last_fullsized":"2023-09-28T04:23:23.384054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402551+0000","last_change":"2023-09-28T04:23:18.400970+0000","last_active":"2023-09-28T04:23:18.402551+0000","last_peered":"2023-09-28T04:23:18.402551+0000","last_clean":"2023-09-28T04:23:18.402551+0000","last_became_active":"2023-09-28T04:23:18.400683+0000","last_became_peered":"2023-09-28T04:23:18.400683+0000","last_unstale":"2023-09-28T04:23:18.402551+0000","last_undegraded":"2023-09-28T04:23:18.402551+0000","last_fullsized":"2023-09-28T04:23:18.402551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:59:30.982762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440021+0000","last_change":"2023-09-28T04:23:17.905162+0000","last_active":"2023-09-28T04:23:33.440021+0000","last_peered":"2023-09-28T04:23:33.440021+0000","last_clean":"2023-09-28T04:23:33.440021+0000","last_became_active":"2023-09-28T04:23:17.904895+0000","last_became_peered":"2023-09-28T04:23:17.904895+0000","last_unstale":"2023-09-28T04:23:33.440021+0000","last_undegraded":"2023-09-28T04:23:33.440021+0000","last_fullsized":"2023-09-28T04:23:33.440021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402543+0000","last_change":"2023-09-28T04:23:18.400714+0000","last_active":"2023-09-28T04:23:18.402543+0000","last_peered":"2023-09-28T04:23:18.402543+0000","last_clean":"2023-09-28T04:23:18.402543+0000","last_became_active":"2023-09-28T04:23:18.400410+0000","last_became_peered":"2023-09-28T04:23:18.400410+0000","last_unstale":"2023-09-28T04:23:18.402543+0000","last_undegraded":"2023-09-28T04:23:18.402543+0000","last_fullsized":"2023-09-28T04:23:18.402543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:43:02.603601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.384516+0000","last_change":"2023-09-28T04:23:17.905493+0000","last_active":"2023-09-28T04:23:23.384516+0000","last_peered":"2023-09-28T04:23:23.384516+0000","last_clean":"2023-09-28T04:23:23.384516+0000","last_became_active":"2023-09-28T04:23:17.905198+0000","last_became_peered":"2023-09-28T04:23:17.905198+0000","last_unstale":"2023-09-28T04:23:23.384516+0000","last_undegraded":"2023-09-28T04:23:23.384516+0000","last_fullsized":"2023-09-28T04:23:23.384516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402220+0000","last_change":"2023-09-28T04:23:18.393194+0000","last_active":"2023-09-28T04:23:18.402220+0000","last_peered":"2023-09-28T04:23:18.402220+0000","last_clean":"2023-09-28T04:23:18.402220+0000","last_became_active":"2023-09-28T04:23:18.392400+0000","last_became_peered":"2023-09-28T04:23:18.392400+0000","last_unstale":"2023-09-28T04:23:18.402220+0000","last_undegraded":"2023-09-28T04:23:18.402220+0000","last_fullsized":"2023-09-28T04:23:18.402220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'9","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.438960+0000","last_change":"2023-09-28T04:23:17.917604+0000","last_active":"2023-09-28T04:23:33.438960+0000","last_peered":"2023-09-28T04:23:33.438960+0000","last_clean":"2023-09-28T04:23:33.438960+0000","last_became_active":"2023-09-28T04:23:17.917266+0000","last_became_peered":"2023-09-28T04:23:17.917266+0000","last_unstale":"2023-09-28T04:23:33.438960+0000","last_undegraded":"2023-09-28T04:23:33.438960+0000","last_fullsized":"2023-09-28T04:23:33.438960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395284+0000","last_change":"2023-09-28T04:23:18.386391+0000","last_active":"2023-09-28T04:23:18.395284+0000","last_peered":"2023-09-28T04:23:18.395284+0000","last_clean":"2023-09-28T04:23:18.395284+0000","last_became_active":"2023-09-28T04:23:18.386051+0000","last_became_peered":"2023-09-28T04:23:18.386051+0000","last_unstale":"2023-09-28T04:23:18.395284+0000","last_undegraded":"2023-09-28T04:23:18.395284+0000","last_fullsized":"2023-09-28T04:23:18.395284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392882+0000","last_change":"2023-09-28T04:23:18.389600+0000","last_active":"2023-09-28T04:23:18.392882+0000","last_peered":"2023-09-28T04:23:18.392882+0000","last_clean":"2023-09-28T04:23:18.392882+0000","last_became_active":"2023-09-28T04:23:18.389280+0000","last_became_peered":"2023-09-28T04:23:18.389280+0000","last_unstale":"2023-09-28T04:23:18.392882+0000","last_undegraded":"2023-09-28T04:23:18.392882+0000","last_fullsized":"2023-09-28T04:23:18.392882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:47.697305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402201+0000","last_change":"2023-09-28T04:23:18.392980+0000","last_active":"2023-09-28T04:23:18.402201+0000","last_peered":"2023-09-28T04:23:18.402201+0000","last_clean":"2023-09-28T04:23:18.402201+0000","last_became_active":"2023-09-28T04:23:18.390929+0000","last_became_peered":"2023-09-28T04:23:18.390929+0000","last_unstale":"2023-09-28T04:23:18.402201+0000","last_undegraded":"2023-09-28T04:23:18.402201+0000","last_fullsized":"2023-09-28T04:23:18.402201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397834+0000","last_change":"2023-09-28T04:23:18.387348+0000","last_active":"2023-09-28T04:23:18.397834+0000","last_peered":"2023-09-28T04:23:18.397834+0000","last_clean":"2023-09-28T04:23:18.397834+0000","last_became_active":"2023-09-28T04:23:18.385870+0000","last_became_peered":"2023-09-28T04:23:18.385870+0000","last_unstale":"2023-09-28T04:23:18.397834+0000","last_undegraded":"2023-09-28T04:23:18.397834+0000","last_fullsized":"2023-09-28T04:23:18.397834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:29:04.985060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402660+0000","last_change":"2023-09-28T04:23:18.392534+0000","last_active":"2023-09-28T04:23:18.402660+0000","last_peered":"2023-09-28T04:23:18.402660+0000","last_clean":"2023-09-28T04:23:18.402660+0000","last_became_active":"2023-09-28T04:23:18.392245+0000","last_became_peered":"2023-09-28T04:23:18.392245+0000","last_unstale":"2023-09-28T04:23:18.402660+0000","last_undegraded":"2023-09-28T04:23:18.402660+0000","last_fullsized":"2023-09-28T04:23:18.402660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395827+0000","last_change":"2023-09-28T04:23:18.391490+0000","last_active":"2023-09-28T04:23:18.395827+0000","last_peered":"2023-09-28T04:23:18.395827+0000","last_clean":"2023-09-28T04:23:18.395827+0000","last_became_active":"2023-09-28T04:23:18.391256+0000","last_became_peered":"2023-09-28T04:23:18.391256+0000","last_unstale":"2023-09-28T04:23:18.395827+0000","last_undegraded":"2023-09-28T04:23:18.395827+0000","last_fullsized":"2023-09-28T04:23:18.395827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:28:43.639301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4966,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":9932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8960,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362880,"statfs":{"total":96636764160,"available":96627589120,"internally_reserved":0,"allocated":319488,"data_stored":672443,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8356,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363484,"statfs":{"total":96636764160,"available":96628207616,"internally_reserved":0,"allocated":225280,"data_stored":79341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8412,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363428,"statfs":{"total":96636764160,"available":96628150272,"internally_reserved":0,"allocated":217088,"data_stored":79229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9020,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362820,"statfs":{"total":96636764160,"available":96627527680,"internally_reserved":0,"allocated":315392,"data_stored":671051,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8352,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363488,"statfs":{"total":96636764160,"available":96628211712,"internally_reserved":0,"allocated":221184,"data_stored":79319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8428,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363412,"statfs":{"total":96636764160,"available":96628133888,"internally_reserved":0,"allocated":233472,"data_stored":80449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8520,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363320,"statfs":{"total":96636764160,"available":96628039680,"internally_reserved":0,"allocated":262144,"data_stored":82149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8432,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363408,"statfs":{"total":96636764160,"available":96628129792,"internally_reserved":0,"allocated":237568,"data_stored":80519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T04:23:43.268 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-28T04:23:43.268 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T04:23:43.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.492+0000 7f45041ff700 1 Processor -- start 2023-09-28T04:23:43.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.492+0000 7f45041ff700 1 -- start start 2023-09-28T04:23:43.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.493+0000 7f45041ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44fc0676a0 0x7f44fc1557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.493+0000 7f45041ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44fc14fc80 0x7f44fc0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.493+0000 7f45041ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44fc0633d0 con 0x7f44fc14f8b0 2023-09-28T04:23:43.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.493+0000 7f45041ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc0c44b0 con 0x7f44fc14fc80 2023-09-28T04:23:43.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.493+0000 7f45041ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0bbd50 con 0x7f44fc0676a0 2023-09-28T04:23:43.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.494+0000 7f450279c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44fc14fc80 0x7f44fc0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.494+0000 7f450279c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44fc14fc80 0x7f44fc0c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54554/0 (socket says 172.21.15.118:54554) 2023-09-28T04:23:43.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.494+0000 7f450279c700 1 -- 172.21.15.118:0/2928631108 learned_addr learned my addr 172.21.15.118:0/2928631108 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:43.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.494+0000 7f450179a700 1 --2- 172.21.15.118:0/2928631108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44fc0676a0 0x7f44fc1557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.494+0000 7f450279c700 1 -- 172.21.15.118:0/2928631108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44fc0676a0 msgr2=0x7f44fc1557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:43.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.494+0000 7f450279c700 1 --2- 172.21.15.118:0/2928631108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44fc0676a0 0x7f44fc1557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.494+0000 7f450279c700 1 -- 172.21.15.118:0/2928631108 >> v1:172.21.15.174:6789/0 conn(0x7f44fc14f8b0 legacy=0x7f44fc0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.494+0000 7f450279c700 1 -- 172.21.15.118:0/2928631108 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc0636b0 con 0x7f44fc14fc80 2023-09-28T04:23:43.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.494+0000 7f4500f99700 1 -- 172.21.15.118:0/2928631108 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399469118 0 0) 0x7f44fc0633d0 con 0x7f44fc14f8b0 2023-09-28T04:23:43.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.494+0000 7f450279c700 1 --2- 172.21.15.118:0/2928631108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc14fc80 0x7f44fc0c8fa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009f20 tx=0x7f44f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a8d3a2051b7af6 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:43.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.495+0000 7f4500f99700 1 -- 172.21.15.118:0/2928631108 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400e070 con 0x7f44fc14fc80 2023-09-28T04:23:43.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.495+0000 7f4500f99700 1 -- 172.21.15.118:0/2928631108 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f400b9d0 con 0x7f44fc14fc80 2023-09-28T04:23:43.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.495+0000 7f4500f99700 1 -- 172.21.15.118:0/2928631108 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f40092e0 con 0x7f44fc14fc80 2023-09-28T04:23:43.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.495+0000 7f45041ff700 1 -- 172.21.15.118:0/2928631108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc14fc80 msgr2=0x7f44fc0c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.495+0000 7f45041ff700 1 --2- 172.21.15.118:0/2928631108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc14fc80 0x7f44fc0c8fa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009f20 tx=0x7f44f4009840 comp rx=0 tx=0).stop 2023-09-28T04:23:43.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.495+0000 7f45041ff700 1 -- 172.21.15.118:0/2928631108 shutdown_connections 2023-09-28T04:23:43.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.495+0000 7f45041ff700 1 --2- 172.21.15.118:0/2928631108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc14fc80 0x7f44fc0c8fa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.495+0000 7f45041ff700 1 --2- 172.21.15.118:0/2928631108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44fc0676a0 0x7f44fc1557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.495+0000 7f45041ff700 1 -- 172.21.15.118:0/2928631108 >> 172.21.15.118:0/2928631108 conn(0x7f44fc06a3b0 msgr2=0x7f44fc06a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:43.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.495+0000 7f45041ff700 1 -- 172.21.15.118:0/2928631108 shutdown_connections 2023-09-28T04:23:43.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.495+0000 7f45041ff700 1 -- 172.21.15.118:0/2928631108 wait complete. 2023-09-28T04:23:43.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.497+0000 7f45041ff700 1 Processor -- start 2023-09-28T04:23:43.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.497+0000 7f45041ff700 1 -- start start 2023-09-28T04:23:43.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f45041ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44fc0676a0 0x7f44fc150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f45041ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc14f8b0 0x7f44fc14f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f45041ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44fc14fc80 0x7f44fc168980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f45041ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc1530a0 con 0x7f44fc14f8b0 2023-09-28T04:23:43.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f45041ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc153610 con 0x7f44fc14fc80 2023-09-28T04:23:43.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f45041ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc152590 con 0x7f44fc0676a0 2023-09-28T04:23:43.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f450179a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc14f8b0 0x7f44fc14f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f450179a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc14f8b0 0x7f44fc14f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54560/0 (socket says 172.21.15.118:54560) 2023-09-28T04:23:43.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f450179a700 1 -- 172.21.15.118:0/3043210290 learned_addr learned my addr 172.21.15.118:0/3043210290 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:43.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f450279c700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44fc14fc80 0x7f44fc168980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f4501f9b700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44fc0676a0 0x7f44fc150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f450179a700 1 -- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44fc0676a0 msgr2=0x7f44fc150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f450179a700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44fc0676a0 0x7f44fc150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f450179a700 1 -- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44fc14fc80 msgr2=0x7f44fc168980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f450179a700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44fc14fc80 0x7f44fc168980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f450179a700 1 -- 172.21.15.118:0/3043210290 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4009ae0 con 0x7f44fc14f8b0 2023-09-28T04:23:43.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.498+0000 7f450179a700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc14f8b0 0x7f44fc14f060 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00ecb0 tx=0x7f44ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:43.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.499+0000 7f44f1ffb700 1 -- 172.21.15.118:0/3043210290 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec00c850 con 0x7f44fc14f8b0 2023-09-28T04:23:43.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.499+0000 7f44f1ffb700 1 -- 172.21.15.118:0/3043210290 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec00c9b0 con 0x7f44fc14f8b0 2023-09-28T04:23:43.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.499+0000 7f45041ff700 1 -- 172.21.15.118:0/3043210290 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc152800 con 0x7f44fc14f8b0 2023-09-28T04:23:43.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.499+0000 7f44f1ffb700 1 -- 172.21.15.118:0/3043210290 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec00cd50 con 0x7f44fc14f8b0 2023-09-28T04:23:43.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.499+0000 7f45041ff700 1 -- 172.21.15.118:0/3043210290 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc152dc0 con 0x7f44fc14f8b0 2023-09-28T04:23:43.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.500+0000 7f45041ff700 1 -- 172.21.15.118:0/3043210290 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc071980 con 0x7f44fc14f8b0 2023-09-28T04:23:43.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.501+0000 7f44f1ffb700 1 -- 172.21.15.118:0/3043210290 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f44ec013680 con 0x7f44fc14f8b0 2023-09-28T04:23:43.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.502+0000 7f44f1ffb700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f44e0067360 0x7f44e0069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.502+0000 7f44f1ffb700 1 -- 172.21.15.118:0/3043210290 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f44ec084e80 con 0x7f44fc14f8b0 2023-09-28T04:23:43.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.502+0000 7f4501f9b700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f44e0067360 0x7f44e0069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.503+0000 7f4501f9b700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f44e0067360 0x7f44e0069810 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f44f8007fd0 tx=0x7f44f8007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:43.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.506+0000 7f44f1ffb700 1 -- 172.21.15.118:0/3043210290 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f44ec051ce0 con 0x7f44fc14f8b0 2023-09-28T04:23:43.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.689+0000 7f45041ff700 1 -- 172.21.15.118:0/3043210290 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44fc158ea0 con 0x7f44e0067360 2023-09-28T04:23:43.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.697+0000 7f44f1ffb700 1 -- 172.21.15.118:0/3043210290 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284733 (secure 0 0 0) 0x7f44fc158ea0 con 0x7f44e0067360 2023-09-28T04:23:43.701 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:43.703 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.701+0000 7f45041ff700 1 -- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f44e0067360 msgr2=0x7f44e0069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.701+0000 7f45041ff700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f44e0067360 0x7f44e0069810 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f44f8007fd0 tx=0x7f44f8007d10 comp rx=0 tx=0).stop 2023-09-28T04:23:43.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.701+0000 7f45041ff700 1 -- 172.21.15.118:0/3043210290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc14f8b0 msgr2=0x7f44fc14f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.701+0000 7f45041ff700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc14f8b0 0x7f44fc14f060 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00ecb0 tx=0x7f44ec0091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.701+0000 7f45041ff700 1 -- 172.21.15.118:0/3043210290 shutdown_connections 2023-09-28T04:23:43.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.701+0000 7f45041ff700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f44e0067360 0x7f44e0069810 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.701+0000 7f45041ff700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44fc14fc80 0x7f44fc168980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.701+0000 7f45041ff700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44fc0676a0 0x7f44fc150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.701+0000 7f45041ff700 1 --2- 172.21.15.118:0/3043210290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc14f8b0 0x7f44fc14f060 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.701+0000 7f45041ff700 1 -- 172.21.15.118:0/3043210290 >> 172.21.15.118:0/3043210290 conn(0x7f44fc06a3b0 msgr2=0x7f44fc0c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:43.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.701+0000 7f45041ff700 1 -- 172.21.15.118:0/3043210290 shutdown_connections 2023-09-28T04:23:43.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.701+0000 7f45041ff700 1 -- 172.21.15.118:0/3043210290 wait complete. 2023-09-28T04:23:43.705 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-09-28T04:23:43.719 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-09-28T04:23:42.531483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595334,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":284,"num_write_kb":2451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68480,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":66432,"kb_avail":754906240,"statfs":{"total":773094113280,"available":773023989760,"internally_reserved":0,"allocated":2031616,"data_stored":1824500,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68026368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1330,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003699"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401799+0000","last_change":"2023-09-28T04:23:18.400475+0000","last_active":"2023-09-28T04:23:18.401799+0000","last_peered":"2023-09-28T04:23:18.401799+0000","last_clean":"2023-09-28T04:23:18.401799+0000","last_became_active":"2023-09-28T04:23:18.400107+0000","last_became_peered":"2023-09-28T04:23:18.400107+0000","last_unstale":"2023-09-28T04:23:18.401799+0000","last_undegraded":"2023-09-28T04:23:18.401799+0000","last_fullsized":"2023-09-28T04:23:18.401799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:44.340279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391569+0000","last_change":"2023-09-28T04:23:18.385136+0000","last_active":"2023-09-28T04:23:18.391569+0000","last_peered":"2023-09-28T04:23:18.391569+0000","last_clean":"2023-09-28T04:23:18.391569+0000","last_became_active":"2023-09-28T04:23:18.384789+0000","last_became_peered":"2023-09-28T04:23:18.384789+0000","last_unstale":"2023-09-28T04:23:18.391569+0000","last_undegraded":"2023-09-28T04:23:18.391569+0000","last_fullsized":"2023-09-28T04:23:18.391569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397939+0000","last_change":"2023-09-28T04:23:18.393700+0000","last_active":"2023-09-28T04:23:18.397939+0000","last_peered":"2023-09-28T04:23:18.397939+0000","last_clean":"2023-09-28T04:23:18.397939+0000","last_became_active":"2023-09-28T04:23:18.390599+0000","last_became_peered":"2023-09-28T04:23:18.390599+0000","last_unstale":"2023-09-28T04:23:18.397939+0000","last_undegraded":"2023-09-28T04:23:18.397939+0000","last_fullsized":"2023-09-28T04:23:18.397939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:43:19.782618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392953+0000","last_change":"2023-09-28T04:23:18.390865+0000","last_active":"2023-09-28T04:23:18.392953+0000","last_peered":"2023-09-28T04:23:18.392953+0000","last_clean":"2023-09-28T04:23:18.392953+0000","last_became_active":"2023-09-28T04:23:18.390607+0000","last_became_peered":"2023-09-28T04:23:18.390607+0000","last_unstale":"2023-09-28T04:23:18.392953+0000","last_undegraded":"2023-09-28T04:23:18.392953+0000","last_fullsized":"2023-09-28T04:23:18.392953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.405585+0000","last_change":"2023-09-28T04:23:18.404215+0000","last_active":"2023-09-28T04:23:18.405585+0000","last_peered":"2023-09-28T04:23:18.405585+0000","last_clean":"2023-09-28T04:23:18.405585+0000","last_became_active":"2023-09-28T04:23:18.403960+0000","last_became_peered":"2023-09-28T04:23:18.403960+0000","last_unstale":"2023-09-28T04:23:18.405585+0000","last_undegraded":"2023-09-28T04:23:18.405585+0000","last_fullsized":"2023-09-28T04:23:18.405585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397969+0000","last_change":"2023-09-28T04:23:18.393987+0000","last_active":"2023-09-28T04:23:18.397969+0000","last_peered":"2023-09-28T04:23:18.397969+0000","last_clean":"2023-09-28T04:23:18.397969+0000","last_became_active":"2023-09-28T04:23:18.390575+0000","last_became_peered":"2023-09-28T04:23:18.390575+0000","last_unstale":"2023-09-28T04:23:18.397969+0000","last_undegraded":"2023-09-28T04:23:18.397969+0000","last_fullsized":"2023-09-28T04:23:18.397969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:24:51.659204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400984+0000","last_change":"2023-09-28T04:23:18.396733+0000","last_active":"2023-09-28T04:23:18.400984+0000","last_peered":"2023-09-28T04:23:18.400984+0000","last_clean":"2023-09-28T04:23:18.400984+0000","last_became_active":"2023-09-28T04:23:18.396038+0000","last_became_peered":"2023-09-28T04:23:18.396038+0000","last_unstale":"2023-09-28T04:23:18.400984+0000","last_undegraded":"2023-09-28T04:23:18.400984+0000","last_fullsized":"2023-09-28T04:23:18.400984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391542+0000","last_change":"2023-09-28T04:23:18.388208+0000","last_active":"2023-09-28T04:23:18.391542+0000","last_peered":"2023-09-28T04:23:18.391542+0000","last_clean":"2023-09-28T04:23:18.391542+0000","last_became_active":"2023-09-28T04:23:18.387260+0000","last_became_peered":"2023-09-28T04:23:18.387260+0000","last_unstale":"2023-09-28T04:23:18.391542+0000","last_undegraded":"2023-09-28T04:23:18.391542+0000","last_fullsized":"2023-09-28T04:23:18.391542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.405212+0000","last_change":"2023-09-28T04:23:18.403803+0000","last_active":"2023-09-28T04:23:18.405212+0000","last_peered":"2023-09-28T04:23:18.405212+0000","last_clean":"2023-09-28T04:23:18.405212+0000","last_became_active":"2023-09-28T04:23:18.403565+0000","last_became_peered":"2023-09-28T04:23:18.403565+0000","last_unstale":"2023-09-28T04:23:18.405212+0000","last_undegraded":"2023-09-28T04:23:18.405212+0000","last_fullsized":"2023-09-28T04:23:18.405212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397774+0000","last_change":"2023-09-28T04:23:18.392418+0000","last_active":"2023-09-28T04:23:18.397774+0000","last_peered":"2023-09-28T04:23:18.397774+0000","last_clean":"2023-09-28T04:23:18.397774+0000","last_became_active":"2023-09-28T04:23:18.390911+0000","last_became_peered":"2023-09-28T04:23:18.390911+0000","last_unstale":"2023-09-28T04:23:18.397774+0000","last_undegraded":"2023-09-28T04:23:18.397774+0000","last_fullsized":"2023-09-28T04:23:18.397774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397957+0000","last_change":"2023-09-28T04:23:18.393845+0000","last_active":"2023-09-28T04:23:18.397957+0000","last_peered":"2023-09-28T04:23:18.397957+0000","last_clean":"2023-09-28T04:23:18.397957+0000","last_became_active":"2023-09-28T04:23:18.393524+0000","last_became_peered":"2023-09-28T04:23:18.393524+0000","last_unstale":"2023-09-28T04:23:18.397957+0000","last_undegraded":"2023-09-28T04:23:18.397957+0000","last_fullsized":"2023-09-28T04:23:18.397957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:27:39.596054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390755+0000","last_change":"2023-09-28T04:23:18.385250+0000","last_active":"2023-09-28T04:23:18.390755+0000","last_peered":"2023-09-28T04:23:18.390755+0000","last_clean":"2023-09-28T04:23:18.390755+0000","last_became_active":"2023-09-28T04:23:18.384986+0000","last_became_peered":"2023-09-28T04:23:18.384986+0000","last_unstale":"2023-09-28T04:23:18.390755+0000","last_undegraded":"2023-09-28T04:23:18.390755+0000","last_fullsized":"2023-09-28T04:23:18.390755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:15.500469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404651+0000","last_change":"2023-09-28T04:23:18.402417+0000","last_active":"2023-09-28T04:23:18.404651+0000","last_peered":"2023-09-28T04:23:18.404651+0000","last_clean":"2023-09-28T04:23:18.404651+0000","last_became_active":"2023-09-28T04:23:18.402161+0000","last_became_peered":"2023-09-28T04:23:18.402161+0000","last_unstale":"2023-09-28T04:23:18.404651+0000","last_undegraded":"2023-09-28T04:23:18.404651+0000","last_fullsized":"2023-09-28T04:23:18.404651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:50.909915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391345+0000","last_change":"2023-09-28T04:23:18.387808+0000","last_active":"2023-09-28T04:23:18.391345+0000","last_peered":"2023-09-28T04:23:18.391345+0000","last_clean":"2023-09-28T04:23:18.391345+0000","last_became_active":"2023-09-28T04:23:18.387471+0000","last_became_peered":"2023-09-28T04:23:18.387471+0000","last_unstale":"2023-09-28T04:23:18.391345+0000","last_undegraded":"2023-09-28T04:23:18.391345+0000","last_fullsized":"2023-09-28T04:23:18.391345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401004+0000","last_change":"2023-09-28T04:23:18.396945+0000","last_active":"2023-09-28T04:23:18.401004+0000","last_peered":"2023-09-28T04:23:18.401004+0000","last_clean":"2023-09-28T04:23:18.401004+0000","last_became_active":"2023-09-28T04:23:18.396395+0000","last_became_peered":"2023-09-28T04:23:18.396395+0000","last_unstale":"2023-09-28T04:23:18.401004+0000","last_undegraded":"2023-09-28T04:23:18.401004+0000","last_fullsized":"2023-09-28T04:23:18.401004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397971+0000","last_change":"2023-09-28T04:23:18.393975+0000","last_active":"2023-09-28T04:23:18.397971+0000","last_peered":"2023-09-28T04:23:18.397971+0000","last_clean":"2023-09-28T04:23:18.397971+0000","last_became_active":"2023-09-28T04:23:18.393683+0000","last_became_peered":"2023-09-28T04:23:18.393683+0000","last_unstale":"2023-09-28T04:23:18.397971+0000","last_undegraded":"2023-09-28T04:23:18.397971+0000","last_fullsized":"2023-09-28T04:23:18.397971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:06:40.927453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404561+0000","last_change":"2023-09-28T04:23:18.402518+0000","last_active":"2023-09-28T04:23:18.404561+0000","last_peered":"2023-09-28T04:23:18.404561+0000","last_clean":"2023-09-28T04:23:18.404561+0000","last_became_active":"2023-09-28T04:23:18.402275+0000","last_became_peered":"2023-09-28T04:23:18.402275+0000","last_unstale":"2023-09-28T04:23:18.404561+0000","last_undegraded":"2023-09-28T04:23:18.404561+0000","last_fullsized":"2023-09-28T04:23:18.404561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400750+0000","last_change":"2023-09-28T04:23:18.395032+0000","last_active":"2023-09-28T04:23:18.400750+0000","last_peered":"2023-09-28T04:23:18.400750+0000","last_clean":"2023-09-28T04:23:18.400750+0000","last_became_active":"2023-09-28T04:23:18.390678+0000","last_became_peered":"2023-09-28T04:23:18.390678+0000","last_unstale":"2023-09-28T04:23:18.400750+0000","last_undegraded":"2023-09-28T04:23:18.400750+0000","last_fullsized":"2023-09-28T04:23:18.400750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390373+0000","last_change":"2023-09-28T04:23:18.385209+0000","last_active":"2023-09-28T04:23:18.390373+0000","last_peered":"2023-09-28T04:23:18.390373+0000","last_clean":"2023-09-28T04:23:18.390373+0000","last_became_active":"2023-09-28T04:23:18.384916+0000","last_became_peered":"2023-09-28T04:23:18.384916+0000","last_unstale":"2023-09-28T04:23:18.390373+0000","last_undegraded":"2023-09-28T04:23:18.390373+0000","last_fullsized":"2023-09-28T04:23:18.390373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:06.937552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397758+0000","last_change":"2023-09-28T04:23:18.386692+0000","last_active":"2023-09-28T04:23:18.397758+0000","last_peered":"2023-09-28T04:23:18.397758+0000","last_clean":"2023-09-28T04:23:18.397758+0000","last_became_active":"2023-09-28T04:23:18.385805+0000","last_became_peered":"2023-09-28T04:23:18.385805+0000","last_unstale":"2023-09-28T04:23:18.397758+0000","last_undegraded":"2023-09-28T04:23:18.397758+0000","last_fullsized":"2023-09-28T04:23:18.397758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:52:07.899487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401120+0000","last_change":"2023-09-28T04:23:18.400497+0000","last_active":"2023-09-28T04:23:18.401120+0000","last_peered":"2023-09-28T04:23:18.401120+0000","last_clean":"2023-09-28T04:23:18.401120+0000","last_became_active":"2023-09-28T04:23:18.400230+0000","last_became_peered":"2023-09-28T04:23:18.400230+0000","last_unstale":"2023-09-28T04:23:18.401120+0000","last_undegraded":"2023-09-28T04:23:18.401120+0000","last_fullsized":"2023-09-28T04:23:18.401120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399068+0000","last_change":"2023-09-28T04:23:18.391683+0000","last_active":"2023-09-28T04:23:18.399068+0000","last_peered":"2023-09-28T04:23:18.399068+0000","last_clean":"2023-09-28T04:23:18.399068+0000","last_became_active":"2023-09-28T04:23:18.391373+0000","last_became_peered":"2023-09-28T04:23:18.391373+0000","last_unstale":"2023-09-28T04:23:18.399068+0000","last_undegraded":"2023-09-28T04:23:18.399068+0000","last_fullsized":"2023-09-28T04:23:18.399068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402238+0000","last_change":"2023-09-28T04:23:18.393381+0000","last_active":"2023-09-28T04:23:18.402238+0000","last_peered":"2023-09-28T04:23:18.402238+0000","last_clean":"2023-09-28T04:23:18.402238+0000","last_became_active":"2023-09-28T04:23:18.392723+0000","last_became_peered":"2023-09-28T04:23:18.392723+0000","last_unstale":"2023-09-28T04:23:18.402238+0000","last_undegraded":"2023-09-28T04:23:18.402238+0000","last_fullsized":"2023-09-28T04:23:18.402238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.403069+0000","last_change":"2023-09-28T04:23:18.402467+0000","last_active":"2023-09-28T04:23:18.403069+0000","last_peered":"2023-09-28T04:23:18.403069+0000","last_clean":"2023-09-28T04:23:18.403069+0000","last_became_active":"2023-09-28T04:23:18.402197+0000","last_became_peered":"2023-09-28T04:23:18.402197+0000","last_unstale":"2023-09-28T04:23:18.403069+0000","last_undegraded":"2023-09-28T04:23:18.403069+0000","last_fullsized":"2023-09-28T04:23:18.403069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.396757+0000","last_change":"2023-09-28T04:23:18.389242+0000","last_active":"2023-09-28T04:23:18.396757+0000","last_peered":"2023-09-28T04:23:18.396757+0000","last_clean":"2023-09-28T04:23:18.396757+0000","last_became_active":"2023-09-28T04:23:18.388936+0000","last_became_peered":"2023-09-28T04:23:18.388936+0000","last_unstale":"2023-09-28T04:23:18.396757+0000","last_undegraded":"2023-09-28T04:23:18.396757+0000","last_fullsized":"2023-09-28T04:23:18.396757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:19.108476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395209+0000","last_change":"2023-09-28T04:23:18.388941+0000","last_active":"2023-09-28T04:23:18.395209+0000","last_peered":"2023-09-28T04:23:18.395209+0000","last_clean":"2023-09-28T04:23:18.395209+0000","last_became_active":"2023-09-28T04:23:18.388682+0000","last_became_peered":"2023-09-28T04:23:18.388682+0000","last_unstale":"2023-09-28T04:23:18.395209+0000","last_undegraded":"2023-09-28T04:23:18.395209+0000","last_fullsized":"2023-09-28T04:23:18.395209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395293+0000","last_change":"2023-09-28T04:23:18.391753+0000","last_active":"2023-09-28T04:23:18.395293+0000","last_peered":"2023-09-28T04:23:18.395293+0000","last_clean":"2023-09-28T04:23:18.395293+0000","last_became_active":"2023-09-28T04:23:18.391031+0000","last_became_peered":"2023-09-28T04:23:18.391031+0000","last_unstale":"2023-09-28T04:23:18.395293+0000","last_undegraded":"2023-09-28T04:23:18.395293+0000","last_fullsized":"2023-09-28T04:23:18.395293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440177+0000","last_change":"2023-09-28T04:23:17.914158+0000","last_active":"2023-09-28T04:23:33.440177+0000","last_peered":"2023-09-28T04:23:33.440177+0000","last_clean":"2023-09-28T04:23:33.440177+0000","last_became_active":"2023-09-28T04:23:17.913941+0000","last_became_peered":"2023-09-28T04:23:17.913941+0000","last_unstale":"2023-09-28T04:23:33.440177+0000","last_undegraded":"2023-09-28T04:23:33.440177+0000","last_fullsized":"2023-09-28T04:23:33.440177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401811+0000","last_change":"2023-09-28T04:23:18.390288+0000","last_active":"2023-09-28T04:23:18.401811+0000","last_peered":"2023-09-28T04:23:18.401811+0000","last_clean":"2023-09-28T04:23:18.401811+0000","last_became_active":"2023-09-28T04:23:18.390030+0000","last_became_peered":"2023-09-28T04:23:18.390030+0000","last_unstale":"2023-09-28T04:23:18.401811+0000","last_undegraded":"2023-09-28T04:23:18.401811+0000","last_fullsized":"2023-09-28T04:23:18.401811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439320+0000","last_change":"2023-09-28T04:23:17.914311+0000","last_active":"2023-09-28T04:23:33.439320+0000","last_peered":"2023-09-28T04:23:33.439320+0000","last_clean":"2023-09-28T04:23:33.439320+0000","last_became_active":"2023-09-28T04:23:17.913950+0000","last_became_peered":"2023-09-28T04:23:17.913950+0000","last_unstale":"2023-09-28T04:23:33.439320+0000","last_undegraded":"2023-09-28T04:23:33.439320+0000","last_fullsized":"2023-09-28T04:23:33.439320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399162+0000","last_change":"2023-09-28T04:23:18.393402+0000","last_active":"2023-09-28T04:23:18.399162+0000","last_peered":"2023-09-28T04:23:18.399162+0000","last_clean":"2023-09-28T04:23:18.399162+0000","last_became_active":"2023-09-28T04:23:18.393106+0000","last_became_peered":"2023-09-28T04:23:18.393106+0000","last_unstale":"2023-09-28T04:23:18.399162+0000","last_undegraded":"2023-09-28T04:23:18.399162+0000","last_fullsized":"2023-09-28T04:23:18.399162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.375882+0000","last_change":"2023-09-28T04:23:17.911104+0000","last_active":"2023-09-28T04:23:19.375882+0000","last_peered":"2023-09-28T04:23:19.375882+0000","last_clean":"2023-09-28T04:23:19.375882+0000","last_became_active":"2023-09-28T04:23:17.910766+0000","last_became_peered":"2023-09-28T04:23:17.910766+0000","last_unstale":"2023-09-28T04:23:19.375882+0000","last_undegraded":"2023-09-28T04:23:19.375882+0000","last_fullsized":"2023-09-28T04:23:19.375882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391763+0000","last_change":"2023-09-28T04:23:18.388098+0000","last_active":"2023-09-28T04:23:18.391763+0000","last_peered":"2023-09-28T04:23:18.391763+0000","last_clean":"2023-09-28T04:23:18.391763+0000","last_became_active":"2023-09-28T04:23:18.387581+0000","last_became_peered":"2023-09-28T04:23:18.387581+0000","last_unstale":"2023-09-28T04:23:18.391763+0000","last_undegraded":"2023-09-28T04:23:18.391763+0000","last_fullsized":"2023-09-28T04:23:18.391763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:11.090984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.409275+0000","last_change":"2023-09-28T04:23:17.917921+0000","last_active":"2023-09-28T04:23:28.409275+0000","last_peered":"2023-09-28T04:23:28.409275+0000","last_clean":"2023-09-28T04:23:28.409275+0000","last_became_active":"2023-09-28T04:23:17.917596+0000","last_became_peered":"2023-09-28T04:23:17.917596+0000","last_unstale":"2023-09-28T04:23:28.409275+0000","last_undegraded":"2023-09-28T04:23:28.409275+0000","last_fullsized":"2023-09-28T04:23:28.409275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402470+0000","last_change":"2023-09-28T04:23:18.394460+0000","last_active":"2023-09-28T04:23:18.402470+0000","last_peered":"2023-09-28T04:23:18.402470+0000","last_clean":"2023-09-28T04:23:18.402470+0000","last_became_active":"2023-09-28T04:23:18.391773+0000","last_became_peered":"2023-09-28T04:23:18.391773+0000","last_unstale":"2023-09-28T04:23:18.402470+0000","last_undegraded":"2023-09-28T04:23:18.402470+0000","last_fullsized":"2023-09-28T04:23:18.402470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.408519+0000","last_change":"2023-09-28T04:23:17.908875+0000","last_active":"2023-09-28T04:23:28.408519+0000","last_peered":"2023-09-28T04:23:28.408519+0000","last_clean":"2023-09-28T04:23:28.408519+0000","last_became_active":"2023-09-28T04:23:17.908599+0000","last_became_peered":"2023-09-28T04:23:17.908599+0000","last_unstale":"2023-09-28T04:23:28.408519+0000","last_undegraded":"2023-09-28T04:23:28.408519+0000","last_fullsized":"2023-09-28T04:23:28.408519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402255+0000","last_change":"2023-09-28T04:23:18.393856+0000","last_active":"2023-09-28T04:23:18.402255+0000","last_peered":"2023-09-28T04:23:18.402255+0000","last_clean":"2023-09-28T04:23:18.402255+0000","last_became_active":"2023-09-28T04:23:18.393631+0000","last_became_peered":"2023-09-28T04:23:18.393631+0000","last_unstale":"2023-09-28T04:23:18.402255+0000","last_undegraded":"2023-09-28T04:23:18.402255+0000","last_fullsized":"2023-09-28T04:23:18.402255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.385554+0000","last_change":"2023-09-28T04:23:17.911594+0000","last_active":"2023-09-28T04:23:23.385554+0000","last_peered":"2023-09-28T04:23:23.385554+0000","last_clean":"2023-09-28T04:23:23.385554+0000","last_became_active":"2023-09-28T04:23:17.911361+0000","last_became_peered":"2023-09-28T04:23:17.911361+0000","last_unstale":"2023-09-28T04:23:23.385554+0000","last_undegraded":"2023-09-28T04:23:23.385554+0000","last_fullsized":"2023-09-28T04:23:23.385554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.394029+0000","last_change":"2023-09-28T04:23:18.387908+0000","last_active":"2023-09-28T04:23:18.394029+0000","last_peered":"2023-09-28T04:23:18.394029+0000","last_clean":"2023-09-28T04:23:18.394029+0000","last_became_active":"2023-09-28T04:23:18.387672+0000","last_became_peered":"2023-09-28T04:23:18.387672+0000","last_unstale":"2023-09-28T04:23:18.394029+0000","last_undegraded":"2023-09-28T04:23:18.394029+0000","last_fullsized":"2023-09-28T04:23:18.394029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.408892+0000","last_change":"2023-09-28T04:23:17.904974+0000","last_active":"2023-09-28T04:23:28.408892+0000","last_peered":"2023-09-28T04:23:28.408892+0000","last_clean":"2023-09-28T04:23:28.408892+0000","last_became_active":"2023-09-28T04:23:17.904734+0000","last_became_peered":"2023-09-28T04:23:17.904734+0000","last_unstale":"2023-09-28T04:23:28.408892+0000","last_undegraded":"2023-09-28T04:23:28.408892+0000","last_fullsized":"2023-09-28T04:23:28.408892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397872+0000","last_change":"2023-09-28T04:23:18.389128+0000","last_active":"2023-09-28T04:23:18.397872+0000","last_peered":"2023-09-28T04:23:18.397872+0000","last_clean":"2023-09-28T04:23:18.397872+0000","last_became_active":"2023-09-28T04:23:18.388871+0000","last_became_peered":"2023-09-28T04:23:18.388871+0000","last_unstale":"2023-09-28T04:23:18.397872+0000","last_undegraded":"2023-09-28T04:23:18.397872+0000","last_fullsized":"2023-09-28T04:23:18.397872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:33:50.957431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440656+0000","last_change":"2023-09-28T04:23:17.910343+0000","last_active":"2023-09-28T04:23:33.440656+0000","last_peered":"2023-09-28T04:23:33.440656+0000","last_clean":"2023-09-28T04:23:33.440656+0000","last_became_active":"2023-09-28T04:23:17.909981+0000","last_became_peered":"2023-09-28T04:23:17.909981+0000","last_unstale":"2023-09-28T04:23:33.440656+0000","last_undegraded":"2023-09-28T04:23:33.440656+0000","last_fullsized":"2023-09-28T04:23:33.440656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:11.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402619+0000","last_change":"2023-09-28T04:23:18.391696+0000","last_active":"2023-09-28T04:23:18.402619+0000","last_peered":"2023-09-28T04:23:18.402619+0000","last_clean":"2023-09-28T04:23:18.402619+0000","last_became_active":"2023-09-28T04:23:18.391441+0000","last_became_peered":"2023-09-28T04:23:18.391441+0000","last_unstale":"2023-09-28T04:23:18.402619+0000","last_undegraded":"2023-09-28T04:23:18.402619+0000","last_fullsized":"2023-09-28T04:23:18.402619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412822+0000","last_change":"2023-09-28T04:23:17.916730+0000","last_active":"2023-09-28T04:23:28.412822+0000","last_peered":"2023-09-28T04:23:28.412822+0000","last_clean":"2023-09-28T04:23:28.412822+0000","last_became_active":"2023-09-28T04:23:17.916424+0000","last_became_peered":"2023-09-28T04:23:17.916424+0000","last_unstale":"2023-09-28T04:23:28.412822+0000","last_undegraded":"2023-09-28T04:23:28.412822+0000","last_fullsized":"2023-09-28T04:23:28.412822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392344+0000","last_change":"2023-09-28T04:23:18.391510+0000","last_active":"2023-09-28T04:23:18.392344+0000","last_peered":"2023-09-28T04:23:18.392344+0000","last_clean":"2023-09-28T04:23:18.392344+0000","last_became_active":"2023-09-28T04:23:18.390613+0000","last_became_peered":"2023-09-28T04:23:18.390613+0000","last_unstale":"2023-09-28T04:23:18.392344+0000","last_undegraded":"2023-09-28T04:23:18.392344+0000","last_fullsized":"2023-09-28T04:23:18.392344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440750+0000","last_change":"2023-09-28T04:23:17.910760+0000","last_active":"2023-09-28T04:23:33.440750+0000","last_peered":"2023-09-28T04:23:33.440750+0000","last_clean":"2023-09-28T04:23:33.440750+0000","last_became_active":"2023-09-28T04:23:17.910457+0000","last_became_peered":"2023-09-28T04:23:17.910457+0000","last_unstale":"2023-09-28T04:23:33.440750+0000","last_undegraded":"2023-09-28T04:23:33.440750+0000","last_fullsized":"2023-09-28T04:23:33.440750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:10.087083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.404516+0000","last_change":"2023-09-28T04:23:18.402823+0000","last_active":"2023-09-28T04:23:18.404516+0000","last_peered":"2023-09-28T04:23:18.404516+0000","last_clean":"2023-09-28T04:23:18.404516+0000","last_became_active":"2023-09-28T04:23:18.402559+0000","last_became_peered":"2023-09-28T04:23:18.402559+0000","last_unstale":"2023-09-28T04:23:18.404516+0000","last_undegraded":"2023-09-28T04:23:18.404516+0000","last_fullsized":"2023-09-28T04:23:18.404516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'15","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440298+0000","last_change":"2023-09-28T04:23:17.910972+0000","last_active":"2023-09-28T04:23:33.440298+0000","last_peered":"2023-09-28T04:23:33.440298+0000","last_clean":"2023-09-28T04:23:33.440298+0000","last_became_active":"2023-09-28T04:23:17.910650+0000","last_became_peered":"2023-09-28T04:23:17.910650+0000","last_unstale":"2023-09-28T04:23:33.440298+0000","last_undegraded":"2023-09-28T04:23:33.440298+0000","last_fullsized":"2023-09-28T04:23:33.440298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:03:36.553513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402556+0000","last_change":"2023-09-28T04:23:18.395424+0000","last_active":"2023-09-28T04:23:18.402556+0000","last_peered":"2023-09-28T04:23:18.402556+0000","last_clean":"2023-09-28T04:23:18.402556+0000","last_became_active":"2023-09-28T04:23:18.394721+0000","last_became_peered":"2023-09-28T04:23:18.394721+0000","last_unstale":"2023-09-28T04:23:18.402556+0000","last_undegraded":"2023-09-28T04:23:18.402556+0000","last_fullsized":"2023-09-28T04:23:18.402556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.385189+0000","last_change":"2023-09-28T04:23:17.907642+0000","last_active":"2023-09-28T04:23:23.385189+0000","last_peered":"2023-09-28T04:23:23.385189+0000","last_clean":"2023-09-28T04:23:23.385189+0000","last_became_active":"2023-09-28T04:23:17.907331+0000","last_became_peered":"2023-09-28T04:23:17.907331+0000","last_unstale":"2023-09-28T04:23:23.385189+0000","last_undegraded":"2023-09-28T04:23:23.385189+0000","last_fullsized":"2023-09-28T04:23:23.385189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.393277+0000","last_change":"2023-09-28T04:23:18.390910+0000","last_active":"2023-09-28T04:23:18.393277+0000","last_peered":"2023-09-28T04:23:18.393277+0000","last_clean":"2023-09-28T04:23:18.393277+0000","last_became_active":"2023-09-28T04:23:18.390633+0000","last_became_peered":"2023-09-28T04:23:18.390633+0000","last_unstale":"2023-09-28T04:23:18.393277+0000","last_undegraded":"2023-09-28T04:23:18.393277+0000","last_fullsized":"2023-09-28T04:23:18.393277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.383758+0000","last_change":"2023-09-28T04:23:17.906320+0000","last_active":"2023-09-28T04:23:23.383758+0000","last_peered":"2023-09-28T04:23:23.383758+0000","last_clean":"2023-09-28T04:23:23.383758+0000","last_became_active":"2023-09-28T04:23:17.906036+0000","last_became_peered":"2023-09-28T04:23:17.906036+0000","last_unstale":"2023-09-28T04:23:23.383758+0000","last_undegraded":"2023-09-28T04:23:23.383758+0000","last_fullsized":"2023-09-28T04:23:23.383758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397773+0000","last_change":"2023-09-28T04:23:18.386196+0000","last_active":"2023-09-28T04:23:18.397773+0000","last_peered":"2023-09-28T04:23:18.397773+0000","last_clean":"2023-09-28T04:23:18.397773+0000","last_became_active":"2023-09-28T04:23:18.385693+0000","last_became_peered":"2023-09-28T04:23:18.385693+0000","last_unstale":"2023-09-28T04:23:18.397773+0000","last_undegraded":"2023-09-28T04:23:18.397773+0000","last_fullsized":"2023-09-28T04:23:18.397773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:13:42.846995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172978+0000","last_change":"2023-09-28T04:23:17.908768+0000","last_active":"2023-09-28T04:23:20.172978+0000","last_peered":"2023-09-28T04:23:20.172978+0000","last_clean":"2023-09-28T04:23:20.172978+0000","last_became_active":"2023-09-28T04:23:17.908493+0000","last_became_peered":"2023-09-28T04:23:17.908493+0000","last_unstale":"2023-09-28T04:23:20.172978+0000","last_undegraded":"2023-09-28T04:23:20.172978+0000","last_fullsized":"2023-09-28T04:23:20.172978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388563+0000","last_change":"2023-09-28T04:23:18.385404+0000","last_active":"2023-09-28T04:23:18.388563+0000","last_peered":"2023-09-28T04:23:18.388563+0000","last_clean":"2023-09-28T04:23:18.388563+0000","last_became_active":"2023-09-28T04:23:18.385112+0000","last_became_peered":"2023-09-28T04:23:18.385112+0000","last_unstale":"2023-09-28T04:23:18.388563+0000","last_undegraded":"2023-09-28T04:23:18.388563+0000","last_fullsized":"2023-09-28T04:23:18.388563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:06.331056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439864+0000","last_change":"2023-09-28T04:23:17.898518+0000","last_active":"2023-09-28T04:23:33.439864+0000","last_peered":"2023-09-28T04:23:33.439864+0000","last_clean":"2023-09-28T04:23:33.439864+0000","last_became_active":"2023-09-28T04:23:17.898232+0000","last_became_peered":"2023-09-28T04:23:17.898232+0000","last_unstale":"2023-09-28T04:23:33.439864+0000","last_undegraded":"2023-09-28T04:23:33.439864+0000","last_fullsized":"2023-09-28T04:23:33.439864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399188+0000","last_change":"2023-09-28T04:23:18.392206+0000","last_active":"2023-09-28T04:23:18.399188+0000","last_peered":"2023-09-28T04:23:18.399188+0000","last_clean":"2023-09-28T04:23:18.399188+0000","last_became_active":"2023-09-28T04:23:18.391963+0000","last_became_peered":"2023-09-28T04:23:18.391963+0000","last_unstale":"2023-09-28T04:23:18.399188+0000","last_undegraded":"2023-09-28T04:23:18.399188+0000","last_fullsized":"2023-09-28T04:23:18.399188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.410038+0000","last_change":"2023-09-28T04:23:17.905390+0000","last_active":"2023-09-28T04:23:28.410038+0000","last_peered":"2023-09-28T04:23:28.410038+0000","last_clean":"2023-09-28T04:23:28.410038+0000","last_became_active":"2023-09-28T04:23:17.905089+0000","last_became_peered":"2023-09-28T04:23:17.905089+0000","last_unstale":"2023-09-28T04:23:28.410038+0000","last_undegraded":"2023-09-28T04:23:28.410038+0000","last_fullsized":"2023-09-28T04:23:28.410038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401474+0000","last_change":"2023-09-28T04:23:18.400110+0000","last_active":"2023-09-28T04:23:18.401474+0000","last_peered":"2023-09-28T04:23:18.401474+0000","last_clean":"2023-09-28T04:23:18.401474+0000","last_became_active":"2023-09-28T04:23:18.399839+0000","last_became_peered":"2023-09-28T04:23:18.399839+0000","last_unstale":"2023-09-28T04:23:18.401474+0000","last_undegraded":"2023-09-28T04:23:18.401474+0000","last_fullsized":"2023-09-28T04:23:18.401474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172225+0000","last_change":"2023-09-28T04:23:17.912734+0000","last_active":"2023-09-28T04:23:20.172225+0000","last_peered":"2023-09-28T04:23:20.172225+0000","last_clean":"2023-09-28T04:23:20.172225+0000","last_became_active":"2023-09-28T04:23:17.912560+0000","last_became_peered":"2023-09-28T04:23:17.912560+0000","last_unstale":"2023-09-28T04:23:20.172225+0000","last_undegraded":"2023-09-28T04:23:20.172225+0000","last_fullsized":"2023-09-28T04:23:20.172225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397919+0000","last_change":"2023-09-28T04:23:18.393554+0000","last_active":"2023-09-28T04:23:18.397919+0000","last_peered":"2023-09-28T04:23:18.397919+0000","last_clean":"2023-09-28T04:23:18.397919+0000","last_became_active":"2023-09-28T04:23:18.390268+0000","last_became_peered":"2023-09-28T04:23:18.390268+0000","last_unstale":"2023-09-28T04:23:18.397919+0000","last_undegraded":"2023-09-28T04:23:18.397919+0000","last_fullsized":"2023-09-28T04:23:18.397919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:03:10.156071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412334+0000","last_change":"2023-09-28T04:23:17.911218+0000","last_active":"2023-09-28T04:23:28.412334+0000","last_peered":"2023-09-28T04:23:28.412334+0000","last_clean":"2023-09-28T04:23:28.412334+0000","last_became_active":"2023-09-28T04:23:17.910887+0000","last_became_peered":"2023-09-28T04:23:17.910887+0000","last_unstale":"2023-09-28T04:23:28.412334+0000","last_undegraded":"2023-09-28T04:23:28.412334+0000","last_fullsized":"2023-09-28T04:23:28.412334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397818+0000","last_change":"2023-09-28T04:23:18.387932+0000","last_active":"2023-09-28T04:23:18.397818+0000","last_peered":"2023-09-28T04:23:18.397818+0000","last_clean":"2023-09-28T04:23:18.397818+0000","last_became_active":"2023-09-28T04:23:18.387667+0000","last_became_peered":"2023-09-28T04:23:18.387667+0000","last_unstale":"2023-09-28T04:23:18.397818+0000","last_undegraded":"2023-09-28T04:23:18.397818+0000","last_fullsized":"2023-09-28T04:23:18.397818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:46:23.383130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.410224+0000","last_change":"2023-09-28T04:23:17.911764+0000","last_active":"2023-09-28T04:23:28.410224+0000","last_peered":"2023-09-28T04:23:28.410224+0000","last_clean":"2023-09-28T04:23:28.410224+0000","last_became_active":"2023-09-28T04:23:17.911458+0000","last_became_peered":"2023-09-28T04:23:17.911458+0000","last_unstale":"2023-09-28T04:23:28.410224+0000","last_undegraded":"2023-09-28T04:23:28.410224+0000","last_fullsized":"2023-09-28T04:23:28.410224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402635+0000","last_change":"2023-09-28T04:23:18.400278+0000","last_active":"2023-09-28T04:23:18.402635+0000","last_peered":"2023-09-28T04:23:18.402635+0000","last_clean":"2023-09-28T04:23:18.402635+0000","last_became_active":"2023-09-28T04:23:18.399957+0000","last_became_peered":"2023-09-28T04:23:18.399957+0000","last_unstale":"2023-09-28T04:23:18.402635+0000","last_undegraded":"2023-09-28T04:23:18.402635+0000","last_fullsized":"2023-09-28T04:23:18.402635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:01:52.295558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377068+0000","last_change":"2023-09-28T04:23:13.017727+0000","last_active":"2023-09-28T04:23:18.377068+0000","last_peered":"2023-09-28T04:23:18.377068+0000","last_clean":"2023-09-28T04:23:18.377068+0000","last_became_active":"2023-09-28T04:23:13.017362+0000","last_became_peered":"2023-09-28T04:23:13.017362+0000","last_unstale":"2023-09-28T04:23:18.377068+0000","last_undegraded":"2023-09-28T04:23:18.377068+0000","last_fullsized":"2023-09-28T04:23:18.377068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376624+0000","last_change":"2023-09-28T04:23:17.899128+0000","last_active":"2023-09-28T04:23:19.376624+0000","last_peered":"2023-09-28T04:23:19.376624+0000","last_clean":"2023-09-28T04:23:19.376624+0000","last_became_active":"2023-09-28T04:23:17.898878+0000","last_became_peered":"2023-09-28T04:23:17.898878+0000","last_unstale":"2023-09-28T04:23:19.376624+0000","last_undegraded":"2023-09-28T04:23:19.376624+0000","last_fullsized":"2023-09-28T04:23:19.376624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388439+0000","last_change":"2023-09-28T04:23:18.384565+0000","last_active":"2023-09-28T04:23:18.388439+0000","last_peered":"2023-09-28T04:23:18.388439+0000","last_clean":"2023-09-28T04:23:18.388439+0000","last_became_active":"2023-09-28T04:23:18.383969+0000","last_became_peered":"2023-09-28T04:23:18.383969+0000","last_unstale":"2023-09-28T04:23:18.388439+0000","last_undegraded":"2023-09-28T04:23:18.388439+0000","last_fullsized":"2023-09-28T04:23:18.388439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379488+0000","last_change":"2023-09-28T04:23:12.604091+0000","last_active":"2023-09-28T04:23:18.379488+0000","last_peered":"2023-09-28T04:23:18.379488+0000","last_clean":"2023-09-28T04:23:18.379488+0000","last_became_active":"2023-09-28T04:23:12.603804+0000","last_became_peered":"2023-09-28T04:23:12.603804+0000","last_unstale":"2023-09-28T04:23:18.379488+0000","last_undegraded":"2023-09-28T04:23:18.379488+0000","last_fullsized":"2023-09-28T04:23:18.379488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412473+0000","last_change":"2023-09-28T04:23:17.918999+0000","last_active":"2023-09-28T04:23:28.412473+0000","last_peered":"2023-09-28T04:23:28.412473+0000","last_clean":"2023-09-28T04:23:28.412473+0000","last_became_active":"2023-09-28T04:23:17.918740+0000","last_became_peered":"2023-09-28T04:23:17.918740+0000","last_unstale":"2023-09-28T04:23:28.412473+0000","last_undegraded":"2023-09-28T04:23:28.412473+0000","last_fullsized":"2023-09-28T04:23:28.412473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395808+0000","last_change":"2023-09-28T04:23:18.389350+0000","last_active":"2023-09-28T04:23:18.395808+0000","last_peered":"2023-09-28T04:23:18.395808+0000","last_clean":"2023-09-28T04:23:18.395808+0000","last_became_active":"2023-09-28T04:23:18.389059+0000","last_became_peered":"2023-09-28T04:23:18.389059+0000","last_unstale":"2023-09-28T04:23:18.395808+0000","last_undegraded":"2023-09-28T04:23:18.395808+0000","last_fullsized":"2023-09-28T04:23:18.395808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378640+0000","last_change":"2023-09-28T04:23:12.602100+0000","last_active":"2023-09-28T04:23:18.378640+0000","last_peered":"2023-09-28T04:23:18.378640+0000","last_clean":"2023-09-28T04:23:18.378640+0000","last_became_active":"2023-09-28T04:23:12.601652+0000","last_became_peered":"2023-09-28T04:23:12.601652+0000","last_unstale":"2023-09-28T04:23:18.378640+0000","last_undegraded":"2023-09-28T04:23:18.378640+0000","last_fullsized":"2023-09-28T04:23:18.378640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:37:16.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.438991+0000","last_change":"2023-09-28T04:23:17.911566+0000","last_active":"2023-09-28T04:23:33.438991+0000","last_peered":"2023-09-28T04:23:33.438991+0000","last_clean":"2023-09-28T04:23:33.438991+0000","last_became_active":"2023-09-28T04:23:17.911308+0000","last_became_peered":"2023-09-28T04:23:17.911308+0000","last_unstale":"2023-09-28T04:23:33.438991+0000","last_undegraded":"2023-09-28T04:23:33.438991+0000","last_fullsized":"2023-09-28T04:23:33.438991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395489+0000","last_change":"2023-09-28T04:23:18.388204+0000","last_active":"2023-09-28T04:23:18.395489+0000","last_peered":"2023-09-28T04:23:18.395489+0000","last_clean":"2023-09-28T04:23:18.395489+0000","last_became_active":"2023-09-28T04:23:18.387945+0000","last_became_peered":"2023-09-28T04:23:18.387945+0000","last_unstale":"2023-09-28T04:23:18.395489+0000","last_undegraded":"2023-09-28T04:23:18.395489+0000","last_fullsized":"2023-09-28T04:23:18.395489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.378668+0000","last_change":"2023-09-28T04:23:12.604212+0000","last_active":"2023-09-28T04:23:18.378668+0000","last_peered":"2023-09-28T04:23:18.378668+0000","last_clean":"2023-09-28T04:23:18.378668+0000","last_became_active":"2023-09-28T04:23:12.603930+0000","last_became_peered":"2023-09-28T04:23:12.603930+0000","last_unstale":"2023-09-28T04:23:18.378668+0000","last_undegraded":"2023-09-28T04:23:18.378668+0000","last_fullsized":"2023-09-28T04:23:18.378668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386718+0000","last_change":"2023-09-28T04:23:11.608534+0000","last_active":"2023-09-28T04:23:18.386718+0000","last_peered":"2023-09-28T04:23:18.386718+0000","last_clean":"2023-09-28T04:23:18.386718+0000","last_became_active":"2023-09-28T04:23:11.608249+0000","last_became_peered":"2023-09-28T04:23:11.608249+0000","last_unstale":"2023-09-28T04:23:18.386718+0000","last_undegraded":"2023-09-28T04:23:18.386718+0000","last_fullsized":"2023-09-28T04:23:18.386718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_clean_scrub_stamp":"2023-09-28T04:23:10.587579+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:10.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376259+0000","last_change":"2023-09-28T04:23:17.902709+0000","last_active":"2023-09-28T04:23:19.376259+0000","last_peered":"2023-09-28T04:23:19.376259+0000","last_clean":"2023-09-28T04:23:19.376259+0000","last_became_active":"2023-09-28T04:23:17.902341+0000","last_became_peered":"2023-09-28T04:23:17.902341+0000","last_unstale":"2023-09-28T04:23:19.376259+0000","last_undegraded":"2023-09-28T04:23:19.376259+0000","last_fullsized":"2023-09-28T04:23:19.376259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392913+0000","last_change":"2023-09-28T04:23:18.389982+0000","last_active":"2023-09-28T04:23:18.392913+0000","last_peered":"2023-09-28T04:23:18.392913+0000","last_clean":"2023-09-28T04:23:18.392913+0000","last_became_active":"2023-09-28T04:23:18.389692+0000","last_became_peered":"2023-09-28T04:23:18.389692+0000","last_unstale":"2023-09-28T04:23:18.392913+0000","last_undegraded":"2023-09-28T04:23:18.392913+0000","last_fullsized":"2023-09-28T04:23:18.392913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386996+0000","last_change":"2023-09-28T04:23:12.605908+0000","last_active":"2023-09-28T04:23:18.386996+0000","last_peered":"2023-09-28T04:23:18.386996+0000","last_clean":"2023-09-28T04:23:18.386996+0000","last_became_active":"2023-09-28T04:23:12.605668+0000","last_became_peered":"2023-09-28T04:23:12.605668+0000","last_unstale":"2023-09-28T04:23:18.386996+0000","last_undegraded":"2023-09-28T04:23:18.386996+0000","last_fullsized":"2023-09-28T04:23:18.386996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440738+0000","last_change":"2023-09-28T04:23:17.918410+0000","last_active":"2023-09-28T04:23:33.440738+0000","last_peered":"2023-09-28T04:23:33.440738+0000","last_clean":"2023-09-28T04:23:33.440738+0000","last_became_active":"2023-09-28T04:23:17.918130+0000","last_became_peered":"2023-09-28T04:23:17.918130+0000","last_unstale":"2023-09-28T04:23:33.440738+0000","last_undegraded":"2023-09-28T04:23:33.440738+0000","last_fullsized":"2023-09-28T04:23:33.440738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399143+0000","last_change":"2023-09-28T04:23:18.391987+0000","last_active":"2023-09-28T04:23:18.399143+0000","last_peered":"2023-09-28T04:23:18.399143+0000","last_clean":"2023-09-28T04:23:18.399143+0000","last_became_active":"2023-09-28T04:23:18.391709+0000","last_became_peered":"2023-09-28T04:23:18.391709+0000","last_unstale":"2023-09-28T04:23:18.399143+0000","last_undegraded":"2023-09-28T04:23:18.399143+0000","last_fullsized":"2023-09-28T04:23:18.399143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386509+0000","last_change":"2023-09-28T04:23:13.017715+0000","last_active":"2023-09-28T04:23:18.386509+0000","last_peered":"2023-09-28T04:23:18.386509+0000","last_clean":"2023-09-28T04:23:18.386509+0000","last_became_active":"2023-09-28T04:23:13.017398+0000","last_became_peered":"2023-09-28T04:23:13.017398+0000","last_unstale":"2023-09-28T04:23:18.386509+0000","last_undegraded":"2023-09-28T04:23:18.386509+0000","last_fullsized":"2023-09-28T04:23:18.386509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:37:41.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377174+0000","last_change":"2023-09-28T04:23:17.912291+0000","last_active":"2023-09-28T04:23:18.377174+0000","last_peered":"2023-09-28T04:23:18.377174+0000","last_clean":"2023-09-28T04:23:18.377174+0000","last_became_active":"2023-09-28T04:23:17.912023+0000","last_became_peered":"2023-09-28T04:23:17.912023+0000","last_unstale":"2023-09-28T04:23:18.377174+0000","last_undegraded":"2023-09-28T04:23:18.377174+0000","last_fullsized":"2023-09-28T04:23:18.377174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:29:01.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.399280+0000","last_change":"2023-09-28T04:23:18.396451+0000","last_active":"2023-09-28T04:23:18.399280+0000","last_peered":"2023-09-28T04:23:18.399280+0000","last_clean":"2023-09-28T04:23:18.399280+0000","last_became_active":"2023-09-28T04:23:18.396190+0000","last_became_peered":"2023-09-28T04:23:18.396190+0000","last_unstale":"2023-09-28T04:23:18.399280+0000","last_undegraded":"2023-09-28T04:23:18.399280+0000","last_fullsized":"2023-09-28T04:23:18.399280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.408972+0000","last_change":"2023-09-28T04:23:17.904739+0000","last_active":"2023-09-28T04:23:28.408972+0000","last_peered":"2023-09-28T04:23:28.408972+0000","last_clean":"2023-09-28T04:23:28.408972+0000","last_became_active":"2023-09-28T04:23:17.903844+0000","last_became_peered":"2023-09-28T04:23:17.903844+0000","last_unstale":"2023-09-28T04:23:28.408972+0000","last_undegraded":"2023-09-28T04:23:28.408972+0000","last_fullsized":"2023-09-28T04:23:28.408972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:37:14.496568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.377634+0000","last_change":"2023-09-28T04:23:12.606496+0000","last_active":"2023-09-28T04:23:18.377634+0000","last_peered":"2023-09-28T04:23:18.377634+0000","last_clean":"2023-09-28T04:23:18.377634+0000","last_became_active":"2023-09-28T04:23:12.606143+0000","last_became_peered":"2023-09-28T04:23:12.606143+0000","last_unstale":"2023-09-28T04:23:18.377634+0000","last_undegraded":"2023-09-28T04:23:18.377634+0000","last_fullsized":"2023-09-28T04:23:18.377634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:26:04.874352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402487+0000","last_change":"2023-09-28T04:23:18.396153+0000","last_active":"2023-09-28T04:23:18.402487+0000","last_peered":"2023-09-28T04:23:18.402487+0000","last_clean":"2023-09-28T04:23:18.402487+0000","last_became_active":"2023-09-28T04:23:18.392092+0000","last_became_peered":"2023-09-28T04:23:18.392092+0000","last_unstale":"2023-09-28T04:23:18.402487+0000","last_undegraded":"2023-09-28T04:23:18.402487+0000","last_fullsized":"2023-09-28T04:23:18.402487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:45:57.196277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379277+0000","last_change":"2023-09-28T04:23:12.606390+0000","last_active":"2023-09-28T04:23:18.379277+0000","last_peered":"2023-09-28T04:23:18.379277+0000","last_clean":"2023-09-28T04:23:18.379277+0000","last_became_active":"2023-09-28T04:23:12.605965+0000","last_became_peered":"2023-09-28T04:23:12.605965+0000","last_unstale":"2023-09-28T04:23:18.379277+0000","last_undegraded":"2023-09-28T04:23:18.379277+0000","last_fullsized":"2023-09-28T04:23:18.379277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:11.833839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439531+0000","last_change":"2023-09-28T04:23:17.915114+0000","last_active":"2023-09-28T04:23:33.439531+0000","last_peered":"2023-09-28T04:23:33.439531+0000","last_clean":"2023-09-28T04:23:33.439531+0000","last_became_active":"2023-09-28T04:23:17.914697+0000","last_became_peered":"2023-09-28T04:23:17.914697+0000","last_unstale":"2023-09-28T04:23:33.439531+0000","last_undegraded":"2023-09-28T04:23:33.439531+0000","last_fullsized":"2023-09-28T04:23:33.439531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:56.903338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397753+0000","last_change":"2023-09-28T04:23:18.386681+0000","last_active":"2023-09-28T04:23:18.397753+0000","last_peered":"2023-09-28T04:23:18.397753+0000","last_clean":"2023-09-28T04:23:18.397753+0000","last_became_active":"2023-09-28T04:23:18.386380+0000","last_became_peered":"2023-09-28T04:23:18.386380+0000","last_unstale":"2023-09-28T04:23:18.397753+0000","last_undegraded":"2023-09-28T04:23:18.397753+0000","last_fullsized":"2023-09-28T04:23:18.397753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:17:48.611733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"21'5","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412964+0000","last_change":"2023-09-28T04:23:17.918404+0000","last_active":"2023-09-28T04:23:28.412964+0000","last_peered":"2023-09-28T04:23:28.412964+0000","last_clean":"2023-09-28T04:23:28.412964+0000","last_became_active":"2023-09-28T04:23:17.918116+0000","last_became_peered":"2023-09-28T04:23:17.918116+0000","last_unstale":"2023-09-28T04:23:28.412964+0000","last_undegraded":"2023-09-28T04:23:28.412964+0000","last_fullsized":"2023-09-28T04:23:28.412964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.390737+0000","last_change":"2023-09-28T04:23:18.385213+0000","last_active":"2023-09-28T04:23:18.390737+0000","last_peered":"2023-09-28T04:23:18.390737+0000","last_clean":"2023-09-28T04:23:18.390737+0000","last_became_active":"2023-09-28T04:23:18.384930+0000","last_became_peered":"2023-09-28T04:23:18.384930+0000","last_unstale":"2023-09-28T04:23:18.390737+0000","last_undegraded":"2023-09-28T04:23:18.390737+0000","last_fullsized":"2023-09-28T04:23:18.390737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:06.681805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.384054+0000","last_change":"2023-09-28T04:23:17.905986+0000","last_active":"2023-09-28T04:23:23.384054+0000","last_peered":"2023-09-28T04:23:23.384054+0000","last_clean":"2023-09-28T04:23:23.384054+0000","last_became_active":"2023-09-28T04:23:17.905667+0000","last_became_peered":"2023-09-28T04:23:17.905667+0000","last_unstale":"2023-09-28T04:23:23.384054+0000","last_undegraded":"2023-09-28T04:23:23.384054+0000","last_fullsized":"2023-09-28T04:23:23.384054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402551+0000","last_change":"2023-09-28T04:23:18.400970+0000","last_active":"2023-09-28T04:23:18.402551+0000","last_peered":"2023-09-28T04:23:18.402551+0000","last_clean":"2023-09-28T04:23:18.402551+0000","last_became_active":"2023-09-28T04:23:18.400683+0000","last_became_peered":"2023-09-28T04:23:18.400683+0000","last_unstale":"2023-09-28T04:23:18.402551+0000","last_undegraded":"2023-09-28T04:23:18.402551+0000","last_fullsized":"2023-09-28T04:23:18.402551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:59:30.982762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440021+0000","last_change":"2023-09-28T04:23:17.905162+0000","last_active":"2023-09-28T04:23:33.440021+0000","last_peered":"2023-09-28T04:23:33.440021+0000","last_clean":"2023-09-28T04:23:33.440021+0000","last_became_active":"2023-09-28T04:23:17.904895+0000","last_became_peered":"2023-09-28T04:23:17.904895+0000","last_unstale":"2023-09-28T04:23:33.440021+0000","last_undegraded":"2023-09-28T04:23:33.440021+0000","last_fullsized":"2023-09-28T04:23:33.440021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:37:49.906014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402543+0000","last_change":"2023-09-28T04:23:18.400714+0000","last_active":"2023-09-28T04:23:18.402543+0000","last_peered":"2023-09-28T04:23:18.402543+0000","last_clean":"2023-09-28T04:23:18.402543+0000","last_became_active":"2023-09-28T04:23:18.400410+0000","last_became_peered":"2023-09-28T04:23:18.400410+0000","last_unstale":"2023-09-28T04:23:18.402543+0000","last_undegraded":"2023-09-28T04:23:18.402543+0000","last_fullsized":"2023-09-28T04:23:18.402543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:43:02.603601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.384516+0000","last_change":"2023-09-28T04:23:17.905493+0000","last_active":"2023-09-28T04:23:23.384516+0000","last_peered":"2023-09-28T04:23:23.384516+0000","last_clean":"2023-09-28T04:23:23.384516+0000","last_became_active":"2023-09-28T04:23:17.905198+0000","last_became_peered":"2023-09-28T04:23:17.905198+0000","last_unstale":"2023-09-28T04:23:23.384516+0000","last_undegraded":"2023-09-28T04:23:23.384516+0000","last_fullsized":"2023-09-28T04:23:23.384516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402220+0000","last_change":"2023-09-28T04:23:18.393194+0000","last_active":"2023-09-28T04:23:18.402220+0000","last_peered":"2023-09-28T04:23:18.402220+0000","last_clean":"2023-09-28T04:23:18.402220+0000","last_became_active":"2023-09-28T04:23:18.392400+0000","last_became_peered":"2023-09-28T04:23:18.392400+0000","last_unstale":"2023-09-28T04:23:18.402220+0000","last_undegraded":"2023-09-28T04:23:18.402220+0000","last_fullsized":"2023-09-28T04:23:18.402220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'9","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.438960+0000","last_change":"2023-09-28T04:23:17.917604+0000","last_active":"2023-09-28T04:23:33.438960+0000","last_peered":"2023-09-28T04:23:33.438960+0000","last_clean":"2023-09-28T04:23:33.438960+0000","last_became_active":"2023-09-28T04:23:17.917266+0000","last_became_peered":"2023-09-28T04:23:17.917266+0000","last_unstale":"2023-09-28T04:23:33.438960+0000","last_undegraded":"2023-09-28T04:23:33.438960+0000","last_fullsized":"2023-09-28T04:23:33.438960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395284+0000","last_change":"2023-09-28T04:23:18.386391+0000","last_active":"2023-09-28T04:23:18.395284+0000","last_peered":"2023-09-28T04:23:18.395284+0000","last_clean":"2023-09-28T04:23:18.395284+0000","last_became_active":"2023-09-28T04:23:18.386051+0000","last_became_peered":"2023-09-28T04:23:18.386051+0000","last_unstale":"2023-09-28T04:23:18.395284+0000","last_undegraded":"2023-09-28T04:23:18.395284+0000","last_fullsized":"2023-09-28T04:23:18.395284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:53:31.281966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392882+0000","last_change":"2023-09-28T04:23:18.389600+0000","last_active":"2023-09-28T04:23:18.392882+0000","last_peered":"2023-09-28T04:23:18.392882+0000","last_clean":"2023-09-28T04:23:18.392882+0000","last_became_active":"2023-09-28T04:23:18.389280+0000","last_became_peered":"2023-09-28T04:23:18.389280+0000","last_unstale":"2023-09-28T04:23:18.392882+0000","last_undegraded":"2023-09-28T04:23:18.392882+0000","last_fullsized":"2023-09-28T04:23:18.392882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:47.697305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402201+0000","last_change":"2023-09-28T04:23:18.392980+0000","last_active":"2023-09-28T04:23:18.402201+0000","last_peered":"2023-09-28T04:23:18.402201+0000","last_clean":"2023-09-28T04:23:18.402201+0000","last_became_active":"2023-09-28T04:23:18.390929+0000","last_became_peered":"2023-09-28T04:23:18.390929+0000","last_unstale":"2023-09-28T04:23:18.402201+0000","last_undegraded":"2023-09-28T04:23:18.402201+0000","last_fullsized":"2023-09-28T04:23:18.402201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:49:26.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.397834+0000","last_change":"2023-09-28T04:23:18.387348+0000","last_active":"2023-09-28T04:23:18.397834+0000","last_peered":"2023-09-28T04:23:18.397834+0000","last_clean":"2023-09-28T04:23:18.397834+0000","last_became_active":"2023-09-28T04:23:18.385870+0000","last_became_peered":"2023-09-28T04:23:18.385870+0000","last_unstale":"2023-09-28T04:23:18.397834+0000","last_undegraded":"2023-09-28T04:23:18.397834+0000","last_fullsized":"2023-09-28T04:23:18.397834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:29:04.985060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.402660+0000","last_change":"2023-09-28T04:23:18.392534+0000","last_active":"2023-09-28T04:23:18.402660+0000","last_peered":"2023-09-28T04:23:18.402660+0000","last_clean":"2023-09-28T04:23:18.402660+0000","last_became_active":"2023-09-28T04:23:18.392245+0000","last_became_peered":"2023-09-28T04:23:18.392245+0000","last_unstale":"2023-09-28T04:23:18.402660+0000","last_undegraded":"2023-09-28T04:23:18.402660+0000","last_fullsized":"2023-09-28T04:23:18.402660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:30:26.381680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.395827+0000","last_change":"2023-09-28T04:23:18.391490+0000","last_active":"2023-09-28T04:23:18.395827+0000","last_peered":"2023-09-28T04:23:18.395827+0000","last_clean":"2023-09-28T04:23:18.395827+0000","last_became_active":"2023-09-28T04:23:18.391256+0000","last_became_peered":"2023-09-28T04:23:18.391256+0000","last_unstale":"2023-09-28T04:23:18.395827+0000","last_undegraded":"2023-09-28T04:23:18.395827+0000","last_fullsized":"2023-09-28T04:23:18.395827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:28:43.639301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4966,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":9932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8960,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362880,"statfs":{"total":96636764160,"available":96627589120,"internally_reserved":0,"allocated":319488,"data_stored":672443,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8356,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363484,"statfs":{"total":96636764160,"available":96628207616,"internally_reserved":0,"allocated":225280,"data_stored":79341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8412,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363428,"statfs":{"total":96636764160,"available":96628150272,"internally_reserved":0,"allocated":217088,"data_stored":79229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9020,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362820,"statfs":{"total":96636764160,"available":96627527680,"internally_reserved":0,"allocated":315392,"data_stored":671051,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8352,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363488,"statfs":{"total":96636764160,"available":96628211712,"internally_reserved":0,"allocated":221184,"data_stored":79319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8428,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363412,"statfs":{"total":96636764160,"available":96628133888,"internally_reserved":0,"allocated":233472,"data_stored":80449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8520,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363320,"statfs":{"total":96636764160,"available":96628039680,"internally_reserved":0,"allocated":262144,"data_stored":82149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8432,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363408,"statfs":{"total":96636764160,"available":96628129792,"internally_reserved":0,"allocated":237568,"data_stored":80519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T04:23:43.725 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:23:43.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.951+0000 7f1ead1ff700 1 Processor -- start 2023-09-28T04:23:43.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.951+0000 7f1ead1ff700 1 -- start start 2023-09-28T04:23:43.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.952+0000 7f1ead1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ea814fe60 0x7f1ea8156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.952+0000 7f1ead1ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea80c8030 con 0x7f1ea814fa90 2023-09-28T04:23:43.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.952+0000 7f1ead1ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea80c7180 con 0x7f1ea80c84c0 2023-09-28T04:23:43.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.952+0000 7f1ead1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80c7420 con 0x7f1ea814fe60 2023-09-28T04:23:43.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.952+0000 7f1ea6d9d700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1ea814fa90 0x7f1ea80cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45984/0 (socket says 172.21.15.118:45984) 2023-09-28T04:23:43.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.952+0000 7f1ea6d9d700 1 -- 172.21.15.118:0/741810924 learned_addr learned my addr 172.21.15.118:0/741810924 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:43.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.953+0000 7f1ea659c700 1 --2- 172.21.15.118:0/741810924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ea814fe60 0x7f1ea8156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.953+0000 7f1ea659c700 1 -- 172.21.15.118:0/741810924 >> v1:172.21.15.174:6789/0 conn(0x7f1ea80c84c0 legacy=0x7f1ea80adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.953+0000 7f1ea5d9b700 1 -- 172.21.15.118:0/741810924 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731973232 0 0) 0x7f1ea80c7180 con 0x7f1ea80c84c0 2023-09-28T04:23:43.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.953+0000 7f1ea659c700 1 -- 172.21.15.118:0/741810924 >> v1:172.21.15.118:6789/0 conn(0x7f1ea814fa90 legacy=0x7f1ea80cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.953+0000 7f1ea659c700 1 -- 172.21.15.118:0/741810924 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea80c7700 con 0x7f1ea814fe60 2023-09-28T04:23:43.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.953+0000 7f1ea659c700 1 --2- 172.21.15.118:0/741810924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ea814fe60 0x7f1ea8156430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009910 tx=0x7f1e9c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e8feb5c3b0b21b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:43.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.953+0000 7f1ea5d9b700 1 -- 172.21.15.118:0/741810924 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c00b760 con 0x7f1ea814fe60 2023-09-28T04:23:43.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.953+0000 7f1ea5d9b700 1 -- 172.21.15.118:0/741810924 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c00b8c0 con 0x7f1ea814fe60 2023-09-28T04:23:43.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.953+0000 7f1ea5d9b700 1 -- 172.21.15.118:0/741810924 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c00bc60 con 0x7f1ea814fe60 2023-09-28T04:23:43.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.954+0000 7f1ead1ff700 1 -- 172.21.15.118:0/741810924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ea814fe60 msgr2=0x7f1ea8156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.954+0000 7f1ead1ff700 1 --2- 172.21.15.118:0/741810924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ea814fe60 0x7f1ea8156430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009910 tx=0x7f1e9c0091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.954+0000 7f1ead1ff700 1 -- 172.21.15.118:0/741810924 shutdown_connections 2023-09-28T04:23:43.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.954+0000 7f1ead1ff700 1 --2- 172.21.15.118:0/741810924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ea814fe60 0x7f1ea8156430 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.954+0000 7f1ead1ff700 1 -- 172.21.15.118:0/741810924 >> 172.21.15.118:0/741810924 conn(0x7f1ea8063cd0 msgr2=0x7f1ea80cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:43.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.954+0000 7f1ead1ff700 1 -- 172.21.15.118:0/741810924 shutdown_connections 2023-09-28T04:23:43.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.954+0000 7f1ead1ff700 1 -- 172.21.15.118:0/741810924 wait complete. 2023-09-28T04:23:43.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.956+0000 7f1ead1ff700 1 Processor -- start 2023-09-28T04:23:43.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.956+0000 7f1ead1ff700 1 -- start start 2023-09-28T04:23:43.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ead1ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea80c84c0 0x7f1ea80c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ead1ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ea814fa90 0x7f1ea81528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ead1ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ea814fe60 0x7f1ea8166010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ead1ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea8165b80 con 0x7f1ea80c84c0 2023-09-28T04:23:43.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ead1ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80b0c10 con 0x7f1ea814fa90 2023-09-28T04:23:43.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ead1ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80b1100 con 0x7f1ea814fe60 2023-09-28T04:23:43.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ea6d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea80c84c0 0x7f1ea80c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ea6d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea80c84c0 0x7f1ea80c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54572/0 (socket says 172.21.15.118:54572) 2023-09-28T04:23:43.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ea6d9d700 1 -- 172.21.15.118:0/1413776095 learned_addr learned my addr 172.21.15.118:0/1413776095 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:43.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ea659c700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ea814fa90 0x7f1ea81528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ea759e700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ea814fe60 0x7f1ea8166010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ea6d9d700 1 -- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ea814fe60 msgr2=0x7f1ea8166010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ea6d9d700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ea814fe60 0x7f1ea8166010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ea6d9d700 1 -- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ea814fa90 msgr2=0x7f1ea81528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:43.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ea6d9d700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ea814fa90 0x7f1ea81528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:43.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.957+0000 7f1ea6d9d700 1 -- 172.21.15.118:0/1413776095 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c009420 con 0x7f1ea80c84c0 2023-09-28T04:23:43.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.958+0000 7f1ea6d9d700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea80c84c0 0x7f1ea80c8b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c7e0 tx=0x7f1e98001100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:43.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.958+0000 7f1e8effd700 1 -- 172.21.15.118:0/1413776095 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98005b30 con 0x7f1ea80c84c0 2023-09-28T04:23:43.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.958+0000 7f1e8effd700 1 -- 172.21.15.118:0/1413776095 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e98005c90 con 0x7f1ea80c84c0 2023-09-28T04:23:43.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.958+0000 7f1e8effd700 1 -- 172.21.15.118:0/1413776095 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98007300 con 0x7f1ea80c84c0 2023-09-28T04:23:43.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.958+0000 7f1ead1ff700 1 -- 172.21.15.118:0/1413776095 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea80b13e0 con 0x7f1ea80c84c0 2023-09-28T04:23:43.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.958+0000 7f1ead1ff700 1 -- 172.21.15.118:0/1413776095 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea80b19a0 con 0x7f1ea80c84c0 2023-09-28T04:23:43.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.959+0000 7f1ead1ff700 1 -- 172.21.15.118:0/1413776095 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea8165e60 con 0x7f1ea80c84c0 2023-09-28T04:23:43.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.960+0000 7f1e8effd700 1 -- 172.21.15.118:0/1413776095 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1e9801b3b0 con 0x7f1ea80c84c0 2023-09-28T04:23:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.961+0000 7f1e8effd700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1e94067360 0x7f1e94069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.961+0000 7f1e8effd700 1 -- 172.21.15.118:0/1413776095 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1e98084020 con 0x7f1ea80c84c0 2023-09-28T04:23:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.961+0000 7f1ea659c700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1e94067360 0x7f1e94069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.962+0000 7f1ea659c700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1e94067360 0x7f1e94069810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8150270 tx=0x7f1e9c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:43.966+0000 7f1e8effd700 1 -- 172.21.15.118:0/1413776095 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1e98050f20 con 0x7f1ea80c84c0 2023-09-28T04:23:44.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.159+0000 7f1ead1ff700 1 -- 172.21.15.118:0/1413776095 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ea80c6d30 con 0x7f1ea80c84c0 2023-09-28T04:23:44.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.160+0000 7f1e8effd700 1 -- 172.21.15.118:0/1413776095 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17010 (secure 0 0 0) 0x7f1e98017090 con 0x7f1ea80c84c0 2023-09-28T04:23:44.161 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:44.161 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:23:19.371938+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T04:23:10.586895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T04:23:10.697802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T04:23:16.491417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T04:23:17.349188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:07.142219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.951857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.911133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.882482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.688096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.764671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.767264+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.763816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:23:44.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.162+0000 7f1ead1ff700 1 -- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1e94067360 msgr2=0x7f1e94069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:44.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.162+0000 7f1ead1ff700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1e94067360 0x7f1e94069810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8150270 tx=0x7f1e9c016000 comp rx=0 tx=0).stop 2023-09-28T04:23:44.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.162+0000 7f1ead1ff700 1 -- 172.21.15.118:0/1413776095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea80c84c0 msgr2=0x7f1ea80c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:44.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.162+0000 7f1ead1ff700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea80c84c0 0x7f1ea80c8b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c7e0 tx=0x7f1e98001100 comp rx=0 tx=0).stop 2023-09-28T04:23:44.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.162+0000 7f1ead1ff700 1 -- 172.21.15.118:0/1413776095 shutdown_connections 2023-09-28T04:23:44.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.162+0000 7f1ead1ff700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f1e94067360 0x7f1e94069810 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:44.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.162+0000 7f1ead1ff700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1ea814fe60 0x7f1ea8166010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:44.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.162+0000 7f1ead1ff700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea80c84c0 0x7f1ea80c8b80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:44.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.162+0000 7f1ead1ff700 1 --2- 172.21.15.118:0/1413776095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ea814fa90 0x7f1ea81528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:44.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.162+0000 7f1ead1ff700 1 -- 172.21.15.118:0/1413776095 >> 172.21.15.118:0/1413776095 conn(0x7f1ea8063cd0 msgr2=0x7f1ea81557c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:44.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.162+0000 7f1ead1ff700 1 -- 172.21.15.118:0/1413776095 shutdown_connections 2023-09-28T04:23:44.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:44.162+0000 7f1ead1ff700 1 -- 172.21.15.118:0/1413776095 wait complete. 2023-09-28T04:23:45.182 INFO:tasks.ceph:Scrubbing osd.0 2023-09-28T04:23:45.182 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-09-28T04:23:45.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.382+0000 7f42963ff700 1 Processor -- start 2023-09-28T04:23:45.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.383+0000 7f42963ff700 1 -- start start 2023-09-28T04:23:45.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.384+0000 7f42963ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f42900abd60 0x7f42900c7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:45.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.384+0000 7f42963ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4290069860 0x7f42900c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:45.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.384+0000 7f42963ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4290155a10 con 0x7f42900ac130 2023-09-28T04:23:45.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.384+0000 7f42963ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429014ff20 con 0x7f42900abd60 2023-09-28T04:23:45.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.384+0000 7f42963ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4290068d00 con 0x7f4290069860 2023-09-28T04:23:45.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.384+0000 7f428ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f42900abd60 0x7f42900c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:45.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.384+0000 7f4287fff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f42900ac130 0x7f4290069150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45988/0 (socket says 172.21.15.118:45988) 2023-09-28T04:23:45.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.384+0000 7f4287fff700 1 -- 172.21.15.118:0/445329574 learned_addr learned my addr 172.21.15.118:0/445329574 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:45.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.384+0000 7f428ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f42900abd60 0x7f42900c7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54580/0 (socket says 172.21.15.118:54580) 2023-09-28T04:23:45.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.384+0000 7f429499c700 1 --2- 172.21.15.118:0/445329574 >> v2:172.21.15.174:3300/0 conn(0x7f4290069860 0x7f42900c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:45.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.385+0000 7f428ffff700 1 -- 172.21.15.118:0/445329574 >> v2:172.21.15.174:3300/0 conn(0x7f4290069860 msgr2=0x7f42900c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.385+0000 7f428ffff700 1 --2- 172.21.15.118:0/445329574 >> v2:172.21.15.174:3300/0 conn(0x7f4290069860 0x7f42900c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.385+0000 7f428ffff700 1 -- 172.21.15.118:0/445329574 >> v1:172.21.15.118:6789/0 conn(0x7f42900ac130 legacy=0x7f4290069150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.385+0000 7f428ffff700 1 -- 172.21.15.118:0/445329574 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4290155cf0 con 0x7f42900abd60 2023-09-28T04:23:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.385+0000 7f428f7fe700 1 -- 172.21.15.118:0/445329574 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256353560 0 0) 0x7f4290155a10 con 0x7f42900ac130 2023-09-28T04:23:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.385+0000 7f428ffff700 1 --2- 172.21.15.118:0/445329574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42900abd60 0x7f42900c7380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f42900b2070 tx=0x7f42800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723658855303a47d server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:45.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.385+0000 7f428f7fe700 1 -- 172.21.15.118:0/445329574 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280011630 con 0x7f42900abd60 2023-09-28T04:23:45.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.385+0000 7f428f7fe700 1 -- 172.21.15.118:0/445329574 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4280011790 con 0x7f42900abd60 2023-09-28T04:23:45.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.385+0000 7f428f7fe700 1 -- 172.21.15.118:0/445329574 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280011b30 con 0x7f42900abd60 2023-09-28T04:23:45.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.386+0000 7f42963ff700 1 -- 172.21.15.118:0/445329574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42900abd60 msgr2=0x7f42900c7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:45.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.386+0000 7f42963ff700 1 --2- 172.21.15.118:0/445329574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42900abd60 0x7f42900c7380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f42900b2070 tx=0x7f42800091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.386+0000 7f42963ff700 1 -- 172.21.15.118:0/445329574 shutdown_connections 2023-09-28T04:23:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.386+0000 7f42963ff700 1 --2- 172.21.15.118:0/445329574 >> v2:172.21.15.174:3300/0 conn(0x7f4290069860 0x7f42900c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.386+0000 7f42963ff700 1 --2- 172.21.15.118:0/445329574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42900abd60 0x7f42900c7380 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.386+0000 7f42963ff700 1 -- 172.21.15.118:0/445329574 >> 172.21.15.118:0/445329574 conn(0x7f4290063230 msgr2=0x7f4290063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.386+0000 7f42963ff700 1 -- 172.21.15.118:0/445329574 shutdown_connections 2023-09-28T04:23:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.386+0000 7f42963ff700 1 -- 172.21.15.118:0/445329574 wait complete. 2023-09-28T04:23:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.387+0000 7f42963ff700 1 Processor -- start 2023-09-28T04:23:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.387+0000 7f42963ff700 1 -- start start 2023-09-28T04:23:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.388+0000 7f42963ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4290069860 0x7f42900b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.388+0000 7f42963ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42900abd60 0x7f4290151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.388+0000 7f42963ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42900ac130 0x7f4290151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.388+0000 7f42963ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4290150080 con 0x7f42900abd60 2023-09-28T04:23:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.388+0000 7f42963ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4290150b60 con 0x7f4290069860 2023-09-28T04:23:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.388+0000 7f42963ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42900affb0 con 0x7f42900ac130 2023-09-28T04:23:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.388+0000 7f4287fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42900abd60 0x7f4290151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.388+0000 7f4287fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42900abd60 0x7f4290151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54584/0 (socket says 172.21.15.118:54584) 2023-09-28T04:23:45.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.388+0000 7f4287fff700 1 -- 172.21.15.118:0/907049213 learned_addr learned my addr 172.21.15.118:0/907049213 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:45.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.389+0000 7f428ffff700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4290069860 0x7f42900b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:45.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.389+0000 7f429499c700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42900ac130 0x7f4290151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:45.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.389+0000 7f4287fff700 1 -- 172.21.15.118:0/907049213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42900ac130 msgr2=0x7f4290151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:45.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.389+0000 7f4287fff700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42900ac130 0x7f4290151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.389+0000 7f4287fff700 1 -- 172.21.15.118:0/907049213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4290069860 msgr2=0x7f42900b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:45.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.389+0000 7f4287fff700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4290069860 0x7f42900b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.389+0000 7f4287fff700 1 -- 172.21.15.118:0/907049213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280009420 con 0x7f42900abd60 2023-09-28T04:23:45.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.389+0000 7f4287fff700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42900abd60 0x7f4290151a50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f427800c5e0 tx=0x7f4278000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:45.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.389+0000 7f428cff9700 1 -- 172.21.15.118:0/907049213 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278005b30 con 0x7f42900abd60 2023-09-28T04:23:45.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.389+0000 7f428cff9700 1 -- 172.21.15.118:0/907049213 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278005c90 con 0x7f42900abd60 2023-09-28T04:23:45.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.389+0000 7f428cff9700 1 -- 172.21.15.118:0/907049213 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278007300 con 0x7f42900abd60 2023-09-28T04:23:45.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.389+0000 7f42963ff700 1 -- 172.21.15.118:0/907049213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42900c28e0 con 0x7f42900abd60 2023-09-28T04:23:45.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.389+0000 7f42963ff700 1 -- 172.21.15.118:0/907049213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4290150260 con 0x7f42900abd60 2023-09-28T04:23:45.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.391+0000 7f42963ff700 1 -- 172.21.15.118:0/907049213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4290071980 con 0x7f42900abd60 2023-09-28T04:23:45.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.391+0000 7f428cff9700 1 -- 172.21.15.118:0/907049213 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f427801b3b0 con 0x7f42900abd60 2023-09-28T04:23:45.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.392+0000 7f428cff9700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4270067330 0x7f42700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:45.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.392+0000 7f428cff9700 1 -- 172.21.15.118:0/907049213 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4278083fe0 con 0x7f42900abd60 2023-09-28T04:23:45.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.393+0000 7f428ffff700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4270067330 0x7f42700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:45.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.393+0000 7f428cff9700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] conn(0x7f427006fbe0 0x7f4270071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:45.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.393+0000 7f428cff9700 1 -- 172.21.15.118:0/907049213 --> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f42700726a0 con 0x7f427006fbe0 2023-09-28T04:23:45.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.393+0000 7f428cff9700 1 -- 172.21.15.118:0/907049213 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42780865c0 con 0x7f42900abd60 2023-09-28T04:23:45.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.393+0000 7f429499c700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] conn(0x7f427006fbe0 0x7f4270071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:45.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.393+0000 7f428ffff700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4270067330 0x7f42700697e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f42800091e0 tx=0x7f4280017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:45.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.393+0000 7f429499c700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] conn(0x7f427006fbe0 0x7f4270071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:45.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.394+0000 7f428cff9700 1 -- 172.21.15.118:0/907049213 <== osd.0 v2:172.21.15.118:6819/114261 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f42700726a0 con 0x7f427006fbe0 2023-09-28T04:23:45.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.409+0000 7f42963ff700 1 -- 172.21.15.118:0/907049213 --> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4290155fd0 con 0x7f427006fbe0 2023-09-28T04:23:45.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.409+0000 7f428cff9700 1 -- 172.21.15.118:0/907049213 <== osd.0 v2:172.21.15.118:6819/114261 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4290155fd0 con 0x7f427006fbe0 2023-09-28T04:23:45.410 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-09-28T04:23:45.410 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T04:23:45.410 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-09-28T04:23:45.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.409+0000 7f42963ff700 1 -- 172.21.15.118:0/907049213 >> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] conn(0x7f427006fbe0 msgr2=0x7f4270071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:45.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.409+0000 7f42963ff700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.118:6819/114261,v1:172.21.15.118:6821/114261] conn(0x7f427006fbe0 0x7f4270071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.409+0000 7f42963ff700 1 -- 172.21.15.118:0/907049213 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4270067330 msgr2=0x7f42700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:45.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.409+0000 7f42963ff700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4270067330 0x7f42700697e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f42800091e0 tx=0x7f4280017000 comp rx=0 tx=0).stop 2023-09-28T04:23:45.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.409+0000 7f42963ff700 1 -- 172.21.15.118:0/907049213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42900abd60 msgr2=0x7f4290151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:45.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.409+0000 7f42963ff700 1 --2- 172.21.15.118:0/907049213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42900abd60 0x7f4290151a50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f427800c5e0 tx=0x7f4278000fe0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.409+0000 7f429499c700 1 -- 172.21.15.118:0/907049213 reap_dead start 2023-09-28T04:23:45.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.410+0000 7f42963ff700 1 -- 172.21.15.118:0/907049213 shutdown_connections 2023-09-28T04:23:45.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.410+0000 7f42963ff700 1 -- 172.21.15.118:0/907049213 >> 172.21.15.118:0/907049213 conn(0x7f4290063230 msgr2=0x7f4290063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:45.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.410+0000 7f42963ff700 1 -- 172.21.15.118:0/907049213 shutdown_connections 2023-09-28T04:23:45.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.410+0000 7f42963ff700 1 -- 172.21.15.118:0/907049213 wait complete. 2023-09-28T04:23:45.426 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-09-28T04:23:45.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.616+0000 7fd70b5ff700 1 Processor -- start 2023-09-28T04:23:45.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.616+0000 7fd70b5ff700 1 -- start start 2023-09-28T04:23:45.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.617+0000 7fd70b5ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd7040c0ca0 0x7fd704152370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:45.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.617+0000 7fd70b5ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7040c4310 0x7fd7040c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:45.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.617+0000 7fd70b5ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7040c3450 con 0x7fd70414c6a0 2023-09-28T04:23:45.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.617+0000 7fd70b5ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7040bfbb0 con 0x7fd7040c0ca0 2023-09-28T04:23:45.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.617+0000 7fd70b5ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70414ca70 con 0x7fd7040c4310 2023-09-28T04:23:45.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.618+0000 7fd708b9a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd7040c0ca0 0x7fd704152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:45.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.618+0000 7fd70939b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd70414c6a0 0x7fd7040c0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45994/0 (socket says 172.21.15.118:45994) 2023-09-28T04:23:45.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.618+0000 7fd70939b700 1 -- 172.21.15.118:0/2993426572 learned_addr learned my addr 172.21.15.118:0/2993426572 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:45.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.618+0000 7fd709b9c700 1 --2- 172.21.15.118:0/2993426572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7040c4310 0x7fd7040c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:45.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.618+0000 7fd6fbfff700 1 -- 172.21.15.118:0/2993426572 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224042727 0 0) 0x7fd7040c3450 con 0x7fd70414c6a0 2023-09-28T04:23:45.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.618+0000 7fd6fbfff700 1 -- 172.21.15.118:0/2993426572 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f0003570 con 0x7fd70414c6a0 2023-09-28T04:23:45.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.618+0000 7fd708b9a700 1 -- 172.21.15.118:0/2993426572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7040c4310 msgr2=0x7fd7040c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:45.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.618+0000 7fd708b9a700 1 --2- 172.21.15.118:0/2993426572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7040c4310 0x7fd7040c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.618+0000 7fd708b9a700 1 -- 172.21.15.118:0/2993426572 >> v1:172.21.15.118:6789/0 conn(0x7fd70414c6a0 legacy=0x7fd7040c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:45.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.618+0000 7fd708b9a700 1 -- 172.21.15.118:0/2993426572 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7040c2560 con 0x7fd7040c0ca0 2023-09-28T04:23:45.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.618+0000 7fd709b9c700 1 --2- 172.21.15.118:0/2993426572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7040c4310 0x7fd7040c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:45.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.618+0000 7fd708b9a700 1 --2- 172.21.15.118:0/2993426572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7040c0ca0 0x7fd704152370 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40098e0 tx=0x7fd6f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364bb7acf0e15a00 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:45.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.619+0000 7fd6fbfff700 1 -- 172.21.15.118:0/2993426572 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4011630 con 0x7fd7040c0ca0 2023-09-28T04:23:45.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.619+0000 7fd6fbfff700 1 -- 172.21.15.118:0/2993426572 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f4011790 con 0x7fd7040c0ca0 2023-09-28T04:23:45.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.619+0000 7fd6fbfff700 1 -- 172.21.15.118:0/2993426572 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4011b30 con 0x7fd7040c0ca0 2023-09-28T04:23:45.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.619+0000 7fd70b5ff700 1 -- 172.21.15.118:0/2993426572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7040c0ca0 msgr2=0x7fd704152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:45.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.619+0000 7fd70b5ff700 1 --2- 172.21.15.118:0/2993426572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7040c0ca0 0x7fd704152370 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40098e0 tx=0x7fd6f40091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.619+0000 7fd70b5ff700 1 -- 172.21.15.118:0/2993426572 shutdown_connections 2023-09-28T04:23:45.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.619+0000 7fd70b5ff700 1 --2- 172.21.15.118:0/2993426572 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7040c4310 0x7fd7040c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.619+0000 7fd70b5ff700 1 --2- 172.21.15.118:0/2993426572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7040c0ca0 0x7fd704152370 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.619+0000 7fd70b5ff700 1 -- 172.21.15.118:0/2993426572 >> 172.21.15.118:0/2993426572 conn(0x7fd704067630 msgr2=0x7fd704067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:45.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.619+0000 7fd70b5ff700 1 -- 172.21.15.118:0/2993426572 shutdown_connections 2023-09-28T04:23:45.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.619+0000 7fd70b5ff700 1 -- 172.21.15.118:0/2993426572 wait complete. 2023-09-28T04:23:45.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.621+0000 7fd70b5ff700 1 Processor -- start 2023-09-28T04:23:45.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.621+0000 7fd70b5ff700 1 -- start start 2023-09-28T04:23:45.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.622+0000 7fd70b5ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7040c0ca0 0x7fd704163bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:45.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.622+0000 7fd70b5ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7040c4310 0x7fd70414f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:45.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.622+0000 7fd70b5ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd70414c6a0 0x7fd704166860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:45.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.622+0000 7fd70b5ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd704163720 con 0x7fd7040c0ca0 2023-09-28T04:23:45.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.622+0000 7fd70b5ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7041633f0 con 0x7fd7040c4310 2023-09-28T04:23:45.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.622+0000 7fd70b5ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70406a400 con 0x7fd70414c6a0 2023-09-28T04:23:45.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.622+0000 7fd70939b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7040c0ca0 0x7fd704163bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:45.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.622+0000 7fd70939b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7040c0ca0 0x7fd704163bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54604/0 (socket says 172.21.15.118:54604) 2023-09-28T04:23:45.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.622+0000 7fd70939b700 1 -- 172.21.15.118:0/673340658 learned_addr learned my addr 172.21.15.118:0/673340658 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:45.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.622+0000 7fd709b9c700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd70414c6a0 0x7fd704166860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:45.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.622+0000 7fd708b9a700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7040c4310 0x7fd70414f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:45.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.623+0000 7fd70939b700 1 -- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd70414c6a0 msgr2=0x7fd704166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:45.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.623+0000 7fd70939b700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd70414c6a0 0x7fd704166860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.623+0000 7fd70939b700 1 -- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7040c4310 msgr2=0x7fd70414f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:45.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.623+0000 7fd70939b700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7040c4310 0x7fd70414f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.623+0000 7fd70939b700 1 -- 172.21.15.118:0/673340658 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc009a20 con 0x7fd7040c0ca0 2023-09-28T04:23:45.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.623+0000 7fd70939b700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7040c0ca0 0x7fd704163bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd70000c590 tx=0x7fd700007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:45.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.623+0000 7fd6f97fa700 1 -- 172.21.15.118:0/673340658 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700005b30 con 0x7fd7040c0ca0 2023-09-28T04:23:45.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.623+0000 7fd6f97fa700 1 -- 172.21.15.118:0/673340658 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd700005cb0 con 0x7fd7040c0ca0 2023-09-28T04:23:45.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.623+0000 7fd70b5ff700 1 -- 172.21.15.118:0/673340658 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f4009420 con 0x7fd7040c0ca0 2023-09-28T04:23:45.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.623+0000 7fd6f97fa700 1 -- 172.21.15.118:0/673340658 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700007320 con 0x7fd7040c0ca0 2023-09-28T04:23:45.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.623+0000 7fd70b5ff700 1 -- 172.21.15.118:0/673340658 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7040bb5b0 con 0x7fd7040c0ca0 2023-09-28T04:23:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.624+0000 7fd70b5ff700 1 -- 172.21.15.118:0/673340658 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd704163560 con 0x7fd7040c0ca0 2023-09-28T04:23:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.625+0000 7fd6f97fa700 1 -- 172.21.15.118:0/673340658 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd70001b3b0 con 0x7fd7040c0ca0 2023-09-28T04:23:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.626+0000 7fd6f97fa700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd6e8067330 0x7fd6e80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.626+0000 7fd6f97fa700 1 -- 172.21.15.118:0/673340658 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd700084130 con 0x7fd7040c0ca0 2023-09-28T04:23:45.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.626+0000 7fd708b9a700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd6e8067330 0x7fd6e80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:45.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.627+0000 7fd708b9a700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd6e8067330 0x7fd6e80697e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40091e0 tx=0x7fd6f4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:45.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.630+0000 7fd6f97fa700 1 -- 172.21.15.118:0/673340658 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd700051050 con 0x7fd7040c0ca0 2023-09-28T04:23:45.822 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.822+0000 7fd70b5ff700 1 -- 172.21.15.118:0/673340658 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd704071980 con 0x7fd6e8067330 2023-09-28T04:23:45.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.822+0000 7fd6f97fa700 1 -- 172.21.15.118:0/673340658 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd704071980 con 0x7fd6e8067330 2023-09-28T04:23:45.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.825+0000 7fd70b5ff700 1 -- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd6e8067330 msgr2=0x7fd6e80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:45.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.825+0000 7fd70b5ff700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd6e8067330 0x7fd6e80697e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40091e0 tx=0x7fd6f4017000 comp rx=0 tx=0).stop 2023-09-28T04:23:45.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.825+0000 7fd70b5ff700 1 -- 172.21.15.118:0/673340658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7040c0ca0 msgr2=0x7fd704163bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:45.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.825+0000 7fd70b5ff700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7040c0ca0 0x7fd704163bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd70000c590 tx=0x7fd700007e00 comp rx=0 tx=0).stop 2023-09-28T04:23:45.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.825+0000 7fd70b5ff700 1 -- 172.21.15.118:0/673340658 shutdown_connections 2023-09-28T04:23:45.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.825+0000 7fd70b5ff700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fd6e8067330 0x7fd6e80697e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.825+0000 7fd70b5ff700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd70414c6a0 0x7fd704166860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.825+0000 7fd70b5ff700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7040c0ca0 0x7fd704163bb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.825+0000 7fd70b5ff700 1 --2- 172.21.15.118:0/673340658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7040c4310 0x7fd70414f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:45.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.825+0000 7fd70b5ff700 1 -- 172.21.15.118:0/673340658 >> 172.21.15.118:0/673340658 conn(0x7fd704067630 msgr2=0x7fd7040c4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:45.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.825+0000 7fd70b5ff700 1 -- 172.21.15.118:0/673340658 shutdown_connections 2023-09-28T04:23:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:45.825+0000 7fd70b5ff700 1 -- 172.21.15.118:0/673340658 wait complete. 2023-09-28T04:23:45.828 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 0 to deep-scrub 2023-09-28T04:23:45.842 INFO:tasks.ceph:Scrubbing osd.1 2023-09-28T04:23:45.843 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-09-28T04:23:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.036+0000 7f9f537ff700 1 Processor -- start 2023-09-28T04:23:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.036+0000 7f9f537ff700 1 -- start start 2023-09-28T04:23:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.037+0000 7f9f537ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f4c0abd60 0x7f9f4c0c7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.037+0000 7f9f537ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4c155a10 con 0x7f9f4c069860 2023-09-28T04:23:46.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.037+0000 7f9f537ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4c155cf0 con 0x7f9f4c0ac130 2023-09-28T04:23:46.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.037+0000 7f9f537ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c14ff20 con 0x7f9f4c0abd60 2023-09-28T04:23:46.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.037+0000 7f9f51d9c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9f4c069860 0x7f9f4c0ad8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46008/0 (socket says 172.21.15.118:46008) 2023-09-28T04:23:46.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.037+0000 7f9f51d9c700 1 -- 172.21.15.118:0/4141790376 learned_addr learned my addr 172.21.15.118:0/4141790376 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:46.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.037+0000 7f9f5159b700 1 --2- 172.21.15.118:0/4141790376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f4c0abd60 0x7f9f4c0c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.038+0000 7f9f43fff700 1 -- 172.21.15.118:0/4141790376 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513065601 0 0) 0x7f9f4c155a10 con 0x7f9f4c069860 2023-09-28T04:23:46.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.038+0000 7f9f43fff700 1 -- 172.21.15.118:0/4141790376 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f38003570 con 0x7f9f4c069860 2023-09-28T04:23:46.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.038+0000 7f9f43fff700 1 -- 172.21.15.118:0/4141790376 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191146950 0 0) 0x7f9f4c155cf0 con 0x7f9f4c0ac130 2023-09-28T04:23:46.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.038+0000 7f9f43fff700 1 -- 172.21.15.118:0/4141790376 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f4c155a10 con 0x7f9f4c0ac130 2023-09-28T04:23:46.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.038+0000 7f9f5159b700 1 -- 172.21.15.118:0/4141790376 >> v1:172.21.15.174:6789/0 conn(0x7f9f4c0ac130 legacy=0x7f9f4c069150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.038+0000 7f9f5159b700 1 -- 172.21.15.118:0/4141790376 >> v1:172.21.15.118:6789/0 conn(0x7f9f4c069860 legacy=0x7f9f4c0ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.038+0000 7f9f5159b700 1 -- 172.21.15.118:0/4141790376 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c155fd0 con 0x7f9f4c0abd60 2023-09-28T04:23:46.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.038+0000 7f9f5159b700 1 --2- 172.21.15.118:0/4141790376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f4c0abd60 0x7f9f4c0c7380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009910 tx=0x7f9f480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8796b876d1f84c60 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.038+0000 7f9f43fff700 1 -- 172.21.15.118:0/4141790376 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48011630 con 0x7f9f4c0abd60 2023-09-28T04:23:46.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.038+0000 7f9f43fff700 1 -- 172.21.15.118:0/4141790376 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f48011790 con 0x7f9f4c0abd60 2023-09-28T04:23:46.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.038+0000 7f9f43fff700 1 -- 172.21.15.118:0/4141790376 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48011b30 con 0x7f9f4c0abd60 2023-09-28T04:23:46.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.039+0000 7f9f537ff700 1 -- 172.21.15.118:0/4141790376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f4c0abd60 msgr2=0x7f9f4c0c7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.039+0000 7f9f537ff700 1 --2- 172.21.15.118:0/4141790376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f4c0abd60 0x7f9f4c0c7380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009910 tx=0x7f9f480091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.039+0000 7f9f537ff700 1 -- 172.21.15.118:0/4141790376 shutdown_connections 2023-09-28T04:23:46.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.039+0000 7f9f537ff700 1 --2- 172.21.15.118:0/4141790376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f4c0abd60 0x7f9f4c0c7380 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.039+0000 7f9f537ff700 1 -- 172.21.15.118:0/4141790376 >> 172.21.15.118:0/4141790376 conn(0x7f9f4c063230 msgr2=0x7f9f4c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:46.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.039+0000 7f9f537ff700 1 -- 172.21.15.118:0/4141790376 shutdown_connections 2023-09-28T04:23:46.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.039+0000 7f9f537ff700 1 -- 172.21.15.118:0/4141790376 wait complete. 2023-09-28T04:23:46.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.041+0000 7f9f537ff700 1 Processor -- start 2023-09-28T04:23:46.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.041+0000 7f9f537ff700 1 -- start start 2023-09-28T04:23:46.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.042+0000 7f9f537ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f4c069860 0x7f9f4c157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.042+0000 7f9f537ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f4c0abd60 0x7f9f4c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.042+0000 7f9f537ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4c0ac130 0x7f9f4c156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.042+0000 7f9f537ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c1657e0 con 0x7f9f4c0ac130 2023-09-28T04:23:46.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.042+0000 7f9f537ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c1533f0 con 0x7f9f4c0abd60 2023-09-28T04:23:46.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.042+0000 7f9f537ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c165a30 con 0x7f9f4c069860 2023-09-28T04:23:46.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f51d9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4c0ac130 0x7f9f4c156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f5159b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f4c069860 0x7f9f4c157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f50d9a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f4c0abd60 0x7f9f4c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f51d9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4c0ac130 0x7f9f4c156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54606/0 (socket says 172.21.15.118:54606) 2023-09-28T04:23:46.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f51d9c700 1 -- 172.21.15.118:0/403056882 learned_addr learned my addr 172.21.15.118:0/403056882 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:46.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f51d9c700 1 -- 172.21.15.118:0/403056882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f4c069860 msgr2=0x7f9f4c157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f51d9c700 1 --2- 172.21.15.118:0/403056882 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f4c069860 0x7f9f4c157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f51d9c700 1 -- 172.21.15.118:0/403056882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f4c0abd60 msgr2=0x7f9f4c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f51d9c700 1 --2- 172.21.15.118:0/403056882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f4c0abd60 0x7f9f4c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f51d9c700 1 -- 172.21.15.118:0/403056882 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f48009420 con 0x7f9f4c0ac130 2023-09-28T04:23:46.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f51d9c700 1 --2- 172.21.15.118:0/403056882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4c0ac130 0x7f9f4c156db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9f44001460 tx=0x7f9f44001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f417fa700 1 -- 172.21.15.118:0/403056882 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4400a8b0 con 0x7f9f4c0ac130 2023-09-28T04:23:46.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f417fa700 1 -- 172.21.15.118:0/403056882 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4400aa10 con 0x7f9f4c0ac130 2023-09-28T04:23:46.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f537ff700 1 -- 172.21.15.118:0/403056882 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4c165d10 con 0x7f9f4c0ac130 2023-09-28T04:23:46.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.043+0000 7f9f417fa700 1 -- 172.21.15.118:0/403056882 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4400add0 con 0x7f9f4c0ac130 2023-09-28T04:23:46.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.044+0000 7f9f537ff700 1 -- 172.21.15.118:0/403056882 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c1662d0 con 0x7f9f4c0ac130 2023-09-28T04:23:46.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.044+0000 7f9f537ff700 1 -- 172.21.15.118:0/403056882 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f4c071980 con 0x7f9f4c0ac130 2023-09-28T04:23:46.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.045+0000 7f9f417fa700 1 -- 172.21.15.118:0/403056882 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9f44007300 con 0x7f9f4c0ac130 2023-09-28T04:23:46.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.046+0000 7f9f417fa700 1 --2- 172.21.15.118:0/403056882 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9f30067330 0x7f9f300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.046+0000 7f9f417fa700 1 -- 172.21.15.118:0/403056882 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9f44084fb0 con 0x7f9f4c0ac130 2023-09-28T04:23:46.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.046+0000 7f9f417fa700 1 --2- 172.21.15.118:0/403056882 >> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] conn(0x7f9f3006fbe0 0x7f9f30071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.046+0000 7f9f417fa700 1 -- 172.21.15.118:0/403056882 --> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f300726a0 con 0x7f9f3006fbe0 2023-09-28T04:23:46.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.046+0000 7f9f417fa700 1 -- 172.21.15.118:0/403056882 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f44087510 con 0x7f9f4c0ac130 2023-09-28T04:23:46.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.046+0000 7f9f5159b700 1 --2- 172.21.15.118:0/403056882 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9f30067330 0x7f9f300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.047+0000 7f9f50d9a700 1 --2- 172.21.15.118:0/403056882 >> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] conn(0x7f9f3006fbe0 0x7f9f30071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.047+0000 7f9f5159b700 1 --2- 172.21.15.118:0/403056882 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9f30067330 0x7f9f300697e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9f480091e0 tx=0x7f9f48017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.047+0000 7f9f50d9a700 1 --2- 172.21.15.118:0/403056882 >> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] conn(0x7f9f3006fbe0 0x7f9f30071ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.048+0000 7f9f417fa700 1 -- 172.21.15.118:0/403056882 <== osd.1 v2:172.21.15.118:6816/114260 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9f300726a0 con 0x7f9f3006fbe0 2023-09-28T04:23:46.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.062+0000 7f9f537ff700 1 -- 172.21.15.118:0/403056882 --> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9f4c069f90 con 0x7f9f3006fbe0 2023-09-28T04:23:46.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.062+0000 7f9f417fa700 1 -- 172.21.15.118:0/403056882 <== osd.1 v2:172.21.15.118:6816/114260 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9f4c069f90 con 0x7f9f3006fbe0 2023-09-28T04:23:46.063 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-09-28T04:23:46.063 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T04:23:46.064 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-09-28T04:23:46.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.063+0000 7f9f537ff700 1 -- 172.21.15.118:0/403056882 >> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] conn(0x7f9f3006fbe0 msgr2=0x7f9f30071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.063+0000 7f9f537ff700 1 --2- 172.21.15.118:0/403056882 >> [v2:172.21.15.118:6816/114260,v1:172.21.15.118:6817/114260] conn(0x7f9f3006fbe0 0x7f9f30071ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.063+0000 7f9f537ff700 1 -- 172.21.15.118:0/403056882 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9f30067330 msgr2=0x7f9f300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.063+0000 7f9f537ff700 1 --2- 172.21.15.118:0/403056882 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f9f30067330 0x7f9f300697e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9f480091e0 tx=0x7f9f48017000 comp rx=0 tx=0).stop 2023-09-28T04:23:46.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.063+0000 7f9f537ff700 1 -- 172.21.15.118:0/403056882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4c0ac130 msgr2=0x7f9f4c156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.063+0000 7f9f537ff700 1 --2- 172.21.15.118:0/403056882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4c0ac130 0x7f9f4c156db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9f44001460 tx=0x7f9f44001aa0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.063+0000 7f9f51d9c700 1 -- 172.21.15.118:0/403056882 reap_dead start 2023-09-28T04:23:46.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.063+0000 7f9f537ff700 1 -- 172.21.15.118:0/403056882 shutdown_connections 2023-09-28T04:23:46.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.063+0000 7f9f537ff700 1 -- 172.21.15.118:0/403056882 >> 172.21.15.118:0/403056882 conn(0x7f9f4c063230 msgr2=0x7f9f4c0cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:46.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.063+0000 7f9f537ff700 1 -- 172.21.15.118:0/403056882 shutdown_connections 2023-09-28T04:23:46.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.063+0000 7f9f537ff700 1 -- 172.21.15.118:0/403056882 wait complete. 2023-09-28T04:23:46.080 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-09-28T04:23:46.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.269+0000 7fdd5abff700 1 Processor -- start 2023-09-28T04:23:46.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.269+0000 7fdd5abff700 1 -- start start 2023-09-28T04:23:46.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.270+0000 7fdd5abff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdd540c4ab0 0x7fdd54156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.270+0000 7fdd5abff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd540c73e0 con 0x7fdd540c5e30 2023-09-28T04:23:46.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.270+0000 7fdd5abff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd540c0b60 con 0x7fdd540ca6c0 2023-09-28T04:23:46.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.270+0000 7fdd5abff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd540c67d0 con 0x7fdd540c4ab0 2023-09-28T04:23:46.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.270+0000 7fdd5919c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdd540c4ab0 0x7fdd54156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.270+0000 7fdd5899b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fdd540c5e30 0x7fdd540c9fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46016/0 (socket says 172.21.15.118:46016) 2023-09-28T04:23:46.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.270+0000 7fdd5899b700 1 -- 172.21.15.118:0/1302914813 learned_addr learned my addr 172.21.15.118:0/1302914813 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:46.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.271+0000 7fdd5919c700 1 -- 172.21.15.118:0/1302914813 >> v1:172.21.15.174:6789/0 conn(0x7fdd540ca6c0 legacy=0x7fdd5414f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.271+0000 7fdd5919c700 1 -- 172.21.15.118:0/1302914813 >> v1:172.21.15.118:6789/0 conn(0x7fdd540c5e30 legacy=0x7fdd540c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.271+0000 7fdd5919c700 1 -- 172.21.15.118:0/1302914813 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd540c6ab0 con 0x7fdd540c4ab0 2023-09-28T04:23:46.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.271+0000 7fdd537fe700 1 -- 172.21.15.118:0/1302914813 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455887691 0 0) 0x7fdd540c0b60 con 0x7fdd540ca6c0 2023-09-28T04:23:46.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.271+0000 7fdd5919c700 1 --2- 172.21.15.118:0/1302914813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd540c4ab0 0x7fdd54156570 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009e60 tx=0x7fdd4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e5a1bff626abac server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.271+0000 7fdd537fe700 1 -- 172.21.15.118:0/1302914813 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00e070 con 0x7fdd540c4ab0 2023-09-28T04:23:46.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.271+0000 7fdd537fe700 1 -- 172.21.15.118:0/1302914813 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c00bb30 con 0x7fdd540c4ab0 2023-09-28T04:23:46.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.271+0000 7fdd537fe700 1 -- 172.21.15.118:0/1302914813 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c012430 con 0x7fdd540c4ab0 2023-09-28T04:23:46.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.272+0000 7fdd5abff700 1 -- 172.21.15.118:0/1302914813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd540c4ab0 msgr2=0x7fdd54156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.272+0000 7fdd5abff700 1 --2- 172.21.15.118:0/1302914813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd540c4ab0 0x7fdd54156570 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009e60 tx=0x7fdd4c009780 comp rx=0 tx=0).stop 2023-09-28T04:23:46.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.272+0000 7fdd5abff700 1 -- 172.21.15.118:0/1302914813 shutdown_connections 2023-09-28T04:23:46.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.272+0000 7fdd5abff700 1 --2- 172.21.15.118:0/1302914813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd540c4ab0 0x7fdd54156570 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.272+0000 7fdd5abff700 1 -- 172.21.15.118:0/1302914813 >> 172.21.15.118:0/1302914813 conn(0x7fdd54063230 msgr2=0x7fdd54063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:46.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.272+0000 7fdd5abff700 1 -- 172.21.15.118:0/1302914813 shutdown_connections 2023-09-28T04:23:46.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.272+0000 7fdd5abff700 1 -- 172.21.15.118:0/1302914813 wait complete. 2023-09-28T04:23:46.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.273+0000 7fdd5abff700 1 Processor -- start 2023-09-28T04:23:46.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.274+0000 7fdd5abff700 1 -- start start 2023-09-28T04:23:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.274+0000 7fdd5abff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd540c4ab0 0x7fdd540c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.274+0000 7fdd5abff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd540c5e30 0x7fdd540c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.274+0000 7fdd5abff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd540ca6c0 0x7fdd5414ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.274+0000 7fdd5abff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540c2c10 con 0x7fdd540c5e30 2023-09-28T04:23:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.274+0000 7fdd5abff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540c2070 con 0x7fdd540ca6c0 2023-09-28T04:23:46.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.274+0000 7fdd5abff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540ace80 con 0x7fdd540c4ab0 2023-09-28T04:23:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.275+0000 7fdd53fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd540c5e30 0x7fdd540c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.275+0000 7fdd5899b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd540c4ab0 0x7fdd540c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.275+0000 7fdd53fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd540c5e30 0x7fdd540c35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54620/0 (socket says 172.21.15.118:54620) 2023-09-28T04:23:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.275+0000 7fdd53fff700 1 -- 172.21.15.118:0/2821667132 learned_addr learned my addr 172.21.15.118:0/2821667132 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.275+0000 7fdd5919c700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd540ca6c0 0x7fdd5414ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.275+0000 7fdd53fff700 1 -- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd540c4ab0 msgr2=0x7fdd540c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.275+0000 7fdd53fff700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd540c4ab0 0x7fdd540c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.275+0000 7fdd53fff700 1 -- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd540ca6c0 msgr2=0x7fdd5414ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.275+0000 7fdd53fff700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd540ca6c0 0x7fdd5414ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.275+0000 7fdd53fff700 1 -- 172.21.15.118:0/2821667132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c009a20 con 0x7fdd540c5e30 2023-09-28T04:23:46.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.275+0000 7fdd5899b700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd540c4ab0 0x7fdd540c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:46.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.275+0000 7fdd5919c700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd540ca6c0 0x7fdd5414ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:46.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.275+0000 7fdd53fff700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd540c5e30 0x7fdd540c35e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000c5c0 tx=0x7fdd40007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.276+0000 7fdd50ff9700 1 -- 172.21.15.118:0/2821667132 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40011590 con 0x7fdd540c5e30 2023-09-28T04:23:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.276+0000 7fdd50ff9700 1 -- 172.21.15.118:0/2821667132 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd40011710 con 0x7fdd540c5e30 2023-09-28T04:23:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.276+0000 7fdd50ff9700 1 -- 172.21.15.118:0/2821667132 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40011ad0 con 0x7fdd540c5e30 2023-09-28T04:23:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.276+0000 7fdd5abff700 1 -- 172.21.15.118:0/2821667132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd54069740 con 0x7fdd540c5e30 2023-09-28T04:23:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.276+0000 7fdd5abff700 1 -- 172.21.15.118:0/2821667132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd540c25c0 con 0x7fdd540c5e30 2023-09-28T04:23:46.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.277+0000 7fdd5abff700 1 -- 172.21.15.118:0/2821667132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd540713a0 con 0x7fdd540c5e30 2023-09-28T04:23:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.278+0000 7fdd50ff9700 1 -- 172.21.15.118:0/2821667132 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdd4001b3b0 con 0x7fdd540c5e30 2023-09-28T04:23:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.279+0000 7fdd50ff9700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdd38067330 0x7fdd380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.279+0000 7fdd50ff9700 1 -- 172.21.15.118:0/2821667132 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdd40084010 con 0x7fdd540c5e30 2023-09-28T04:23:46.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.279+0000 7fdd5899b700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdd38067330 0x7fdd380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.280+0000 7fdd5899b700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdd38067330 0x7fdd380697e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdd480010e0 tx=0x7fdd48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.283+0000 7fdd50ff9700 1 -- 172.21.15.118:0/2821667132 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdd40050f10 con 0x7fdd540c5e30 2023-09-28T04:23:46.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.476+0000 7fdd5abff700 1 -- 172.21.15.118:0/2821667132 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd54071980 con 0x7fdd38067330 2023-09-28T04:23:46.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.476+0000 7fdd50ff9700 1 -- 172.21.15.118:0/2821667132 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdd54071980 con 0x7fdd38067330 2023-09-28T04:23:46.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.479+0000 7fdd5abff700 1 -- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdd38067330 msgr2=0x7fdd380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.479+0000 7fdd5abff700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdd38067330 0x7fdd380697e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdd480010e0 tx=0x7fdd48009040 comp rx=0 tx=0).stop 2023-09-28T04:23:46.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.479+0000 7fdd5abff700 1 -- 172.21.15.118:0/2821667132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd540c5e30 msgr2=0x7fdd540c35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.479+0000 7fdd5abff700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd540c5e30 0x7fdd540c35e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000c5c0 tx=0x7fdd40007ef0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.479+0000 7fdd5abff700 1 -- 172.21.15.118:0/2821667132 shutdown_connections 2023-09-28T04:23:46.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.479+0000 7fdd5abff700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fdd38067330 0x7fdd380697e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.481 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.479+0000 7fdd5abff700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdd540ca6c0 0x7fdd5414ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.481 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.479+0000 7fdd5abff700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdd540c4ab0 0x7fdd540c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.481 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.479+0000 7fdd5abff700 1 --2- 172.21.15.118:0/2821667132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd540c5e30 0x7fdd540c35e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.481 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.479+0000 7fdd5abff700 1 -- 172.21.15.118:0/2821667132 >> 172.21.15.118:0/2821667132 conn(0x7fdd54063230 msgr2=0x7fdd54063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:46.481 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.479+0000 7fdd5abff700 1 -- 172.21.15.118:0/2821667132 shutdown_connections 2023-09-28T04:23:46.481 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.479+0000 7fdd5abff700 1 -- 172.21.15.118:0/2821667132 wait complete. 2023-09-28T04:23:46.482 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 1 to deep-scrub 2023-09-28T04:23:46.497 INFO:tasks.ceph:Scrubbing osd.2 2023-09-28T04:23:46.497 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-09-28T04:23:46.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.688+0000 7fcb4a9ff700 1 Processor -- start 2023-09-28T04:23:46.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.688+0000 7fcb4a9ff700 1 -- start start 2023-09-28T04:23:46.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb4a9ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcb440abd60 0x7fcb440c7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb4a9ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb440ac130 0x7fcb440c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb4a9ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcb44069150 0x7fcb440695a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb4a9ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4414ff20 con 0x7fcb44069150 2023-09-28T04:23:46.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb4a9ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb44068d00 con 0x7fcb440abd60 2023-09-28T04:23:46.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb4a9ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb44069ae0 con 0x7fcb440ac130 2023-09-28T04:23:46.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb48f9c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcb44069150 0x7fcb440695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb3bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb440ac130 0x7fcb440c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb48f9c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcb44069150 0x7fcb440695a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54630/0 (socket says 172.21.15.118:54630) 2023-09-28T04:23:46.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb48f9c700 1 -- 172.21.15.118:0/4095564301 learned_addr learned my addr 172.21.15.118:0/4095564301 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:46.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb43fff700 1 --2- 172.21.15.118:0/4095564301 >> v2:172.21.15.174:3300/0 conn(0x7fcb440abd60 0x7fcb440c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb48f9c700 1 -- 172.21.15.118:0/4095564301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb440ac130 msgr2=0x7fcb440c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:46.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb48f9c700 1 --2- 172.21.15.118:0/4095564301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb440ac130 0x7fcb440c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb48f9c700 1 -- 172.21.15.118:0/4095564301 >> v2:172.21.15.174:3300/0 conn(0x7fcb440abd60 msgr2=0x7fcb440c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:46.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb48f9c700 1 --2- 172.21.15.118:0/4095564301 >> v2:172.21.15.174:3300/0 conn(0x7fcb440abd60 0x7fcb440c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.690+0000 7fcb48f9c700 1 -- 172.21.15.118:0/4095564301 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb44155a10 con 0x7fcb44069150 2023-09-28T04:23:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.691+0000 7fcb48f9c700 1 --2- 172.21.15.118:0/4095564301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb44069150 0x7fcb440695a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcb44089da0 tx=0x7fcb3c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effff0cd583b1cc server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.691+0000 7fcb437fe700 1 -- 172.21.15.118:0/4095564301 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00e070 con 0x7fcb44069150 2023-09-28T04:23:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.691+0000 7fcb437fe700 1 -- 172.21.15.118:0/4095564301 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c00b970 con 0x7fcb44069150 2023-09-28T04:23:46.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.691+0000 7fcb437fe700 1 -- 172.21.15.118:0/4095564301 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0092e0 con 0x7fcb44069150 2023-09-28T04:23:46.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.691+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4095564301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb44069150 msgr2=0x7fcb440695a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.691+0000 7fcb4a9ff700 1 --2- 172.21.15.118:0/4095564301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb44069150 0x7fcb440695a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcb44089da0 tx=0x7fcb3c009840 comp rx=0 tx=0).stop 2023-09-28T04:23:46.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.691+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4095564301 shutdown_connections 2023-09-28T04:23:46.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.691+0000 7fcb4a9ff700 1 --2- 172.21.15.118:0/4095564301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb44069150 0x7fcb440695a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.691+0000 7fcb4a9ff700 1 --2- 172.21.15.118:0/4095564301 >> v2:172.21.15.174:3300/0 conn(0x7fcb440abd60 0x7fcb440c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.691+0000 7fcb4a9ff700 1 --2- 172.21.15.118:0/4095564301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb440ac130 0x7fcb440c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.691+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4095564301 >> 172.21.15.118:0/4095564301 conn(0x7fcb44063230 msgr2=0x7fcb44063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:46.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.692+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4095564301 shutdown_connections 2023-09-28T04:23:46.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.692+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4095564301 wait complete. 2023-09-28T04:23:46.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.694+0000 7fcb4a9ff700 1 Processor -- start 2023-09-28T04:23:46.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.694+0000 7fcb4a9ff700 1 -- start start 2023-09-28T04:23:46.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.695+0000 7fcb4a9ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb44069150 0x7fcb44156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.695+0000 7fcb4a9ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb440abd60 0x7fcb4415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.695+0000 7fcb4a9ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb440ac130 0x7fcb4415b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.695+0000 7fcb4a9ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4415ab30 con 0x7fcb440abd60 2023-09-28T04:23:46.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.695+0000 7fcb4a9ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb440cc910 con 0x7fcb44069150 2023-09-28T04:23:46.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.695+0000 7fcb4a9ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb44165a00 con 0x7fcb440ac130 2023-09-28T04:23:46.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.695+0000 7fcb3bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb440abd60 0x7fcb4415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.695+0000 7fcb3bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb440abd60 0x7fcb4415b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54644/0 (socket says 172.21.15.118:54644) 2023-09-28T04:23:46.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.695+0000 7fcb3bfff700 1 -- 172.21.15.118:0/4068332696 learned_addr learned my addr 172.21.15.118:0/4068332696 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:46.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.695+0000 7fcb48f9c700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb440ac130 0x7fcb4415b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.695+0000 7fcb43fff700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb44069150 0x7fcb44156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.696+0000 7fcb3bfff700 1 -- 172.21.15.118:0/4068332696 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb440ac130 msgr2=0x7fcb4415b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.696+0000 7fcb3bfff700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb440ac130 0x7fcb4415b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.696+0000 7fcb3bfff700 1 -- 172.21.15.118:0/4068332696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb44069150 msgr2=0x7fcb44156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.696+0000 7fcb3bfff700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb44069150 0x7fcb44156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.696+0000 7fcb3bfff700 1 -- 172.21.15.118:0/4068332696 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c009ae0 con 0x7fcb440abd60 2023-09-28T04:23:46.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.696+0000 7fcb3bfff700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb440abd60 0x7fcb4415b2a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00e950 tx=0x7fcb2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.696+0000 7fcb40ff9700 1 -- 172.21.15.118:0/4068332696 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c013680 con 0x7fcb440abd60 2023-09-28T04:23:46.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.696+0000 7fcb40ff9700 1 -- 172.21.15.118:0/4068332696 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2c0137e0 con 0x7fcb440abd60 2023-09-28T04:23:46.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.696+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4068332696 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb44165ce0 con 0x7fcb440abd60 2023-09-28T04:23:46.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.696+0000 7fcb40ff9700 1 -- 172.21.15.118:0/4068332696 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c013ba0 con 0x7fcb440abd60 2023-09-28T04:23:46.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.696+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4068332696 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb441662a0 con 0x7fcb440abd60 2023-09-28T04:23:46.703 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.697+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4068332696 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb440c9410 con 0x7fcb440abd60 2023-09-28T04:23:46.703 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.698+0000 7fcb40ff9700 1 -- 172.21.15.118:0/4068332696 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcb2c0123d0 con 0x7fcb440abd60 2023-09-28T04:23:46.703 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.699+0000 7fcb40ff9700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fcb24067360 0x7fcb24069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.699+0000 7fcb40ff9700 1 -- 172.21.15.118:0/4068332696 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcb2c084d20 con 0x7fcb440abd60 2023-09-28T04:23:46.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.700+0000 7fcb40ff9700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] conn(0x7fcb2406fc10 0x7fcb24072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.700+0000 7fcb43fff700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fcb24067360 0x7fcb24069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.700+0000 7fcb40ff9700 1 -- 172.21.15.118:0/4068332696 --> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb240726d0 con 0x7fcb2406fc10 2023-09-28T04:23:46.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.700+0000 7fcb40ff9700 1 -- 172.21.15.118:0/4068332696 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb2c08a070 con 0x7fcb440abd60 2023-09-28T04:23:46.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.700+0000 7fcb48f9c700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] conn(0x7fcb2406fc10 0x7fcb24072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.704 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.700+0000 7fcb43fff700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fcb24067360 0x7fcb24069810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009db0 tx=0x7fcb340091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.700+0000 7fcb48f9c700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] conn(0x7fcb2406fc10 0x7fcb24072020 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.701+0000 7fcb40ff9700 1 -- 172.21.15.118:0/4068332696 <== osd.2 v2:172.21.15.118:6808/114259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fcb240726d0 con 0x7fcb2406fc10 2023-09-28T04:23:46.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.715+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4068332696 --> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcb44071980 con 0x7fcb2406fc10 2023-09-28T04:23:46.716 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.715+0000 7fcb40ff9700 1 -- 172.21.15.118:0/4068332696 <== osd.2 v2:172.21.15.118:6808/114259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcb44071980 con 0x7fcb2406fc10 2023-09-28T04:23:46.716 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-09-28T04:23:46.716 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T04:23:46.717 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-09-28T04:23:46.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.716+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4068332696 >> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] conn(0x7fcb2406fc10 msgr2=0x7fcb24072020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.716+0000 7fcb4a9ff700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.118:6808/114259,v1:172.21.15.118:6809/114259] conn(0x7fcb2406fc10 0x7fcb24072020 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.716+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4068332696 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fcb24067360 msgr2=0x7fcb24069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.716+0000 7fcb4a9ff700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fcb24067360 0x7fcb24069810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009db0 tx=0x7fcb340091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.716+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4068332696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb440abd60 msgr2=0x7fcb4415b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.716+0000 7fcb4a9ff700 1 --2- 172.21.15.118:0/4068332696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb440abd60 0x7fcb4415b2a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00e950 tx=0x7fcb2c0091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.716+0000 7fcb48f9c700 1 -- 172.21.15.118:0/4068332696 reap_dead start 2023-09-28T04:23:46.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.716+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4068332696 shutdown_connections 2023-09-28T04:23:46.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.716+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4068332696 >> 172.21.15.118:0/4068332696 conn(0x7fcb44063230 msgr2=0x7fcb4414f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:46.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.716+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4068332696 shutdown_connections 2023-09-28T04:23:46.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.716+0000 7fcb4a9ff700 1 -- 172.21.15.118:0/4068332696 wait complete. 2023-09-28T04:23:46.733 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-09-28T04:23:46.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.924+0000 7f4485fff700 1 Processor -- start 2023-09-28T04:23:46.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.924+0000 7f4485fff700 1 -- start start 2023-09-28T04:23:46.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.925+0000 7f4485fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4480152640 0x7f44800c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.925+0000 7f4485fff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448014c3c0 con 0x7f448006f1c0 2023-09-28T04:23:46.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.925+0000 7f4485fff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4480152a70 con 0x7f44800c36f0 2023-09-28T04:23:46.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.925+0000 7f4485fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44800c24c0 con 0x7f4480152640 2023-09-28T04:23:46.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.925+0000 7f447f7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f448006f1c0 0x7f448006b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46020/0 (socket says 172.21.15.118:46020) 2023-09-28T04:23:46.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.925+0000 7f447f7fe700 1 -- 172.21.15.118:0/1077233600 learned_addr learned my addr 172.21.15.118:0/1077233600 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:46.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.925+0000 7f447effd700 1 --2- 172.21.15.118:0/1077233600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4480152640 0x7f44800c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.926+0000 7f447e7fc700 1 -- 172.21.15.118:0/1077233600 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996169895 0 0) 0x7f448014c3c0 con 0x7f448006f1c0 2023-09-28T04:23:46.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.926+0000 7f447e7fc700 1 -- 172.21.15.118:0/1077233600 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4468003570 con 0x7f448006f1c0 2023-09-28T04:23:46.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.926+0000 7f447e7fc700 1 -- 172.21.15.118:0/1077233600 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150316330 0 0) 0x7f4480152a70 con 0x7f44800c36f0 2023-09-28T04:23:46.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.926+0000 7f447e7fc700 1 -- 172.21.15.118:0/1077233600 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f448014c3c0 con 0x7f44800c36f0 2023-09-28T04:23:46.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.926+0000 7f447effd700 1 -- 172.21.15.118:0/1077233600 >> v1:172.21.15.174:6789/0 conn(0x7f44800c36f0 legacy=0x7f448015c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.926+0000 7f447effd700 1 -- 172.21.15.118:0/1077233600 >> v1:172.21.15.118:6789/0 conn(0x7f448006f1c0 legacy=0x7f448006b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.926+0000 7f447effd700 1 -- 172.21.15.118:0/1077233600 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448006c2c0 con 0x7f4480152640 2023-09-28T04:23:46.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.926+0000 7f447effd700 1 --2- 172.21.15.118:0/1077233600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4480152640 0x7f44800c31b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f447400aac0 tx=0x7f447400a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=225f7198c6b88623 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.926+0000 7f447e7fc700 1 -- 172.21.15.118:0/1077233600 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447400c970 con 0x7f4480152640 2023-09-28T04:23:46.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.926+0000 7f447e7fc700 1 -- 172.21.15.118:0/1077233600 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447400cad0 con 0x7f4480152640 2023-09-28T04:23:46.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.926+0000 7f447e7fc700 1 -- 172.21.15.118:0/1077233600 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447400ce70 con 0x7f4480152640 2023-09-28T04:23:46.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.927+0000 7f4485fff700 1 -- 172.21.15.118:0/1077233600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4480152640 msgr2=0x7f44800c31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.927+0000 7f4485fff700 1 --2- 172.21.15.118:0/1077233600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4480152640 0x7f44800c31b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f447400aac0 tx=0x7f447400a330 comp rx=0 tx=0).stop 2023-09-28T04:23:46.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.927+0000 7f4485fff700 1 -- 172.21.15.118:0/1077233600 shutdown_connections 2023-09-28T04:23:46.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.927+0000 7f4485fff700 1 --2- 172.21.15.118:0/1077233600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4480152640 0x7f44800c31b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.927+0000 7f4485fff700 1 -- 172.21.15.118:0/1077233600 >> 172.21.15.118:0/1077233600 conn(0x7f4480067630 msgr2=0x7f4480067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:46.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.927+0000 7f4485fff700 1 -- 172.21.15.118:0/1077233600 shutdown_connections 2023-09-28T04:23:46.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.927+0000 7f4485fff700 1 -- 172.21.15.118:0/1077233600 wait complete. 2023-09-28T04:23:46.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.929+0000 7f4485fff700 1 Processor -- start 2023-09-28T04:23:46.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.929+0000 7f4485fff700 1 -- start start 2023-09-28T04:23:46.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f4485fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f448006f1c0 0x7f4480162f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f4485fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44800c36f0 0x7f44800bd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f4485fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4480152640 0x7f44800bdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f4485fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448015ab70 con 0x7f448006f1c0 2023-09-28T04:23:46.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f4485fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44800be120 con 0x7f4480152640 2023-09-28T04:23:46.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f4485fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4480167e70 con 0x7f44800c36f0 2023-09-28T04:23:46.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f447f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f448006f1c0 0x7f4480162f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f447f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f448006f1c0 0x7f4480162f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54652/0 (socket says 172.21.15.118:54652) 2023-09-28T04:23:46.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f447f7fe700 1 -- 172.21.15.118:0/253571211 learned_addr learned my addr 172.21.15.118:0/253571211 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:46.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f447effd700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44800c36f0 0x7f44800bd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f447ffff700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4480152640 0x7f44800bdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f447f7fe700 1 -- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44800c36f0 msgr2=0x7f44800bd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f447f7fe700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44800c36f0 0x7f44800bd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f447f7fe700 1 -- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4480152640 msgr2=0x7f44800bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:46.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f447f7fe700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4480152640 0x7f44800bdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:46.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f447f7fe700 1 -- 172.21.15.118:0/253571211 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447400a5d0 con 0x7f448006f1c0 2023-09-28T04:23:46.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.930+0000 7f447f7fe700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f448006f1c0 0x7f4480162f40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f447000c790 tx=0x7f4470007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.931+0000 7f44677fe700 1 -- 172.21.15.118:0/253571211 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470005b30 con 0x7f448006f1c0 2023-09-28T04:23:46.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.931+0000 7f44677fe700 1 -- 172.21.15.118:0/253571211 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4470005c90 con 0x7f448006f1c0 2023-09-28T04:23:46.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.931+0000 7f44677fe700 1 -- 172.21.15.118:0/253571211 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470007300 con 0x7f448006f1c0 2023-09-28T04:23:46.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.931+0000 7f4485fff700 1 -- 172.21.15.118:0/253571211 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4480168300 con 0x7f448006f1c0 2023-09-28T04:23:46.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.931+0000 7f4485fff700 1 -- 172.21.15.118:0/253571211 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4480167260 con 0x7f448006f1c0 2023-09-28T04:23:46.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.932+0000 7f4485fff700 1 -- 172.21.15.118:0/253571211 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4480071980 con 0x7f448006f1c0 2023-09-28T04:23:46.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.933+0000 7f44677fe700 1 -- 172.21.15.118:0/253571211 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f447001b3b0 con 0x7f448006f1c0 2023-09-28T04:23:46.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.934+0000 7f44677fe700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f446c067330 0x7f446c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:46.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.934+0000 7f44677fe700 1 -- 172.21.15.118:0/253571211 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4470084120 con 0x7f448006f1c0 2023-09-28T04:23:46.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.934+0000 7f447effd700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f446c067330 0x7f446c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:46.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.935+0000 7f447effd700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f446c067330 0x7f446c0697e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f447400aa10 tx=0x7f447401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:46.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:46.938+0000 7f44677fe700 1 -- 172.21.15.118:0/253571211 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4470051000 con 0x7f448006f1c0 2023-09-28T04:23:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.127+0000 7f4485fff700 1 -- 172.21.15.118:0/253571211 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4480167fb0 con 0x7f446c067330 2023-09-28T04:23:47.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.128+0000 7f44677fe700 1 -- 172.21.15.118:0/253571211 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4474000c50 con 0x7f446c067330 2023-09-28T04:23:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.130+0000 7f4485fff700 1 -- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f446c067330 msgr2=0x7f446c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.130+0000 7f4485fff700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f446c067330 0x7f446c0697e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f447400aa10 tx=0x7f447401a000 comp rx=0 tx=0).stop 2023-09-28T04:23:47.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.130+0000 7f4485fff700 1 -- 172.21.15.118:0/253571211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f448006f1c0 msgr2=0x7f4480162f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.130+0000 7f4485fff700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f448006f1c0 0x7f4480162f40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f447000c790 tx=0x7f4470007ea0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.130+0000 7f4485fff700 1 -- 172.21.15.118:0/253571211 shutdown_connections 2023-09-28T04:23:47.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.130+0000 7f4485fff700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f446c067330 0x7f446c0697e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.130+0000 7f4485fff700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4480152640 0x7f44800bdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.130+0000 7f4485fff700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f448006f1c0 0x7f4480162f40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.130+0000 7f4485fff700 1 --2- 172.21.15.118:0/253571211 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44800c36f0 0x7f44800bd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.130+0000 7f4485fff700 1 -- 172.21.15.118:0/253571211 >> 172.21.15.118:0/253571211 conn(0x7f4480067630 msgr2=0x7f44800bfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:47.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.131+0000 7f4485fff700 1 -- 172.21.15.118:0/253571211 shutdown_connections 2023-09-28T04:23:47.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.131+0000 7f4485fff700 1 -- 172.21.15.118:0/253571211 wait complete. 2023-09-28T04:23:47.133 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 2 to deep-scrub 2023-09-28T04:23:47.148 INFO:tasks.ceph:Scrubbing osd.3 2023-09-28T04:23:47.149 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-09-28T04:23:47.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.341+0000 7f12551ff700 1 Processor -- start 2023-09-28T04:23:47.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.342+0000 7f12551ff700 1 -- start start 2023-09-28T04:23:47.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.343+0000 7f12551ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f12500bef80 0x7f125006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.343+0000 7f12551ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1250069a90 con 0x7f12500c2510 2023-09-28T04:23:47.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.343+0000 7f12551ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125006f600 con 0x7f12500c0af0 2023-09-28T04:23:47.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.343+0000 7f12551ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12501525f0 con 0x7f12500bef80 2023-09-28T04:23:47.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.343+0000 7f124e59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f12500bef80 0x7f125006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.343+0000 7f124f59e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f12500c2510 0x7f125015ceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46024/0 (socket says 172.21.15.118:46024) 2023-09-28T04:23:47.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.343+0000 7f124ed9d700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f12500c0af0 0x7f125006dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:44808/0 (socket says 172.21.15.118:44808) 2023-09-28T04:23:47.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.343+0000 7f124f59e700 1 -- 172.21.15.118:0/3240524550 learned_addr learned my addr 172.21.15.118:0/3240524550 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:47.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.344+0000 7f124dd9b700 1 -- 172.21.15.118:0/3240524550 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889506188 0 0) 0x7f125006f600 con 0x7f12500c0af0 2023-09-28T04:23:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.344+0000 7f124dd9b700 1 -- 172.21.15.118:0/3240524550 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1238003570 con 0x7f12500c0af0 2023-09-28T04:23:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.344+0000 7f124e59c700 1 -- 172.21.15.118:0/3240524550 >> v1:172.21.15.174:6789/0 conn(0x7f12500c0af0 legacy=0x7f125006dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.344+0000 7f124e59c700 1 -- 172.21.15.118:0/3240524550 >> v1:172.21.15.118:6789/0 conn(0x7f12500c2510 legacy=0x7f125015ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.344+0000 7f124dd9b700 1 -- 172.21.15.118:0/3240524550 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353279509 0 0) 0x7f1250069a90 con 0x7f12500c2510 2023-09-28T04:23:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.344+0000 7f124e59c700 1 -- 172.21.15.118:0/3240524550 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125006f880 con 0x7f12500bef80 2023-09-28T04:23:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.344+0000 7f124e59c700 1 --2- 172.21.15.118:0/3240524550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12500bef80 0x7f125006e7a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f12440098e0 tx=0x7f12440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5ee62081348c18 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.344+0000 7f124dd9b700 1 -- 172.21.15.118:0/3240524550 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400b640 con 0x7f12500bef80 2023-09-28T04:23:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.344+0000 7f124dd9b700 1 -- 172.21.15.118:0/3240524550 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124400b7a0 con 0x7f12500bef80 2023-09-28T04:23:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.344+0000 7f124dd9b700 1 -- 172.21.15.118:0/3240524550 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400bb40 con 0x7f12500bef80 2023-09-28T04:23:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.345+0000 7f12551ff700 1 -- 172.21.15.118:0/3240524550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12500bef80 msgr2=0x7f125006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.345+0000 7f12551ff700 1 --2- 172.21.15.118:0/3240524550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12500bef80 0x7f125006e7a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f12440098e0 tx=0x7f12440091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.345+0000 7f12551ff700 1 -- 172.21.15.118:0/3240524550 shutdown_connections 2023-09-28T04:23:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.345+0000 7f12551ff700 1 --2- 172.21.15.118:0/3240524550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12500bef80 0x7f125006e7a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.345+0000 7f12551ff700 1 -- 172.21.15.118:0/3240524550 >> 172.21.15.118:0/3240524550 conn(0x7f12500c7ba0 msgr2=0x7f12500c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.345+0000 7f12551ff700 1 -- 172.21.15.118:0/3240524550 shutdown_connections 2023-09-28T04:23:47.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.345+0000 7f12551ff700 1 -- 172.21.15.118:0/3240524550 wait complete. 2023-09-28T04:23:47.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.346+0000 7f12551ff700 1 Processor -- start 2023-09-28T04:23:47.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.346+0000 7f12551ff700 1 -- start start 2023-09-28T04:23:47.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.347+0000 7f12551ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12500bef80 0x7f1250067cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.347+0000 7f12551ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12500c0af0 0x7f12500c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.347+0000 7f12551ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12500c2510 0x7f1250165560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.347+0000 7f12551ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1250164e30 con 0x7f12500c0af0 2023-09-28T04:23:47.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.347+0000 7f12551ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1250154820 con 0x7f12500bef80 2023-09-28T04:23:47.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.347+0000 7f12551ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12500c1ae0 con 0x7f12500c2510 2023-09-28T04:23:47.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.348+0000 7f124ed9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12500bef80 0x7f1250067cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.348+0000 7f124e59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12500c0af0 0x7f12500c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.348+0000 7f124f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12500c2510 0x7f1250165560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.348+0000 7f124ed9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12500bef80 0x7f1250067cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.118:38390/0 (socket says 172.21.15.118:38390) 2023-09-28T04:23:47.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.348+0000 7f124ed9d700 1 -- 172.21.15.118:0/2946361561 learned_addr learned my addr 172.21.15.118:0/2946361561 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:47.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.348+0000 7f124e59c700 1 -- 172.21.15.118:0/2946361561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12500c2510 msgr2=0x7f1250165560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.348+0000 7f124e59c700 1 --2- 172.21.15.118:0/2946361561 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12500c2510 0x7f1250165560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.348+0000 7f124e59c700 1 -- 172.21.15.118:0/2946361561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12500bef80 msgr2=0x7f1250067cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.348+0000 7f124e59c700 1 --2- 172.21.15.118:0/2946361561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12500bef80 0x7f1250067cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.348+0000 7f124e59c700 1 -- 172.21.15.118:0/2946361561 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1244009420 con 0x7f12500c0af0 2023-09-28T04:23:47.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.348+0000 7f124ed9d700 1 --2- 172.21.15.118:0/2946361561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12500bef80 0x7f1250067cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:47.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.348+0000 7f124e59c700 1 --2- 172.21.15.118:0/2946361561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12500c0af0 0x7f12500c2f90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f12500c45b0 tx=0x7f1244017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:47.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.349+0000 7f1236ffd700 1 -- 172.21.15.118:0/2946361561 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124401f070 con 0x7f12500c0af0 2023-09-28T04:23:47.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.349+0000 7f1236ffd700 1 -- 172.21.15.118:0/2946361561 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1244002f70 con 0x7f12500c0af0 2023-09-28T04:23:47.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.349+0000 7f1236ffd700 1 -- 172.21.15.118:0/2946361561 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400b910 con 0x7f12500c0af0 2023-09-28T04:23:47.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.349+0000 7f12551ff700 1 -- 172.21.15.118:0/2946361561 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12500c1220 con 0x7f12500c0af0 2023-09-28T04:23:47.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.349+0000 7f12551ff700 1 -- 172.21.15.118:0/2946361561 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12500c2010 con 0x7f12500c0af0 2023-09-28T04:23:47.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.350+0000 7f12551ff700 1 -- 172.21.15.118:0/2946361561 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12500c2200 con 0x7f12500c0af0 2023-09-28T04:23:47.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.351+0000 7f1236ffd700 1 -- 172.21.15.118:0/2946361561 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1244023070 con 0x7f12500c0af0 2023-09-28T04:23:47.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.352+0000 7f1236ffd700 1 --2- 172.21.15.118:0/2946361561 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f123c067330 0x7f123c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.352+0000 7f1236ffd700 1 -- 172.21.15.118:0/2946361561 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1244085db0 con 0x7f12500c0af0 2023-09-28T04:23:47.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.352+0000 7f1236ffd700 1 --2- 172.21.15.118:0/2946361561 >> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] conn(0x7f123c06fbe0 0x7f123c071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.352+0000 7f124ed9d700 1 --2- 172.21.15.118:0/2946361561 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f123c067330 0x7f123c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.352+0000 7f1236ffd700 1 -- 172.21.15.118:0/2946361561 --> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f123c0726a0 con 0x7f123c06fbe0 2023-09-28T04:23:47.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.352+0000 7f1236ffd700 1 -- 172.21.15.118:0/2946361561 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1244088310 con 0x7f12500c0af0 2023-09-28T04:23:47.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.352+0000 7f124f59e700 1 --2- 172.21.15.118:0/2946361561 >> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] conn(0x7f123c06fbe0 0x7f123c071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.353+0000 7f124ed9d700 1 --2- 172.21.15.118:0/2946361561 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f123c067330 0x7f123c0697e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1240004830 tx=0x7f1240007dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:47.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.353+0000 7f124f59e700 1 --2- 172.21.15.118:0/2946361561 >> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] conn(0x7f123c06fbe0 0x7f123c071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:47.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.353+0000 7f1236ffd700 1 -- 172.21.15.118:0/2946361561 <== osd.3 v2:172.21.15.118:6800/114258 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f123c0726a0 con 0x7f123c06fbe0 2023-09-28T04:23:47.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.368+0000 7f12551ff700 1 -- 172.21.15.118:0/2946361561 --> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1250071980 con 0x7f123c06fbe0 2023-09-28T04:23:47.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.368+0000 7f1236ffd700 1 -- 172.21.15.118:0/2946361561 <== osd.3 v2:172.21.15.118:6800/114258 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1250071980 con 0x7f123c06fbe0 2023-09-28T04:23:47.369 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-09-28T04:23:47.369 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T04:23:47.369 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-09-28T04:23:47.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.368+0000 7f12551ff700 1 -- 172.21.15.118:0/2946361561 >> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] conn(0x7f123c06fbe0 msgr2=0x7f123c071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.368+0000 7f12551ff700 1 --2- 172.21.15.118:0/2946361561 >> [v2:172.21.15.118:6800/114258,v1:172.21.15.118:6801/114258] conn(0x7f123c06fbe0 0x7f123c071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.368+0000 7f12551ff700 1 -- 172.21.15.118:0/2946361561 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f123c067330 msgr2=0x7f123c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.368+0000 7f12551ff700 1 --2- 172.21.15.118:0/2946361561 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f123c067330 0x7f123c0697e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1240004830 tx=0x7f1240007dc0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.368+0000 7f12551ff700 1 -- 172.21.15.118:0/2946361561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12500c0af0 msgr2=0x7f12500c2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.368+0000 7f12551ff700 1 --2- 172.21.15.118:0/2946361561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12500c0af0 0x7f12500c2f90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f12500c45b0 tx=0x7f1244017000 comp rx=0 tx=0).stop 2023-09-28T04:23:47.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.368+0000 7f124f59e700 1 -- 172.21.15.118:0/2946361561 reap_dead start 2023-09-28T04:23:47.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.368+0000 7f12551ff700 1 -- 172.21.15.118:0/2946361561 shutdown_connections 2023-09-28T04:23:47.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.368+0000 7f12551ff700 1 -- 172.21.15.118:0/2946361561 >> 172.21.15.118:0/2946361561 conn(0x7f12500c7ba0 msgr2=0x7f125006dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:47.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.369+0000 7f12551ff700 1 -- 172.21.15.118:0/2946361561 shutdown_connections 2023-09-28T04:23:47.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.369+0000 7f12551ff700 1 -- 172.21.15.118:0/2946361561 wait complete. 2023-09-28T04:23:47.385 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-09-28T04:23:47.574 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.574+0000 7f227cbff700 1 Processor -- start 2023-09-28T04:23:47.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.574+0000 7f227cbff700 1 -- start start 2023-09-28T04:23:47.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.575+0000 7f227cbff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f227814fa90 0x7f2278156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.575+0000 7f227cbff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22780c84c0 0x7f2278068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.575+0000 7f227cbff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22780c8030 con 0x7f227814fe60 2023-09-28T04:23:47.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.575+0000 7f227cbff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22780c7180 con 0x7f22780c84c0 2023-09-28T04:23:47.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.575+0000 7f227cbff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22780c7420 con 0x7f227814fa90 2023-09-28T04:23:47.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.576+0000 7f227659c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f227814fa90 0x7f2278156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.576+0000 7f2276d9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22780c84c0 0x7f2278068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.576+0000 7f227659c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f227814fa90 0x7f2278156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:34728/0 (socket says 172.21.15.118:34728) 2023-09-28T04:23:47.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.576+0000 7f227659c700 1 -- 172.21.15.118:0/977506070 learned_addr learned my addr 172.21.15.118:0/977506070 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:47.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.576+0000 7f227659c700 1 -- 172.21.15.118:0/977506070 >> v2:172.21.15.174:3300/0 conn(0x7f22780c84c0 msgr2=0x7f2278068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:47.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.576+0000 7f227659c700 1 --2- 172.21.15.118:0/977506070 >> v2:172.21.15.174:3300/0 conn(0x7f22780c84c0 0x7f2278068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.576+0000 7f227559a700 1 -- 172.21.15.118:0/977506070 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761584808 0 0) 0x7f22780c8030 con 0x7f227814fe60 2023-09-28T04:23:47.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.576+0000 7f227659c700 1 -- 172.21.15.118:0/977506070 >> v1:172.21.15.174:6789/0 conn(0x7f227814fe60 legacy=0x7f22780cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.576+0000 7f227659c700 1 -- 172.21.15.118:0/977506070 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780c7700 con 0x7f227814fa90 2023-09-28T04:23:47.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.576+0000 7f227659c700 1 --2- 172.21.15.118:0/977506070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f227814fa90 0x7f2278156430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22680099b0 tx=0x7f2268009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=759cade12c4875d server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:47.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.577+0000 7f227559a700 1 -- 172.21.15.118:0/977506070 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268009ea0 con 0x7f227814fa90 2023-09-28T04:23:47.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.577+0000 7f227559a700 1 -- 172.21.15.118:0/977506070 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226800b860 con 0x7f227814fa90 2023-09-28T04:23:47.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.577+0000 7f227559a700 1 -- 172.21.15.118:0/977506070 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226800bc00 con 0x7f227814fa90 2023-09-28T04:23:47.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.577+0000 7f227cbff700 1 -- 172.21.15.118:0/977506070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f227814fa90 msgr2=0x7f2278156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.577+0000 7f227cbff700 1 --2- 172.21.15.118:0/977506070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f227814fa90 0x7f2278156430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22680099b0 tx=0x7f2268009250 comp rx=0 tx=0).stop 2023-09-28T04:23:47.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.577+0000 7f227cbff700 1 -- 172.21.15.118:0/977506070 shutdown_connections 2023-09-28T04:23:47.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.577+0000 7f227cbff700 1 --2- 172.21.15.118:0/977506070 >> v2:172.21.15.174:3300/0 conn(0x7f22780c84c0 0x7f2278068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.577+0000 7f227cbff700 1 --2- 172.21.15.118:0/977506070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f227814fa90 0x7f2278156430 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.577+0000 7f227cbff700 1 -- 172.21.15.118:0/977506070 >> 172.21.15.118:0/977506070 conn(0x7f2278063cd0 msgr2=0x7f22780cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:47.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.577+0000 7f227cbff700 1 -- 172.21.15.118:0/977506070 shutdown_connections 2023-09-28T04:23:47.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.577+0000 7f227cbff700 1 -- 172.21.15.118:0/977506070 wait complete. 2023-09-28T04:23:47.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.579+0000 7f227cbff700 1 Processor -- start 2023-09-28T04:23:47.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.580+0000 7f227cbff700 1 -- start start 2023-09-28T04:23:47.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.581+0000 7f227cbff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22780c84c0 0x7f22780b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.581+0000 7f227cbff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f227814fa90 0x7f22780b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.581+0000 7f227cbff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f227814fe60 0x7f22780af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.581+0000 7f227cbff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22780b0860 con 0x7f22780c84c0 2023-09-28T04:23:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.581+0000 7f227cbff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22780c5eb0 con 0x7f227814fe60 2023-09-28T04:23:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.581+0000 7f227cbff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22780c4fe0 con 0x7f227814fa90 2023-09-28T04:23:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.581+0000 7f227659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22780c84c0 0x7f22780b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.581+0000 7f227659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22780c84c0 0x7f22780b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54684/0 (socket says 172.21.15.118:54684) 2023-09-28T04:23:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.581+0000 7f227659c700 1 -- 172.21.15.118:0/3036321727 learned_addr learned my addr 172.21.15.118:0/3036321727 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.581+0000 7f2276d9d700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f227814fe60 0x7f22780af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.581+0000 7f2275d9b700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f227814fa90 0x7f22780b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.582+0000 7f2276d9d700 1 -- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f227814fa90 msgr2=0x7f22780b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.582+0000 7f2276d9d700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f227814fa90 0x7f22780b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.582+0000 7f2276d9d700 1 -- 172.21.15.118:0/3036321727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22780c84c0 msgr2=0x7f22780b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.582+0000 7f2276d9d700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22780c84c0 0x7f22780b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.582+0000 7f2276d9d700 1 -- 172.21.15.118:0/3036321727 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22680094f0 con 0x7f227814fe60 2023-09-28T04:23:47.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.582+0000 7f2275d9b700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f227814fa90 0x7f22780b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:47.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.582+0000 7f227659c700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22780c84c0 0x7f22780b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:47.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.582+0000 7f2276d9d700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f227814fe60 0x7f22780af010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f227000ecf0 tx=0x7f227000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:47.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.582+0000 7f22667fc700 1 -- 172.21.15.118:0/3036321727 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227000c8f0 con 0x7f227814fe60 2023-09-28T04:23:47.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.582+0000 7f22667fc700 1 -- 172.21.15.118:0/3036321727 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227000f040 con 0x7f227814fe60 2023-09-28T04:23:47.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.582+0000 7f227cbff700 1 -- 172.21.15.118:0/3036321727 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22780c52a0 con 0x7f227814fe60 2023-09-28T04:23:47.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.582+0000 7f22667fc700 1 -- 172.21.15.118:0/3036321727 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227000ccc0 con 0x7f227814fe60 2023-09-28T04:23:47.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.582+0000 7f227cbff700 1 -- 172.21.15.118:0/3036321727 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22780c5860 con 0x7f227814fe60 2023-09-28T04:23:47.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.583+0000 7f227cbff700 1 -- 172.21.15.118:0/3036321727 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22780aed30 con 0x7f227814fe60 2023-09-28T04:23:47.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.584+0000 7f22667fc700 1 -- 172.21.15.118:0/3036321727 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2270014690 con 0x7f227814fe60 2023-09-28T04:23:47.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.585+0000 7f22667fc700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2258067360 0x7f2258069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.585+0000 7f22667fc700 1 -- 172.21.15.118:0/3036321727 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f22700855f0 con 0x7f227814fe60 2023-09-28T04:23:47.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.586+0000 7f227659c700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2258067360 0x7f2258069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.586+0000 7f227659c700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2258067360 0x7f2258069810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f226800c010 tx=0x7f2268017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:47.590 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.590+0000 7f22667fc700 1 -- 172.21.15.118:0/3036321727 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2270052450 con 0x7f227814fe60 2023-09-28T04:23:47.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.780+0000 7f227cbff700 1 -- 172.21.15.118:0/3036321727 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2278070fe0 con 0x7f2258067360 2023-09-28T04:23:47.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.781+0000 7f22667fc700 1 -- 172.21.15.118:0/3036321727 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2278070fe0 con 0x7f2258067360 2023-09-28T04:23:47.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.783+0000 7f227cbff700 1 -- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2258067360 msgr2=0x7f2258069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.783+0000 7f227cbff700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2258067360 0x7f2258069810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f226800c010 tx=0x7f2268017000 comp rx=0 tx=0).stop 2023-09-28T04:23:47.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.783+0000 7f227cbff700 1 -- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f227814fe60 msgr2=0x7f22780af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.783+0000 7f227cbff700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f227814fe60 0x7f22780af010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f227000ecf0 tx=0x7f227000b040 comp rx=0 tx=0).stop 2023-09-28T04:23:47.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.783+0000 7f227cbff700 1 -- 172.21.15.118:0/3036321727 shutdown_connections 2023-09-28T04:23:47.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.783+0000 7f227cbff700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f2258067360 0x7f2258069810 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.783+0000 7f227cbff700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f227814fe60 0x7f22780af010 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.783+0000 7f227cbff700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22780c84c0 0x7f22780b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.783+0000 7f227cbff700 1 --2- 172.21.15.118:0/3036321727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f227814fa90 0x7f22780b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.783+0000 7f227cbff700 1 -- 172.21.15.118:0/3036321727 >> 172.21.15.118:0/3036321727 conn(0x7f2278063cd0 msgr2=0x7f227814c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:47.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.783+0000 7f227cbff700 1 -- 172.21.15.118:0/3036321727 shutdown_connections 2023-09-28T04:23:47.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.783+0000 7f227cbff700 1 -- 172.21.15.118:0/3036321727 wait complete. 2023-09-28T04:23:47.786 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 3 to deep-scrub 2023-09-28T04:23:47.801 INFO:tasks.ceph:Scrubbing osd.4 2023-09-28T04:23:47.801 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-09-28T04:23:47.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.994+0000 7fec8dfff700 1 Processor -- start 2023-09-28T04:23:47.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.994+0000 7fec8dfff700 1 -- start start 2023-09-28T04:23:47.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.995+0000 7fec8dfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec8806c4a0 0x7fec88156450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.995+0000 7fec8dfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fec8806c870 0x7fec880c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:47.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.995+0000 7fec8dfff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec880bb610 con 0x7fec880c3430 2023-09-28T04:23:47.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.995+0000 7fec8dfff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec880c5570 con 0x7fec8806c870 2023-09-28T04:23:47.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.995+0000 7fec8dfff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec880c5b30 con 0x7fec8806c4a0 2023-09-28T04:23:47.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.996+0000 7fec86ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fec8806c870 0x7fec880c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.996+0000 7fec86ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fec8806c870 0x7fec880c2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58732/0 (socket says 172.21.15.118:58732) 2023-09-28T04:23:47.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.996+0000 7fec86ffd700 1 -- 172.21.15.118:0/3362094818 learned_addr learned my addr 172.21.15.118:0/3362094818 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:47.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.996+0000 7fec87fff700 1 --1- 172.21.15.118:0/3362094818 >> v1:172.21.15.118:6789/0 conn(0x7fec880c3430 0x7fec88152cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:40790/0 (socket says 172.21.15.118:40790) 2023-09-28T04:23:47.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.996+0000 7fec877fe700 1 --2- 172.21.15.118:0/3362094818 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec8806c4a0 0x7fec88156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:47.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.996+0000 7fec86ffd700 1 -- 172.21.15.118:0/3362094818 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec8806c4a0 msgr2=0x7fec88156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:47.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.996+0000 7fec86ffd700 1 --2- 172.21.15.118:0/3362094818 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec8806c4a0 0x7fec88156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:47.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.996+0000 7fec86ffd700 1 -- 172.21.15.118:0/3362094818 >> v1:172.21.15.118:6789/0 conn(0x7fec880c3430 legacy=0x7fec88152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:47.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.996+0000 7fec86ffd700 1 -- 172.21.15.118:0/3362094818 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec880c3870 con 0x7fec8806c870 2023-09-28T04:23:47.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.996+0000 7fec877fe700 1 --2- 172.21.15.118:0/3362094818 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec8806c4a0 0x7fec88156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:47.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.996+0000 7fec86ffd700 1 --2- 172.21.15.118:0/3362094818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8806c870 0x7fec880c2ef0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0099b0 tx=0x7fec7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94241df94dfc809 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:47.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.997+0000 7fec867fc700 1 -- 172.21.15.118:0/3362094818 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00b860 con 0x7fec8806c870 2023-09-28T04:23:47.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.997+0000 7fec867fc700 1 -- 172.21.15.118:0/3362094818 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c00b9c0 con 0x7fec8806c870 2023-09-28T04:23:47.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.997+0000 7fec867fc700 1 -- 172.21.15.118:0/3362094818 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00bd60 con 0x7fec8806c870 2023-09-28T04:23:48.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.997+0000 7fec8dfff700 1 -- 172.21.15.118:0/3362094818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8806c870 msgr2=0x7fec880c2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.997+0000 7fec8dfff700 1 --2- 172.21.15.118:0/3362094818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8806c870 0x7fec880c2ef0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0099b0 tx=0x7fec7c009250 comp rx=0 tx=0).stop 2023-09-28T04:23:48.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.997+0000 7fec8dfff700 1 -- 172.21.15.118:0/3362094818 shutdown_connections 2023-09-28T04:23:48.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.997+0000 7fec8dfff700 1 --2- 172.21.15.118:0/3362094818 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec8806c4a0 0x7fec88156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.997+0000 7fec8dfff700 1 --2- 172.21.15.118:0/3362094818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8806c870 0x7fec880c2ef0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.997+0000 7fec8dfff700 1 -- 172.21.15.118:0/3362094818 >> 172.21.15.118:0/3362094818 conn(0x7fec880c8ec0 msgr2=0x7fec880c4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.997+0000 7fec8dfff700 1 -- 172.21.15.118:0/3362094818 shutdown_connections 2023-09-28T04:23:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.997+0000 7fec8dfff700 1 -- 172.21.15.118:0/3362094818 wait complete. 2023-09-28T04:23:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.999+0000 7fec8dfff700 1 Processor -- start 2023-09-28T04:23:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:47.999+0000 7fec8dfff700 1 -- start start 2023-09-28T04:23:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec8dfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8806c4a0 0x7fec88166550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec8dfff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec8806c870 0x7fec880be960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec8dfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec880c3430 0x7fec880beea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec8dfff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec88165b40 con 0x7fec8806c4a0 2023-09-28T04:23:48.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec8dfff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec88166a90 con 0x7fec8806c870 2023-09-28T04:23:48.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec8dfff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec881660c0 con 0x7fec880c3430 2023-09-28T04:23:48.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec877fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8806c4a0 0x7fec88166550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec877fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8806c4a0 0x7fec88166550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58736/0 (socket says 172.21.15.118:58736) 2023-09-28T04:23:48.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec877fe700 1 -- 172.21.15.118:0/296090177 learned_addr learned my addr 172.21.15.118:0/296090177 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:48.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec86ffd700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec8806c870 0x7fec880be960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec87fff700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec880c3430 0x7fec880beea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec86ffd700 1 -- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec880c3430 msgr2=0x7fec880beea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec86ffd700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec880c3430 0x7fec880beea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec86ffd700 1 -- 172.21.15.118:0/296090177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8806c4a0 msgr2=0x7fec88166550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec86ffd700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8806c4a0 0x7fec88166550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec86ffd700 1 -- 172.21.15.118:0/296090177 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c0094f0 con 0x7fec8806c870 2023-09-28T04:23:48.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec877fe700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fec8806c4a0 0x7fec88166550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:48.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.000+0000 7fec87fff700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec880c3430 0x7fec880beea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:48.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.001+0000 7fec86ffd700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec8806c870 0x7fec880be960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fec8806e3f0 tx=0x7fec7c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:48.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.001+0000 7fec6f7fe700 1 -- 172.21.15.118:0/296090177 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c011e70 con 0x7fec8806c870 2023-09-28T04:23:48.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.001+0000 7fec6f7fe700 1 -- 172.21.15.118:0/296090177 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c01f070 con 0x7fec8806c870 2023-09-28T04:23:48.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.001+0000 7fec8dfff700 1 -- 172.21.15.118:0/296090177 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec880badb0 con 0x7fec8806c870 2023-09-28T04:23:48.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.001+0000 7fec6f7fe700 1 -- 172.21.15.118:0/296090177 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0266f0 con 0x7fec8806c870 2023-09-28T04:23:48.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.001+0000 7fec8dfff700 1 -- 172.21.15.118:0/296090177 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec88165d50 con 0x7fec8806c870 2023-09-28T04:23:48.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.002+0000 7fec8dfff700 1 -- 172.21.15.118:0/296090177 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec880638a0 con 0x7fec8806c870 2023-09-28T04:23:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.003+0000 7fec6f7fe700 1 -- 172.21.15.118:0/296090177 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fec7c026ae0 con 0x7fec8806c870 2023-09-28T04:23:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.004+0000 7fec6f7fe700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fec74067330 0x7fec740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.004+0000 7fec6f7fe700 1 -- 172.21.15.118:0/296090177 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fec7c021070 con 0x7fec8806c870 2023-09-28T04:23:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.004+0000 7fec877fe700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fec74067330 0x7fec740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.004+0000 7fec6f7fe700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] conn(0x7fec7406fbe0 0x7fec74071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.004+0000 7fec6f7fe700 1 -- 172.21.15.118:0/296090177 --> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec740726a0 con 0x7fec7406fbe0 2023-09-28T04:23:48.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.004+0000 7fec6f7fe700 1 -- 172.21.15.118:0/296090177 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec7c088d10 con 0x7fec8806c870 2023-09-28T04:23:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.004+0000 7fec87fff700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] conn(0x7fec7406fbe0 0x7fec74071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.005+0000 7fec877fe700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fec74067330 0x7fec740697e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec78006dc0 tx=0x7fec78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.005+0000 7fec87fff700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] conn(0x7fec7406fbe0 0x7fec74071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:48.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.006+0000 7fec6f7fe700 1 -- 172.21.15.118:0/296090177 <== osd.4 v2:172.21.15.174:6800/119880 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fec740726a0 con 0x7fec7406fbe0 2023-09-28T04:23:48.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.019+0000 7fec8dfff700 1 -- 172.21.15.118:0/296090177 --> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fec88071980 con 0x7fec7406fbe0 2023-09-28T04:23:48.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.020+0000 7fec6f7fe700 1 -- 172.21.15.118:0/296090177 <== osd.4 v2:172.21.15.174:6800/119880 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fec88071980 con 0x7fec7406fbe0 2023-09-28T04:23:48.021 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-09-28T04:23:48.021 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T04:23:48.021 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-09-28T04:23:48.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.020+0000 7fec8dfff700 1 -- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] conn(0x7fec7406fbe0 msgr2=0x7fec74071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.020+0000 7fec8dfff700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:6800/119880,v1:172.21.15.174:6801/119880] conn(0x7fec7406fbe0 0x7fec74071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.020+0000 7fec8dfff700 1 -- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fec74067330 msgr2=0x7fec740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.020+0000 7fec8dfff700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fec74067330 0x7fec740697e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec78006dc0 tx=0x7fec78008040 comp rx=0 tx=0).stop 2023-09-28T04:23:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.020+0000 7fec8dfff700 1 -- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec8806c870 msgr2=0x7fec880be960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.020+0000 7fec8dfff700 1 --2- 172.21.15.118:0/296090177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec8806c870 0x7fec880be960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fec8806e3f0 tx=0x7fec7c017000 comp rx=0 tx=0).stop 2023-09-28T04:23:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.021+0000 7fec87fff700 1 -- 172.21.15.118:0/296090177 reap_dead start 2023-09-28T04:23:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.021+0000 7fec8dfff700 1 -- 172.21.15.118:0/296090177 shutdown_connections 2023-09-28T04:23:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.021+0000 7fec8dfff700 1 -- 172.21.15.118:0/296090177 >> 172.21.15.118:0/296090177 conn(0x7fec880c8ec0 msgr2=0x7fec88152210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.021+0000 7fec8dfff700 1 -- 172.21.15.118:0/296090177 shutdown_connections 2023-09-28T04:23:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.021+0000 7fec8dfff700 1 -- 172.21.15.118:0/296090177 wait complete. 2023-09-28T04:23:48.037 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-09-28T04:23:48.227 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.226+0000 7fb5659ff700 1 Processor -- start 2023-09-28T04:23:48.227 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.226+0000 7fb5659ff700 1 -- start start 2023-09-28T04:23:48.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.227+0000 7fb5659ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb56014fa90 0x7fb560156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.227+0000 7fb5659ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5600c8030 con 0x7fb56014fe60 2023-09-28T04:23:48.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.227+0000 7fb5659ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5600c7180 con 0x7fb5600c84c0 2023-09-28T04:23:48.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.227+0000 7fb5659ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5600c7420 con 0x7fb56014fa90 2023-09-28T04:23:48.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.228+0000 7fb55effd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb56014fa90 0x7fb560156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.228+0000 7fb55e7fc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb56014fe60 0x7fb5600cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:40800/0 (socket says 172.21.15.118:40800) 2023-09-28T04:23:48.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.228+0000 7fb55e7fc700 1 -- 172.21.15.118:0/2199417941 learned_addr learned my addr 172.21.15.118:0/2199417941 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:48.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.228+0000 7fb55effd700 1 -- 172.21.15.118:0/2199417941 >> v1:172.21.15.174:6789/0 conn(0x7fb5600c84c0 legacy=0x7fb5600adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.228+0000 7fb55effd700 1 -- 172.21.15.118:0/2199417941 >> v1:172.21.15.118:6789/0 conn(0x7fb56014fe60 legacy=0x7fb5600cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.228+0000 7fb55effd700 1 -- 172.21.15.118:0/2199417941 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5600c7700 con 0x7fb56014fa90 2023-09-28T04:23:48.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.228+0000 7fb55dffb700 1 -- 172.21.15.118:0/2199417941 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098092104 0 0) 0x7fb5600c8030 con 0x7fb56014fe60 2023-09-28T04:23:48.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.228+0000 7fb55effd700 1 --2- 172.21.15.118:0/2199417941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb56014fa90 0x7fb560156430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb5500098e0 tx=0x7fb5500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133852a1e0911e32 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:48.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.229+0000 7fb55dffb700 1 -- 172.21.15.118:0/2199417941 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550009e80 con 0x7fb56014fa90 2023-09-28T04:23:48.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.229+0000 7fb55dffb700 1 -- 172.21.15.118:0/2199417941 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55000b860 con 0x7fb56014fa90 2023-09-28T04:23:48.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.229+0000 7fb55dffb700 1 -- 172.21.15.118:0/2199417941 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000bbe0 con 0x7fb56014fa90 2023-09-28T04:23:48.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.229+0000 7fb5659ff700 1 -- 172.21.15.118:0/2199417941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb56014fa90 msgr2=0x7fb560156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.229+0000 7fb5659ff700 1 --2- 172.21.15.118:0/2199417941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb56014fa90 0x7fb560156430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb5500098e0 tx=0x7fb5500091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.229+0000 7fb5659ff700 1 -- 172.21.15.118:0/2199417941 shutdown_connections 2023-09-28T04:23:48.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.229+0000 7fb5659ff700 1 --2- 172.21.15.118:0/2199417941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb56014fa90 0x7fb560156430 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.229+0000 7fb5659ff700 1 -- 172.21.15.118:0/2199417941 >> 172.21.15.118:0/2199417941 conn(0x7fb560063cd0 msgr2=0x7fb5600cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:48.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.229+0000 7fb5659ff700 1 -- 172.21.15.118:0/2199417941 shutdown_connections 2023-09-28T04:23:48.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.229+0000 7fb5659ff700 1 -- 172.21.15.118:0/2199417941 wait complete. 2023-09-28T04:23:48.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.231+0000 7fb5659ff700 1 Processor -- start 2023-09-28T04:23:48.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.232+0000 7fb5659ff700 1 -- start start 2023-09-28T04:23:48.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb5659ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5600c84c0 0x7fb5601552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb5659ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb56014fa90 0x7fb5600c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb5659ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb56014fe60 0x7fb5600c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb5659ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600af250 con 0x7fb56014fa90 2023-09-28T04:23:48.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb5659ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600c3f20 con 0x7fb5600c84c0 2023-09-28T04:23:48.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb5659ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56014cd10 con 0x7fb56014fe60 2023-09-28T04:23:48.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb55e7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb56014fa90 0x7fb5600c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb55e7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb56014fa90 0x7fb5600c4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58756/0 (socket says 172.21.15.118:58756) 2023-09-28T04:23:48.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb55effd700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5600c84c0 0x7fb5601552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb55e7fc700 1 -- 172.21.15.118:0/4141251054 learned_addr learned my addr 172.21.15.118:0/4141251054 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:48.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb55f7fe700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb56014fe60 0x7fb5600c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb55e7fc700 1 -- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb56014fe60 msgr2=0x7fb5600c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb55e7fc700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb56014fe60 0x7fb5600c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb55e7fc700 1 -- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5600c84c0 msgr2=0x7fb5601552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb55e7fc700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5600c84c0 0x7fb5601552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.233+0000 7fb55e7fc700 1 -- 172.21.15.118:0/4141251054 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550009420 con 0x7fb56014fa90 2023-09-28T04:23:48.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.234+0000 7fb55e7fc700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb56014fa90 0x7fb5600c4840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb55400c560 tx=0x7fb554007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:48.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.234+0000 7fb546ffd700 1 -- 172.21.15.118:0/4141251054 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554005b30 con 0x7fb56014fa90 2023-09-28T04:23:48.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.234+0000 7fb546ffd700 1 -- 172.21.15.118:0/4141251054 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554005c90 con 0x7fb56014fa90 2023-09-28T04:23:48.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.234+0000 7fb5659ff700 1 -- 172.21.15.118:0/4141251054 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb560155d90 con 0x7fb56014fa90 2023-09-28T04:23:48.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.234+0000 7fb546ffd700 1 -- 172.21.15.118:0/4141251054 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554007320 con 0x7fb56014fa90 2023-09-28T04:23:48.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.234+0000 7fb5659ff700 1 -- 172.21.15.118:0/4141251054 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb560166370 con 0x7fb56014fa90 2023-09-28T04:23:48.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.236+0000 7fb5659ff700 1 -- 172.21.15.118:0/4141251054 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb560089a70 con 0x7fb56014fa90 2023-09-28T04:23:48.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.236+0000 7fb546ffd700 1 -- 172.21.15.118:0/4141251054 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb55401b3b0 con 0x7fb56014fa90 2023-09-28T04:23:48.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.237+0000 7fb546ffd700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb54c067330 0x7fb54c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.237+0000 7fb546ffd700 1 -- 172.21.15.118:0/4141251054 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb554083f00 con 0x7fb56014fa90 2023-09-28T04:23:48.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.237+0000 7fb55effd700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb54c067330 0x7fb54c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.238+0000 7fb55effd700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb54c067330 0x7fb54c0697e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb5500093f0 tx=0x7fb550017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:48.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.241+0000 7fb546ffd700 1 -- 172.21.15.118:0/4141251054 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb554050d60 con 0x7fb56014fa90 2023-09-28T04:23:48.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.431+0000 7fb5659ff700 1 -- 172.21.15.118:0/4141251054 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb560089c70 con 0x7fb54c067330 2023-09-28T04:23:48.432 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.432+0000 7fb546ffd700 1 -- 172.21.15.118:0/4141251054 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb560089c70 con 0x7fb54c067330 2023-09-28T04:23:48.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.434+0000 7fb5659ff700 1 -- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb54c067330 msgr2=0x7fb54c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.434+0000 7fb5659ff700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb54c067330 0x7fb54c0697e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb5500093f0 tx=0x7fb550017000 comp rx=0 tx=0).stop 2023-09-28T04:23:48.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.434+0000 7fb5659ff700 1 -- 172.21.15.118:0/4141251054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb56014fa90 msgr2=0x7fb5600c4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.434+0000 7fb5659ff700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb56014fa90 0x7fb5600c4840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb55400c560 tx=0x7fb554007f90 comp rx=0 tx=0).stop 2023-09-28T04:23:48.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.434+0000 7fb5659ff700 1 -- 172.21.15.118:0/4141251054 shutdown_connections 2023-09-28T04:23:48.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.434+0000 7fb5659ff700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb54c067330 0x7fb54c0697e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.434+0000 7fb5659ff700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb56014fe60 0x7fb5600c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.434+0000 7fb5659ff700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5600c84c0 0x7fb5601552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.434+0000 7fb5659ff700 1 --2- 172.21.15.118:0/4141251054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb56014fa90 0x7fb5600c4840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.434+0000 7fb5659ff700 1 -- 172.21.15.118:0/4141251054 >> 172.21.15.118:0/4141251054 conn(0x7fb560063cd0 msgr2=0x7fb56014a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:48.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.434+0000 7fb5659ff700 1 -- 172.21.15.118:0/4141251054 shutdown_connections 2023-09-28T04:23:48.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.434+0000 7fb5659ff700 1 -- 172.21.15.118:0/4141251054 wait complete. 2023-09-28T04:23:48.437 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 4 to deep-scrub 2023-09-28T04:23:48.452 INFO:tasks.ceph:Scrubbing osd.5 2023-09-28T04:23:48.452 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-09-28T04:23:48.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.643+0000 7f3a515ff700 1 Processor -- start 2023-09-28T04:23:48.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.643+0000 7f3a515ff700 1 -- start start 2023-09-28T04:23:48.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.644+0000 7f3a515ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a4c0ac130 0x7f3a4c069150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.644+0000 7f3a515ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4c069b10 con 0x7f3a4c0abd60 2023-09-28T04:23:48.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.644+0000 7f3a515ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4c155a10 con 0x7f3a4c069690 2023-09-28T04:23:48.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.644+0000 7f3a515ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c14ff20 con 0x7f3a4c0ac130 2023-09-28T04:23:48.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.645+0000 7f3a4affd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f3a4c0abd60 0x7f3a4c0c7380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:40814/0 (socket says 172.21.15.118:40814) 2023-09-28T04:23:48.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.645+0000 7f3a4affd700 1 -- 172.21.15.118:0/1019470436 learned_addr learned my addr 172.21.15.118:0/1019470436 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:48.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.645+0000 7f3a4a7fc700 1 --2- 172.21.15.118:0/1019470436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a4c0ac130 0x7f3a4c069150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.645+0000 7f3a49ffb700 1 -- 172.21.15.118:0/1019470436 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455556457 0 0) 0x7f3a4c069b10 con 0x7f3a4c0abd60 2023-09-28T04:23:48.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.645+0000 7f3a49ffb700 1 -- 172.21.15.118:0/1019470436 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a34003570 con 0x7f3a4c0abd60 2023-09-28T04:23:48.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.645+0000 7f3a49ffb700 1 -- 172.21.15.118:0/1019470436 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916300867 0 0) 0x7f3a4c155a10 con 0x7f3a4c069690 2023-09-28T04:23:48.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.645+0000 7f3a49ffb700 1 -- 172.21.15.118:0/1019470436 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a4c069b10 con 0x7f3a4c069690 2023-09-28T04:23:48.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.645+0000 7f3a4a7fc700 1 -- 172.21.15.118:0/1019470436 >> v1:172.21.15.174:6789/0 conn(0x7f3a4c069690 legacy=0x7f3a4c0ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.645+0000 7f3a4a7fc700 1 -- 172.21.15.118:0/1019470436 >> v1:172.21.15.118:6789/0 conn(0x7f3a4c0abd60 legacy=0x7f3a4c0c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.645+0000 7f3a4a7fc700 1 -- 172.21.15.118:0/1019470436 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c155cf0 con 0x7f3a4c0ac130 2023-09-28T04:23:48.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.645+0000 7f3a4a7fc700 1 --2- 172.21.15.118:0/1019470436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a4c0ac130 0x7f3a4c069150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009910 tx=0x7f3a400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4a6d07674e79bd6 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:48.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.646+0000 7f3a49ffb700 1 -- 172.21.15.118:0/1019470436 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a40011630 con 0x7f3a4c0ac130 2023-09-28T04:23:48.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.646+0000 7f3a49ffb700 1 -- 172.21.15.118:0/1019470436 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a40011790 con 0x7f3a4c0ac130 2023-09-28T04:23:48.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.646+0000 7f3a49ffb700 1 -- 172.21.15.118:0/1019470436 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a40011b30 con 0x7f3a4c0ac130 2023-09-28T04:23:48.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.646+0000 7f3a515ff700 1 -- 172.21.15.118:0/1019470436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a4c0ac130 msgr2=0x7f3a4c069150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.646+0000 7f3a515ff700 1 --2- 172.21.15.118:0/1019470436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a4c0ac130 0x7f3a4c069150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009910 tx=0x7f3a400091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.646+0000 7f3a515ff700 1 -- 172.21.15.118:0/1019470436 shutdown_connections 2023-09-28T04:23:48.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.646+0000 7f3a515ff700 1 --2- 172.21.15.118:0/1019470436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a4c0ac130 0x7f3a4c069150 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.646+0000 7f3a515ff700 1 -- 172.21.15.118:0/1019470436 >> 172.21.15.118:0/1019470436 conn(0x7f3a4c063230 msgr2=0x7f3a4c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:48.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.646+0000 7f3a515ff700 1 -- 172.21.15.118:0/1019470436 shutdown_connections 2023-09-28T04:23:48.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.647+0000 7f3a515ff700 1 -- 172.21.15.118:0/1019470436 wait complete. 2023-09-28T04:23:48.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.648+0000 7f3a515ff700 1 Processor -- start 2023-09-28T04:23:48.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.648+0000 7f3a515ff700 1 -- start start 2023-09-28T04:23:48.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.649+0000 7f3a515ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a4c069690 0x7f3a4c169200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.649+0000 7f3a515ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a4c0abd60 0x7f3a4c14d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.649+0000 7f3a515ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a4c0ac130 0x7f3a4c14df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.649+0000 7f3a515ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c150130 con 0x7f3a4c0ac130 2023-09-28T04:23:48.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.649+0000 7f3a515ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0b1470 con 0x7f3a4c069690 2023-09-28T04:23:48.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.649+0000 7f3a515ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c168d70 con 0x7f3a4c0abd60 2023-09-28T04:23:48.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.649+0000 7f3a4b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a4c0ac130 0x7f3a4c14df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.649+0000 7f3a4affd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a4c069690 0x7f3a4c169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.649+0000 7f3a4b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a4c0ac130 0x7f3a4c14df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58760/0 (socket says 172.21.15.118:58760) 2023-09-28T04:23:48.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.649+0000 7f3a4b7fe700 1 -- 172.21.15.118:0/3090705313 learned_addr learned my addr 172.21.15.118:0/3090705313 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:48.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.649+0000 7f3a4a7fc700 1 --2- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a4c0abd60 0x7f3a4c14d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.650+0000 7f3a4b7fe700 1 -- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a4c0abd60 msgr2=0x7f3a4c14d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.650+0000 7f3a4b7fe700 1 --2- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3a4c0abd60 0x7f3a4c14d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.650+0000 7f3a4b7fe700 1 -- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a4c069690 msgr2=0x7f3a4c169200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.650+0000 7f3a4b7fe700 1 --2- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3a4c069690 0x7f3a4c169200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.650+0000 7f3a4b7fe700 1 -- 172.21.15.118:0/3090705313 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a40009420 con 0x7f3a4c0ac130 2023-09-28T04:23:48.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.650+0000 7f3a4b7fe700 1 --2- 172.21.15.118:0/3090705313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a4c0ac130 0x7f3a4c14df90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400c940 tx=0x7f3a440027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:48.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.650+0000 7f3a32ffd700 1 -- 172.21.15.118:0/3090705313 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44012630 con 0x7f3a4c0ac130 2023-09-28T04:23:48.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.650+0000 7f3a32ffd700 1 -- 172.21.15.118:0/3090705313 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a440127b0 con 0x7f3a4c0ac130 2023-09-28T04:23:48.655 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.650+0000 7f3a32ffd700 1 -- 172.21.15.118:0/3090705313 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44012b70 con 0x7f3a4c0ac130 2023-09-28T04:23:48.655 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.650+0000 7f3a515ff700 1 -- 172.21.15.118:0/3090705313 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c169740 con 0x7f3a4c0ac130 2023-09-28T04:23:48.655 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.650+0000 7f3a515ff700 1 -- 172.21.15.118:0/3090705313 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c0b1ba0 con 0x7f3a4c0ac130 2023-09-28T04:23:48.655 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.651+0000 7f3a515ff700 1 -- 172.21.15.118:0/3090705313 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a4c0b11d0 con 0x7f3a4c0ac130 2023-09-28T04:23:48.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.652+0000 7f3a32ffd700 1 -- 172.21.15.118:0/3090705313 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3a4401b400 con 0x7f3a4c0ac130 2023-09-28T04:23:48.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.653+0000 7f3a32ffd700 1 --2- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3a38067360 0x7f3a38069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.653+0000 7f3a32ffd700 1 -- 172.21.15.118:0/3090705313 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3a44084f30 con 0x7f3a4c0ac130 2023-09-28T04:23:48.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.653+0000 7f3a32ffd700 1 --2- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] conn(0x7f3a3806fc10 0x7f3a38072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.653+0000 7f3a32ffd700 1 -- 172.21.15.118:0/3090705313 --> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a380726d0 con 0x7f3a3806fc10 2023-09-28T04:23:48.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.653+0000 7f3a32ffd700 1 -- 172.21.15.118:0/3090705313 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a44087490 con 0x7f3a4c0ac130 2023-09-28T04:23:48.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.653+0000 7f3a4affd700 1 --2- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3a38067360 0x7f3a38069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.654+0000 7f3a4a7fc700 1 --2- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] conn(0x7f3a3806fc10 0x7f3a38072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.654+0000 7f3a4affd700 1 --2- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3a38067360 0x7f3a38069810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c007fd0 tx=0x7f3a3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:48.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.654+0000 7f3a4a7fc700 1 --2- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] conn(0x7f3a3806fc10 0x7f3a38072020 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:48.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.655+0000 7f3a32ffd700 1 -- 172.21.15.118:0/3090705313 <== osd.5 v2:172.21.15.174:6817/119908 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3a380726d0 con 0x7f3a3806fc10 2023-09-28T04:23:48.669 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.669+0000 7f3a515ff700 1 -- 172.21.15.118:0/3090705313 --> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3a4c071980 con 0x7f3a3806fc10 2023-09-28T04:23:48.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.669+0000 7f3a32ffd700 1 -- 172.21.15.118:0/3090705313 <== osd.5 v2:172.21.15.174:6817/119908 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3a4c071980 con 0x7f3a3806fc10 2023-09-28T04:23:48.670 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-09-28T04:23:48.670 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T04:23:48.670 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-09-28T04:23:48.671 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.670+0000 7f3a515ff700 1 -- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] conn(0x7f3a3806fc10 msgr2=0x7f3a38072020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.670+0000 7f3a515ff700 1 --2- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:6817/119908,v1:172.21.15.174:6819/119908] conn(0x7f3a3806fc10 0x7f3a38072020 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.670+0000 7f3a515ff700 1 -- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3a38067360 msgr2=0x7f3a38069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.670+0000 7f3a515ff700 1 --2- 172.21.15.118:0/3090705313 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f3a38067360 0x7f3a38069810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c007fd0 tx=0x7f3a3c009040 comp rx=0 tx=0).stop 2023-09-28T04:23:48.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.670+0000 7f3a515ff700 1 -- 172.21.15.118:0/3090705313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a4c0ac130 msgr2=0x7f3a4c14df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.670+0000 7f3a515ff700 1 --2- 172.21.15.118:0/3090705313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a4c0ac130 0x7f3a4c14df90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400c940 tx=0x7f3a440027a0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.670+0000 7f3a4b7fe700 1 -- 172.21.15.118:0/3090705313 reap_dead start 2023-09-28T04:23:48.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.670+0000 7f3a515ff700 1 -- 172.21.15.118:0/3090705313 shutdown_connections 2023-09-28T04:23:48.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.670+0000 7f3a515ff700 1 -- 172.21.15.118:0/3090705313 >> 172.21.15.118:0/3090705313 conn(0x7f3a4c063230 msgr2=0x7f3a4c14f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:48.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.670+0000 7f3a515ff700 1 -- 172.21.15.118:0/3090705313 shutdown_connections 2023-09-28T04:23:48.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.670+0000 7f3a515ff700 1 -- 172.21.15.118:0/3090705313 wait complete. 2023-09-28T04:23:48.687 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-09-28T04:23:48.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.877+0000 7f7e64bff700 1 Processor -- start 2023-09-28T04:23:48.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.877+0000 7f7e64bff700 1 -- start start 2023-09-28T04:23:48.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.878+0000 7f7e64bff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7e6014fa90 0x7f7e60156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.878+0000 7f7e64bff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e600c84c0 0x7f7e60068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.878+0000 7f7e64bff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e600c8030 con 0x7f7e6014fe60 2023-09-28T04:23:48.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.878+0000 7f7e64bff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e600c7180 con 0x7f7e6014fa90 2023-09-28T04:23:48.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.878+0000 7f7e64bff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600c7420 con 0x7f7e600c84c0 2023-09-28T04:23:48.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.878+0000 7f7e5e59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7e6014fa90 0x7f7e60156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.878+0000 7f7e5e59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7e6014fa90 0x7f7e60156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58764/0 (socket says 172.21.15.118:58764) 2023-09-28T04:23:48.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.878+0000 7f7e5e59c700 1 -- 172.21.15.118:0/2445883723 learned_addr learned my addr 172.21.15.118:0/2445883723 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:48.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.879+0000 7f7e5ed9d700 1 --2- 172.21.15.118:0/2445883723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e600c84c0 0x7f7e60068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.879+0000 7f7e5e59c700 1 -- 172.21.15.118:0/2445883723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e600c84c0 msgr2=0x7f7e60068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:48.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.879+0000 7f7e5e59c700 1 --2- 172.21.15.118:0/2445883723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e600c84c0 0x7f7e60068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.879+0000 7f7e5e59c700 1 -- 172.21.15.118:0/2445883723 >> v1:172.21.15.118:6789/0 conn(0x7f7e6014fe60 legacy=0x7f7e600cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.879+0000 7f7e5e59c700 1 -- 172.21.15.118:0/2445883723 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e600c7700 con 0x7f7e6014fa90 2023-09-28T04:23:48.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.879+0000 7f7e5d59a700 1 -- 172.21.15.118:0/2445883723 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877530237 0 0) 0x7f7e600c8030 con 0x7f7e6014fe60 2023-09-28T04:23:48.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.879+0000 7f7e5e59c700 1 --2- 172.21.15.118:0/2445883723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e6014fa90 0x7f7e60156430 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7e500099b0 tx=0x7f7e50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fc0352fe8f2150 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:48.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.879+0000 7f7e5d59a700 1 -- 172.21.15.118:0/2445883723 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50009ea0 con 0x7f7e6014fa90 2023-09-28T04:23:48.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.879+0000 7f7e5d59a700 1 -- 172.21.15.118:0/2445883723 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5000b860 con 0x7f7e6014fa90 2023-09-28T04:23:48.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.879+0000 7f7e5d59a700 1 -- 172.21.15.118:0/2445883723 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5000bc00 con 0x7f7e6014fa90 2023-09-28T04:23:48.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.880+0000 7f7e64bff700 1 -- 172.21.15.118:0/2445883723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e6014fa90 msgr2=0x7f7e60156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.880+0000 7f7e64bff700 1 --2- 172.21.15.118:0/2445883723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e6014fa90 0x7f7e60156430 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7e500099b0 tx=0x7f7e50009250 comp rx=0 tx=0).stop 2023-09-28T04:23:48.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.880+0000 7f7e64bff700 1 -- 172.21.15.118:0/2445883723 shutdown_connections 2023-09-28T04:23:48.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.880+0000 7f7e64bff700 1 --2- 172.21.15.118:0/2445883723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e600c84c0 0x7f7e60068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.880+0000 7f7e64bff700 1 --2- 172.21.15.118:0/2445883723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e6014fa90 0x7f7e60156430 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.880+0000 7f7e64bff700 1 -- 172.21.15.118:0/2445883723 >> 172.21.15.118:0/2445883723 conn(0x7f7e60063cd0 msgr2=0x7f7e600cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:48.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.880+0000 7f7e64bff700 1 -- 172.21.15.118:0/2445883723 shutdown_connections 2023-09-28T04:23:48.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.880+0000 7f7e64bff700 1 -- 172.21.15.118:0/2445883723 wait complete. 2023-09-28T04:23:48.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.881+0000 7f7e64bff700 1 Processor -- start 2023-09-28T04:23:48.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.882+0000 7f7e64bff700 1 -- start start 2023-09-28T04:23:48.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.882+0000 7f7e64bff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e600c84c0 0x7f7e60165680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.882+0000 7f7e64bff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e6014fa90 0x7f7e601696d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.882+0000 7f7e64bff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e6014fe60 0x7f7e600c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.882+0000 7f7e64bff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600cbaa0 con 0x7f7e6014fe60 2023-09-28T04:23:48.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.882+0000 7f7e64bff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600ad570 con 0x7f7e6014fa90 2023-09-28T04:23:48.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.882+0000 7f7e64bff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60168c80 con 0x7f7e600c84c0 2023-09-28T04:23:48.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.883+0000 7f7e5ed9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e6014fe60 0x7f7e600c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.883+0000 7f7e5ed9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e6014fe60 0x7f7e600c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58780/0 (socket says 172.21.15.118:58780) 2023-09-28T04:23:48.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.883+0000 7f7e5ed9d700 1 -- 172.21.15.118:0/2651976032 learned_addr learned my addr 172.21.15.118:0/2651976032 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:48.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.883+0000 7f7e5e59c700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e600c84c0 0x7f7e60165680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.883+0000 7f7e5dd9b700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e6014fa90 0x7f7e601696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.883+0000 7f7e5ed9d700 1 -- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e600c84c0 msgr2=0x7f7e60165680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.883+0000 7f7e5ed9d700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e600c84c0 0x7f7e60165680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.883+0000 7f7e5ed9d700 1 -- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e6014fa90 msgr2=0x7f7e601696d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:48.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.883+0000 7f7e5ed9d700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e6014fa90 0x7f7e601696d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:48.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.883+0000 7f7e5ed9d700 1 -- 172.21.15.118:0/2651976032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e500094f0 con 0x7f7e6014fe60 2023-09-28T04:23:48.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.883+0000 7f7e5ed9d700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e6014fe60 0x7f7e600c5b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009df0 tx=0x7f7e5800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:48.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.884+0000 7f7e4e7fc700 1 -- 172.21.15.118:0/2651976032 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5800caa0 con 0x7f7e6014fe60 2023-09-28T04:23:48.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.884+0000 7f7e4e7fc700 1 -- 172.21.15.118:0/2651976032 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5800f040 con 0x7f7e6014fe60 2023-09-28T04:23:48.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.884+0000 7f7e64bff700 1 -- 172.21.15.118:0/2651976032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e60169240 con 0x7f7e6014fe60 2023-09-28T04:23:48.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.884+0000 7f7e4e7fc700 1 -- 172.21.15.118:0/2651976032 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5800ce70 con 0x7f7e6014fe60 2023-09-28T04:23:48.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.884+0000 7f7e64bff700 1 -- 172.21.15.118:0/2651976032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e600b06d0 con 0x7f7e6014fe60 2023-09-28T04:23:48.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.885+0000 7f7e64bff700 1 -- 172.21.15.118:0/2651976032 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e60070fe0 con 0x7f7e6014fe60 2023-09-28T04:23:48.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.886+0000 7f7e4e7fc700 1 -- 172.21.15.118:0/2651976032 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7e58014690 con 0x7f7e6014fe60 2023-09-28T04:23:48.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.887+0000 7f7e4e7fc700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7e40067330 0x7f7e400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:48.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.887+0000 7f7e4e7fc700 1 -- 172.21.15.118:0/2651976032 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7e58085460 con 0x7f7e6014fe60 2023-09-28T04:23:48.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.887+0000 7f7e5e59c700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7e40067330 0x7f7e400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:48.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.888+0000 7f7e5e59c700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7e40067330 0x7f7e400697e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7e500099b0 tx=0x7f7e50017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:48.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:48.892+0000 7f7e4e7fc700 1 -- 172.21.15.118:0/2651976032 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7e60070fe0 con 0x7f7e6014fe60 2023-09-28T04:23:49.086 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.086+0000 7f7e64bff700 1 -- 172.21.15.118:0/2651976032 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e60070fe0 con 0x7f7e40067330 2023-09-28T04:23:49.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.087+0000 7f7e4e7fc700 1 -- 172.21.15.118:0/2651976032 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7e60070fe0 con 0x7f7e40067330 2023-09-28T04:23:49.090 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.089+0000 7f7e64bff700 1 -- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7e40067330 msgr2=0x7f7e400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.090 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.089+0000 7f7e64bff700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7e40067330 0x7f7e400697e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7e500099b0 tx=0x7f7e50017000 comp rx=0 tx=0).stop 2023-09-28T04:23:49.090 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.089+0000 7f7e64bff700 1 -- 172.21.15.118:0/2651976032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e6014fe60 msgr2=0x7f7e600c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.090 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.089+0000 7f7e64bff700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e6014fe60 0x7f7e600c5b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009df0 tx=0x7f7e5800b040 comp rx=0 tx=0).stop 2023-09-28T04:23:49.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.089+0000 7f7e64bff700 1 -- 172.21.15.118:0/2651976032 shutdown_connections 2023-09-28T04:23:49.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.089+0000 7f7e64bff700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f7e40067330 0x7f7e400697e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.089+0000 7f7e64bff700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e6014fe60 0x7f7e600c5b50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.089+0000 7f7e64bff700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e600c84c0 0x7f7e60165680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.089+0000 7f7e64bff700 1 --2- 172.21.15.118:0/2651976032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e6014fa90 0x7f7e601696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.089+0000 7f7e64bff700 1 -- 172.21.15.118:0/2651976032 >> 172.21.15.118:0/2651976032 conn(0x7f7e60063cd0 msgr2=0x7f7e6014b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:49.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.089+0000 7f7e64bff700 1 -- 172.21.15.118:0/2651976032 shutdown_connections 2023-09-28T04:23:49.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.089+0000 7f7e64bff700 1 -- 172.21.15.118:0/2651976032 wait complete. 2023-09-28T04:23:49.092 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 5 to deep-scrub 2023-09-28T04:23:49.108 INFO:tasks.ceph:Scrubbing osd.6 2023-09-28T04:23:49.108 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-09-28T04:23:49.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.301+0000 7f34fe7ff700 1 Processor -- start 2023-09-28T04:23:49.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.301+0000 7f34fe7ff700 1 -- start start 2023-09-28T04:23:49.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.302+0000 7f34fe7ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f34f80c0af0 0x7f34f806dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.302+0000 7f34fe7ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f34f80bef80 0x7f34f806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.302+0000 7f34fe7ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f8069a90 con 0x7f34f80c2510 2023-09-28T04:23:49.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.302+0000 7f34fe7ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f81525f0 con 0x7f34f80bef80 2023-09-28T04:23:49.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.302+0000 7f34fe7ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f806f600 con 0x7f34f80c0af0 2023-09-28T04:23:49.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.302+0000 7f34f77fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f34f80bef80 0x7f34f806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.302+0000 7f34fcd9c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f34f80c2510 0x7f34f8155b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:40830/0 (socket says 172.21.15.118:40830) 2023-09-28T04:23:49.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.303+0000 7f34f77fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f34f80bef80 0x7f34f806e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58784/0 (socket says 172.21.15.118:58784) 2023-09-28T04:23:49.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.303+0000 7f34fcd9c700 1 -- 172.21.15.118:0/3729661079 learned_addr learned my addr 172.21.15.118:0/3729661079 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:49.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.303+0000 7f34f7fff700 1 --2- 172.21.15.118:0/3729661079 >> v2:172.21.15.174:3300/0 conn(0x7f34f80c0af0 0x7f34f806dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.303+0000 7f34f77fe700 1 -- 172.21.15.118:0/3729661079 >> v2:172.21.15.174:3300/0 conn(0x7f34f80c0af0 msgr2=0x7f34f806dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:49.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.303+0000 7f34f77fe700 1 --2- 172.21.15.118:0/3729661079 >> v2:172.21.15.174:3300/0 conn(0x7f34f80c0af0 0x7f34f806dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.303+0000 7f34f77fe700 1 -- 172.21.15.118:0/3729661079 >> v1:172.21.15.118:6789/0 conn(0x7f34f80c2510 legacy=0x7f34f8155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.303+0000 7f34f77fe700 1 -- 172.21.15.118:0/3729661079 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f806f880 con 0x7f34f80bef80 2023-09-28T04:23:49.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.303+0000 7f34f6ffd700 1 -- 172.21.15.118:0/3729661079 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737709743 0 0) 0x7f34f8069a90 con 0x7f34f80c2510 2023-09-28T04:23:49.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.303+0000 7f34f77fe700 1 --2- 172.21.15.118:0/3729661079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f80bef80 0x7f34f806e7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f34f8068820 tx=0x7f34ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e329941ff0e69e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:49.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.303+0000 7f34f6ffd700 1 -- 172.21.15.118:0/3729661079 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec011630 con 0x7f34f80bef80 2023-09-28T04:23:49.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.303+0000 7f34f6ffd700 1 -- 172.21.15.118:0/3729661079 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec011790 con 0x7f34f80bef80 2023-09-28T04:23:49.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.303+0000 7f34f6ffd700 1 -- 172.21.15.118:0/3729661079 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec011b30 con 0x7f34f80bef80 2023-09-28T04:23:49.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.304+0000 7f34fe7ff700 1 -- 172.21.15.118:0/3729661079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f80bef80 msgr2=0x7f34f806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.304+0000 7f34fe7ff700 1 --2- 172.21.15.118:0/3729661079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f80bef80 0x7f34f806e7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f34f8068820 tx=0x7f34ec0091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.304+0000 7f34fe7ff700 1 -- 172.21.15.118:0/3729661079 shutdown_connections 2023-09-28T04:23:49.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.304+0000 7f34fe7ff700 1 --2- 172.21.15.118:0/3729661079 >> v2:172.21.15.174:3300/0 conn(0x7f34f80c0af0 0x7f34f806dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.304+0000 7f34fe7ff700 1 --2- 172.21.15.118:0/3729661079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f80bef80 0x7f34f806e7a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.304+0000 7f34fe7ff700 1 -- 172.21.15.118:0/3729661079 >> 172.21.15.118:0/3729661079 conn(0x7f34f80c7ba0 msgr2=0x7f34f80c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:49.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.304+0000 7f34fe7ff700 1 -- 172.21.15.118:0/3729661079 shutdown_connections 2023-09-28T04:23:49.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.304+0000 7f34fe7ff700 1 -- 172.21.15.118:0/3729661079 wait complete. 2023-09-28T04:23:49.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.306+0000 7f34fe7ff700 1 Processor -- start 2023-09-28T04:23:49.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.306+0000 7f34fe7ff700 1 -- start start 2023-09-28T04:23:49.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34fe7ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34f80bef80 0x7f34f80c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34fe7ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f80c0af0 0x7f34f80c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34fe7ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34f80c2510 0x7f34f8151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34fe7ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8164d60 con 0x7f34f80c0af0 2023-09-28T04:23:49.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34fe7ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f81453a0 con 0x7f34f80c2510 2023-09-28T04:23:49.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34fe7ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8165b60 con 0x7f34f80bef80 2023-09-28T04:23:49.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34f77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f80c0af0 0x7f34f80c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34f77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f80c0af0 0x7f34f80c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58792/0 (socket says 172.21.15.118:58792) 2023-09-28T04:23:49.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34f77fe700 1 -- 172.21.15.118:0/2119207786 learned_addr learned my addr 172.21.15.118:0/2119207786 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:49.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34f7fff700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34f80bef80 0x7f34f80c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34fcd9c700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34f80c2510 0x7f34f8151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34f77fe700 1 -- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34f80bef80 msgr2=0x7f34f80c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34f77fe700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34f80bef80 0x7f34f80c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34f77fe700 1 -- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34f80c2510 msgr2=0x7f34f8151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34f77fe700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34f80c2510 0x7f34f8151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34f77fe700 1 -- 172.21.15.118:0/2119207786 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec009420 con 0x7f34f80c0af0 2023-09-28T04:23:49.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.307+0000 7f34f77fe700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f80c0af0 0x7f34f80c7100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f34ec013000 tx=0x7f34ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:49.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.308+0000 7f34dffff700 1 -- 172.21.15.118:0/2119207786 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec011b10 con 0x7f34f80c0af0 2023-09-28T04:23:49.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.308+0000 7f34dffff700 1 -- 172.21.15.118:0/2119207786 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec0253f0 con 0x7f34f80c0af0 2023-09-28T04:23:49.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.308+0000 7f34dffff700 1 -- 172.21.15.118:0/2119207786 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec025790 con 0x7f34f80c0af0 2023-09-28T04:23:49.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.308+0000 7f34fe7ff700 1 -- 172.21.15.118:0/2119207786 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f8164f50 con 0x7f34f80c0af0 2023-09-28T04:23:49.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.308+0000 7f34fe7ff700 1 -- 172.21.15.118:0/2119207786 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f8165510 con 0x7f34f80c0af0 2023-09-28T04:23:49.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.309+0000 7f34fe7ff700 1 -- 172.21.15.118:0/2119207786 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f34f8071980 con 0x7f34f80c0af0 2023-09-28T04:23:49.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.310+0000 7f34dffff700 1 -- 172.21.15.118:0/2119207786 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f34ec025b40 con 0x7f34f80c0af0 2023-09-28T04:23:49.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.310+0000 7f34dffff700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f34e4067330 0x7f34e40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.311+0000 7f34dffff700 1 -- 172.21.15.118:0/2119207786 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f34ec086570 con 0x7f34f80c0af0 2023-09-28T04:23:49.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.311+0000 7f34dffff700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] conn(0x7f34e406fbe0 0x7f34e4071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.311+0000 7f34dffff700 1 -- 172.21.15.118:0/2119207786 --> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34e40726a0 con 0x7f34e406fbe0 2023-09-28T04:23:49.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.311+0000 7f34dffff700 1 -- 172.21.15.118:0/2119207786 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34ec088a70 con 0x7f34f80c0af0 2023-09-28T04:23:49.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.311+0000 7f34f7fff700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f34e4067330 0x7f34e40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.311+0000 7f34fcd9c700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] conn(0x7f34e406fbe0 0x7f34e4071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.311+0000 7f34f7fff700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f34e4067330 0x7f34e40697e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009d40 tx=0x7f34e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:49.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.312+0000 7f34fcd9c700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] conn(0x7f34e406fbe0 0x7f34e4071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:49.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.312+0000 7f34dffff700 1 -- 172.21.15.118:0/2119207786 <== osd.6 v2:172.21.15.174:6816/119911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f34e40726a0 con 0x7f34e406fbe0 2023-09-28T04:23:49.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.326+0000 7f34fe7ff700 1 -- 172.21.15.118:0/2119207786 --> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f34f8152800 con 0x7f34e406fbe0 2023-09-28T04:23:49.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.327+0000 7f34dffff700 1 -- 172.21.15.118:0/2119207786 <== osd.6 v2:172.21.15.174:6816/119911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f34f8152800 con 0x7f34e406fbe0 2023-09-28T04:23:49.328 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-09-28T04:23:49.328 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T04:23:49.328 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-09-28T04:23:49.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.328+0000 7f34fe7ff700 1 -- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] conn(0x7f34e406fbe0 msgr2=0x7f34e4071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.328+0000 7f34fe7ff700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:6816/119911,v1:172.21.15.174:6818/119911] conn(0x7f34e406fbe0 0x7f34e4071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.328+0000 7f34fe7ff700 1 -- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f34e4067330 msgr2=0x7f34e40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.328+0000 7f34fe7ff700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f34e4067330 0x7f34e40697e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009d40 tx=0x7f34e8008040 comp rx=0 tx=0).stop 2023-09-28T04:23:49.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.328+0000 7f34fe7ff700 1 -- 172.21.15.118:0/2119207786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f80c0af0 msgr2=0x7f34f80c7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.328+0000 7f34fe7ff700 1 --2- 172.21.15.118:0/2119207786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f80c0af0 0x7f34f80c7100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f34ec013000 tx=0x7f34ec017000 comp rx=0 tx=0).stop 2023-09-28T04:23:49.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.328+0000 7f34fcd9c700 1 -- 172.21.15.118:0/2119207786 reap_dead start 2023-09-28T04:23:49.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.328+0000 7f34fe7ff700 1 -- 172.21.15.118:0/2119207786 shutdown_connections 2023-09-28T04:23:49.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.328+0000 7f34fe7ff700 1 -- 172.21.15.118:0/2119207786 >> 172.21.15.118:0/2119207786 conn(0x7f34f80c7ba0 msgr2=0x7f34f80c1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:49.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.328+0000 7f34fe7ff700 1 -- 172.21.15.118:0/2119207786 shutdown_connections 2023-09-28T04:23:49.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.328+0000 7f34fe7ff700 1 -- 172.21.15.118:0/2119207786 wait complete. 2023-09-28T04:23:49.345 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-09-28T04:23:49.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.534+0000 7f6ac49ff700 1 Processor -- start 2023-09-28T04:23:49.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.534+0000 7f6ac49ff700 1 -- start start 2023-09-28T04:23:49.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.535+0000 7f6ac49ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac014f9f0 0x7f6ac01562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6ac49ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6ac0089830 0x7f6ac00c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6ac49ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac00c7980 con 0x7f6ac00adf10 2023-09-28T04:23:49.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6ac49ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac00cce60 con 0x7f6ac0089830 2023-09-28T04:23:49.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6ac49ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac00c75e0 con 0x7f6ac014f9f0 2023-09-28T04:23:49.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6abe59c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f6ac00adf10 0x7f6ac014f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:40832/0 (socket says 172.21.15.118:40832) 2023-09-28T04:23:49.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6abe59c700 1 -- 172.21.15.118:0/378936809 learned_addr learned my addr 172.21.15.118:0/378936809 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:49.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6abed9d700 1 --2- 172.21.15.118:0/378936809 >> v2:172.21.15.174:3300/0 conn(0x7f6ac0089830 0x7f6ac00c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6ab7fff700 1 --2- 172.21.15.118:0/378936809 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac014f9f0 0x7f6ac01562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6abdd9b700 1 -- 172.21.15.118:0/378936809 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330161460 0 0) 0x7f6ac00c7980 con 0x7f6ac00adf10 2023-09-28T04:23:49.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6abdd9b700 1 -- 172.21.15.118:0/378936809 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aa0003570 con 0x7f6ac00adf10 2023-09-28T04:23:49.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6ab7fff700 1 -- 172.21.15.118:0/378936809 >> v2:172.21.15.174:3300/0 conn(0x7f6ac0089830 msgr2=0x7f6ac00c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:49.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6ab7fff700 1 --2- 172.21.15.118:0/378936809 >> v2:172.21.15.174:3300/0 conn(0x7f6ac0089830 0x7f6ac00c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6ab7fff700 1 -- 172.21.15.118:0/378936809 >> v1:172.21.15.118:6789/0 conn(0x7f6ac00adf10 legacy=0x7f6ac014f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6ab7fff700 1 -- 172.21.15.118:0/378936809 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac00ccbc0 con 0x7f6ac014f9f0 2023-09-28T04:23:49.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.536+0000 7f6abed9d700 1 --2- 172.21.15.118:0/378936809 >> v2:172.21.15.174:3300/0 conn(0x7f6ac0089830 0x7f6ac00c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:49.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.537+0000 7f6ab7fff700 1 --2- 172.21.15.118:0/378936809 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac014f9f0 0x7f6ac01562b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80098e0 tx=0x7f6aa80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49fc53fa01ea86c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:49.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.537+0000 7f6abdd9b700 1 -- 172.21.15.118:0/378936809 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8011630 con 0x7f6ac014f9f0 2023-09-28T04:23:49.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.537+0000 7f6abdd9b700 1 -- 172.21.15.118:0/378936809 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa8011790 con 0x7f6ac014f9f0 2023-09-28T04:23:49.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.537+0000 7f6abdd9b700 1 -- 172.21.15.118:0/378936809 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8011b30 con 0x7f6ac014f9f0 2023-09-28T04:23:49.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.537+0000 7f6ac49ff700 1 -- 172.21.15.118:0/378936809 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac014f9f0 msgr2=0x7f6ac01562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.537+0000 7f6ac49ff700 1 --2- 172.21.15.118:0/378936809 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac014f9f0 0x7f6ac01562b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80098e0 tx=0x7f6aa80091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.538+0000 7f6ac49ff700 1 -- 172.21.15.118:0/378936809 shutdown_connections 2023-09-28T04:23:49.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.538+0000 7f6ac49ff700 1 --2- 172.21.15.118:0/378936809 >> v2:172.21.15.174:3300/0 conn(0x7f6ac0089830 0x7f6ac00c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.538+0000 7f6ac49ff700 1 --2- 172.21.15.118:0/378936809 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac014f9f0 0x7f6ac01562b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.543 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.538+0000 7f6ac49ff700 1 -- 172.21.15.118:0/378936809 >> 172.21.15.118:0/378936809 conn(0x7f6ac0063cc0 msgr2=0x7f6ac00cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:49.543 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.538+0000 7f6ac49ff700 1 -- 172.21.15.118:0/378936809 shutdown_connections 2023-09-28T04:23:49.543 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.538+0000 7f6ac49ff700 1 -- 172.21.15.118:0/378936809 wait complete. 2023-09-28T04:23:49.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.540+0000 7f6ac49ff700 1 Processor -- start 2023-09-28T04:23:49.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.540+0000 7f6ac49ff700 1 -- start start 2023-09-28T04:23:49.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.541+0000 7f6ac49ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac0089830 0x7f6ac00b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.541+0000 7f6ac49ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac00adf10 0x7f6ac0150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.541+0000 7f6ac49ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac014f9f0 0x7f6ac00aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.541+0000 7f6ac49ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac01529a0 con 0x7f6ac014f9f0 2023-09-28T04:23:49.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.541+0000 7f6ac49ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0154fa0 con 0x7f6ac0089830 2023-09-28T04:23:49.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.541+0000 7f6ac49ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac01551f0 con 0x7f6ac00adf10 2023-09-28T04:23:49.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.541+0000 7f6abed9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac014f9f0 0x7f6ac00aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.541+0000 7f6abed9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac014f9f0 0x7f6ac00aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58802/0 (socket says 172.21.15.118:58802) 2023-09-28T04:23:49.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.541+0000 7f6abed9d700 1 -- 172.21.15.118:0/2983255939 learned_addr learned my addr 172.21.15.118:0/2983255939 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:49.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.541+0000 7f6ab7fff700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac00adf10 0x7f6ac0150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.541+0000 7f6abe59c700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac0089830 0x7f6ac00b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.542+0000 7f6abed9d700 1 -- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac00adf10 msgr2=0x7f6ac0150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.542+0000 7f6abed9d700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac00adf10 0x7f6ac0150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.542+0000 7f6abed9d700 1 -- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac0089830 msgr2=0x7f6ac00b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.542+0000 7f6abed9d700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac0089830 0x7f6ac00b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.542+0000 7f6abed9d700 1 -- 172.21.15.118:0/2983255939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8009a20 con 0x7f6ac014f9f0 2023-09-28T04:23:49.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.542+0000 7f6abed9d700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac014f9f0 0x7f6ac00aef80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009ec0 tx=0x7f6ab800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:49.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.542+0000 7f6ab67fc700 1 -- 172.21.15.118:0/2983255939 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800cc00 con 0x7f6ac014f9f0 2023-09-28T04:23:49.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.542+0000 7f6ab67fc700 1 -- 172.21.15.118:0/2983255939 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab800f040 con 0x7f6ac014f9f0 2023-09-28T04:23:49.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.542+0000 7f6ab67fc700 1 -- 172.21.15.118:0/2983255939 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8014480 con 0x7f6ac014f9f0 2023-09-28T04:23:49.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.542+0000 7f6ac49ff700 1 -- 172.21.15.118:0/2983255939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa8009420 con 0x7f6ac014f9f0 2023-09-28T04:23:49.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.542+0000 7f6ac49ff700 1 -- 172.21.15.118:0/2983255939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac01557b0 con 0x7f6ac014f9f0 2023-09-28T04:23:49.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.543+0000 7f6ac49ff700 1 -- 172.21.15.118:0/2983255939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac0152b50 con 0x7f6ac014f9f0 2023-09-28T04:23:49.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.544+0000 7f6ab67fc700 1 -- 172.21.15.118:0/2983255939 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6ab80147f0 con 0x7f6ac014f9f0 2023-09-28T04:23:49.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.545+0000 7f6ab67fc700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6aa4067330 0x7f6aa40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.545+0000 7f6ab67fc700 1 -- 172.21.15.118:0/2983255939 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ab8085970 con 0x7f6ac014f9f0 2023-09-28T04:23:49.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.546+0000 7f6abe59c700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6aa4067330 0x7f6aa40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.548+0000 7f6abe59c700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6aa4067330 0x7f6aa40697e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0007fd0 tx=0x7f6ab0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:49.550 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.549+0000 7f6ab67fc700 1 -- 172.21.15.118:0/2983255939 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6ac0152b50 con 0x7f6ac014f9f0 2023-09-28T04:23:49.740 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.739+0000 7f6ac49ff700 1 -- 172.21.15.118:0/2983255939 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ac0152b50 con 0x7f6aa4067330 2023-09-28T04:23:49.740 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.740+0000 7f6ab67fc700 1 -- 172.21.15.118:0/2983255939 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6ac0152b50 con 0x7f6aa4067330 2023-09-28T04:23:49.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.742+0000 7f6ac49ff700 1 -- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6aa4067330 msgr2=0x7f6aa40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.742+0000 7f6ac49ff700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6aa4067330 0x7f6aa40697e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0007fd0 tx=0x7f6ab0009040 comp rx=0 tx=0).stop 2023-09-28T04:23:49.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.742+0000 7f6ac49ff700 1 -- 172.21.15.118:0/2983255939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac014f9f0 msgr2=0x7f6ac00aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.742+0000 7f6ac49ff700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac014f9f0 0x7f6ac00aef80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009ec0 tx=0x7f6ab800b040 comp rx=0 tx=0).stop 2023-09-28T04:23:49.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.742+0000 7f6ac49ff700 1 -- 172.21.15.118:0/2983255939 shutdown_connections 2023-09-28T04:23:49.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.742+0000 7f6ac49ff700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6aa4067330 0x7f6aa40697e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.742+0000 7f6ac49ff700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ac014f9f0 0x7f6ac00aef80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.742+0000 7f6ac49ff700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac0089830 0x7f6ac00b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.742+0000 7f6ac49ff700 1 --2- 172.21.15.118:0/2983255939 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6ac00adf10 0x7f6ac0150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.742+0000 7f6ac49ff700 1 -- 172.21.15.118:0/2983255939 >> 172.21.15.118:0/2983255939 conn(0x7f6ac0063cc0 msgr2=0x7f6ac00c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:49.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.743+0000 7f6ac49ff700 1 -- 172.21.15.118:0/2983255939 shutdown_connections 2023-09-28T04:23:49.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.743+0000 7f6ac49ff700 1 -- 172.21.15.118:0/2983255939 wait complete. 2023-09-28T04:23:49.745 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 6 to deep-scrub 2023-09-28T04:23:49.760 INFO:tasks.ceph:Scrubbing osd.7 2023-09-28T04:23:49.760 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-09-28T04:23:49.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.956+0000 7f4f3b5ff700 1 Processor -- start 2023-09-28T04:23:49.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.956+0000 7f4f3b5ff700 1 -- start start 2023-09-28T04:23:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.957+0000 7f4f3b5ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4f340af8b0 0x7f4f341564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.957+0000 7f4f3b5ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4f340c4700 0x7f4f341572a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.957+0000 7f4f3b5ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f34068660 con 0x7f4f340af4e0 2023-09-28T04:23:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.957+0000 7f4f3b5ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f340697f0 con 0x7f4f340af8b0 2023-09-28T04:23:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.957+0000 7f4f3b5ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f34068900 con 0x7f4f340c4700 2023-09-28T04:23:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.957+0000 7f4f3939b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f4f340af4e0 0x7f4f340c9d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:40842/0 (socket says 172.21.15.118:40842) 2023-09-28T04:23:49.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.957+0000 7f4f3939b700 1 -- 172.21.15.118:0/2085112749 learned_addr learned my addr 172.21.15.118:0/2085112749 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:49.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.957+0000 7f4f38b9a700 1 --2- 172.21.15.118:0/2085112749 >> v2:172.21.15.118:3300/0 conn(0x7f4f340af8b0 0x7f4f341564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.957+0000 7f4f39b9c700 1 --2- 172.21.15.118:0/2085112749 >> v2:172.21.15.174:3300/0 conn(0x7f4f340c4700 0x7f4f341572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.958+0000 7f4f2bfff700 1 -- 172.21.15.118:0/2085112749 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516441487 0 0) 0x7f4f34068660 con 0x7f4f340af4e0 2023-09-28T04:23:49.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.958+0000 7f4f2bfff700 1 -- 172.21.15.118:0/2085112749 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f20003570 con 0x7f4f340af4e0 2023-09-28T04:23:49.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.958+0000 7f4f38b9a700 1 -- 172.21.15.118:0/2085112749 >> v2:172.21.15.174:3300/0 conn(0x7f4f340c4700 msgr2=0x7f4f341572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:49.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.958+0000 7f4f38b9a700 1 --2- 172.21.15.118:0/2085112749 >> v2:172.21.15.174:3300/0 conn(0x7f4f340c4700 0x7f4f341572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.958+0000 7f4f38b9a700 1 -- 172.21.15.118:0/2085112749 >> v1:172.21.15.118:6789/0 conn(0x7f4f340af4e0 legacy=0x7f4f340c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.958+0000 7f4f38b9a700 1 -- 172.21.15.118:0/2085112749 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f34068be0 con 0x7f4f340af8b0 2023-09-28T04:23:49.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.958+0000 7f4f39b9c700 1 --2- 172.21.15.118:0/2085112749 >> v2:172.21.15.174:3300/0 conn(0x7f4f340c4700 0x7f4f341572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:23:49.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.958+0000 7f4f38b9a700 1 --2- 172.21.15.118:0/2085112749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f340af8b0 0x7f4f341564c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4f3406fcf0 tx=0x7f4f240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ee4615e2c155d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:49.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.958+0000 7f4f2bfff700 1 -- 172.21.15.118:0/2085112749 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400b690 con 0x7f4f340af8b0 2023-09-28T04:23:49.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.958+0000 7f4f2bfff700 1 -- 172.21.15.118:0/2085112749 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2400b7f0 con 0x7f4f340af8b0 2023-09-28T04:23:49.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.958+0000 7f4f2bfff700 1 -- 172.21.15.118:0/2085112749 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400bb90 con 0x7f4f340af8b0 2023-09-28T04:23:49.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.959+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/2085112749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f340af8b0 msgr2=0x7f4f341564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.959+0000 7f4f3b5ff700 1 --2- 172.21.15.118:0/2085112749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f340af8b0 0x7f4f341564c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4f3406fcf0 tx=0x7f4f240091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.959+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/2085112749 shutdown_connections 2023-09-28T04:23:49.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.959+0000 7f4f3b5ff700 1 --2- 172.21.15.118:0/2085112749 >> v2:172.21.15.174:3300/0 conn(0x7f4f340c4700 0x7f4f341572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.959+0000 7f4f3b5ff700 1 --2- 172.21.15.118:0/2085112749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f340af8b0 0x7f4f341564c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.959+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/2085112749 >> 172.21.15.118:0/2085112749 conn(0x7f4f34063230 msgr2=0x7f4f34063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.959+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/2085112749 shutdown_connections 2023-09-28T04:23:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.959+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/2085112749 wait complete. 2023-09-28T04:23:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.960+0000 7f4f3b5ff700 1 Processor -- start 2023-09-28T04:23:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.961+0000 7f4f3b5ff700 1 -- start start 2023-09-28T04:23:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.961+0000 7f4f3b5ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f340af4e0 0x7f4f341507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.961+0000 7f4f3b5ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f340af8b0 0x7f4f34152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.961+0000 7f4f3b5ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f340c4700 0x7f4f34152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.961+0000 7f4f3b5ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340c74b0 con 0x7f4f340c4700 2023-09-28T04:23:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.961+0000 7f4f3b5ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f34151e70 con 0x7f4f340af8b0 2023-09-28T04:23:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.961+0000 7f4f3b5ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340ae9d0 con 0x7f4f340af4e0 2023-09-28T04:23:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.962+0000 7f4f39b9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f340c4700 0x7f4f34152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.962+0000 7f4f39b9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f340c4700 0x7f4f34152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58822/0 (socket says 172.21.15.118:58822) 2023-09-28T04:23:49.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.962+0000 7f4f39b9c700 1 -- 172.21.15.118:0/1677228510 learned_addr learned my addr 172.21.15.118:0/1677228510 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:49.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.962+0000 7f4f38b9a700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f340af8b0 0x7f4f34152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.962+0000 7f4f3939b700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f340af4e0 0x7f4f341507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.962+0000 7f4f39b9c700 1 -- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f340af4e0 msgr2=0x7f4f341507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.962+0000 7f4f39b9c700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f340af4e0 0x7f4f341507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.962+0000 7f4f39b9c700 1 -- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f340af8b0 msgr2=0x7f4f34152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.962+0000 7f4f39b9c700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f340af8b0 0x7f4f34152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.962+0000 7f4f39b9c700 1 -- 172.21.15.118:0/1677228510 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f24009420 con 0x7f4f340c4700 2023-09-28T04:23:49.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.962+0000 7f4f39b9c700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f340c4700 0x7f4f34152840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009fc0 tx=0x7f4f2c0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.962+0000 7f4f297fa700 1 -- 172.21.15.118:0/1677228510 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c00dc70 con 0x7f4f340c4700 2023-09-28T04:23:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.963+0000 7f4f297fa700 1 -- 172.21.15.118:0/1677228510 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c00f040 con 0x7f4f340c4700 2023-09-28T04:23:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.963+0000 7f4f297fa700 1 -- 172.21.15.118:0/1677228510 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c015440 con 0x7f4f340c4700 2023-09-28T04:23:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.963+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/1677228510 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f340aec70 con 0x7f4f340c4700 2023-09-28T04:23:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.963+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/1677228510 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f34151380 con 0x7f4f340c4700 2023-09-28T04:23:49.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.963+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/1677228510 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f340713e0 con 0x7f4f340c4700 2023-09-28T04:23:49.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.965+0000 7f4f297fa700 1 -- 172.21.15.118:0/1677228510 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4f2c01e3b0 con 0x7f4f340c4700 2023-09-28T04:23:49.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.965+0000 7f4f297fa700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4f18067330 0x7f4f180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.966+0000 7f4f297fa700 1 -- 172.21.15.118:0/1677228510 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4f2c0850e0 con 0x7f4f340c4700 2023-09-28T04:23:49.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.966+0000 7f4f297fa700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] conn(0x7f4f1806fbe0 0x7f4f18071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:49.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.966+0000 7f4f297fa700 1 -- 172.21.15.118:0/1677228510 --> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f180726a0 con 0x7f4f1806fbe0 2023-09-28T04:23:49.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.966+0000 7f4f297fa700 1 -- 172.21.15.118:0/1677228510 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f2c087640 con 0x7f4f340c4700 2023-09-28T04:23:49.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.966+0000 7f4f3939b700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4f18067330 0x7f4f180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.966+0000 7f4f38b9a700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] conn(0x7f4f1806fbe0 0x7f4f18071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:49.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.967+0000 7f4f3939b700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4f18067330 0x7f4f180697e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4f30007fd0 tx=0x7f4f30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:49.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.967+0000 7f4f38b9a700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] conn(0x7f4f1806fbe0 0x7f4f18071ff0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:49.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.967+0000 7f4f297fa700 1 -- 172.21.15.118:0/1677228510 <== osd.7 v2:172.21.15.174:6808/119881 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f4f180726a0 con 0x7f4f1806fbe0 2023-09-28T04:23:49.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.982+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/1677228510 --> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4f34071980 con 0x7f4f1806fbe0 2023-09-28T04:23:49.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.982+0000 7f4f297fa700 1 -- 172.21.15.118:0/1677228510 <== osd.7 v2:172.21.15.174:6808/119881 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4f34071980 con 0x7f4f1806fbe0 2023-09-28T04:23:49.983 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-09-28T04:23:49.983 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T04:23:49.983 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-09-28T04:23:49.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.983+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] conn(0x7f4f1806fbe0 msgr2=0x7f4f18071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.983+0000 7f4f3b5ff700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:6808/119881,v1:172.21.15.174:6809/119881] conn(0x7f4f1806fbe0 0x7f4f18071ff0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.983+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4f18067330 msgr2=0x7f4f180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.983+0000 7f4f3b5ff700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4f18067330 0x7f4f180697e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4f30007fd0 tx=0x7f4f30009040 comp rx=0 tx=0).stop 2023-09-28T04:23:49.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.983+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/1677228510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f340c4700 msgr2=0x7f4f34152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:49.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.983+0000 7f4f3b5ff700 1 --2- 172.21.15.118:0/1677228510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f340c4700 0x7f4f34152840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009fc0 tx=0x7f4f2c0099b0 comp rx=0 tx=0).stop 2023-09-28T04:23:49.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.983+0000 7f4f39b9c700 1 -- 172.21.15.118:0/1677228510 reap_dead start 2023-09-28T04:23:49.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.983+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/1677228510 shutdown_connections 2023-09-28T04:23:49.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.983+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/1677228510 >> 172.21.15.118:0/1677228510 conn(0x7f4f34063230 msgr2=0x7f4f341541e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:49.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.983+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/1677228510 shutdown_connections 2023-09-28T04:23:49.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:49.983+0000 7f4f3b5ff700 1 -- 172.21.15.118:0/1677228510 wait complete. 2023-09-28T04:23:50.000 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-09-28T04:23:50.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.187+0000 7f66a65ff700 1 Processor -- start 2023-09-28T04:23:50.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.188+0000 7f66a65ff700 1 -- start start 2023-09-28T04:23:50.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.189+0000 7f66a65ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f66a00ca6c0 0x7f66a0156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:50.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.189+0000 7f66a65ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a00c73e0 con 0x7f66a00c5e30 2023-09-28T04:23:50.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.189+0000 7f66a65ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a00c0b60 con 0x7f66a00c4ab0 2023-09-28T04:23:50.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.189+0000 7f66a65ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a00c67d0 con 0x7f66a00ca6c0 2023-09-28T04:23:50.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.189+0000 7f669f7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f66a00ca6c0 0x7f66a0156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:50.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.189+0000 7f669ffff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f66a00c5e30 0x7f66a00c9fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:40846/0 (socket says 172.21.15.118:40846) 2023-09-28T04:23:50.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.189+0000 7f669f7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f66a00ca6c0 0x7f66a0156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58838/0 (socket says 172.21.15.118:58838) 2023-09-28T04:23:50.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.189+0000 7f669ffff700 1 -- 172.21.15.118:0/2042846469 learned_addr learned my addr 172.21.15.118:0/2042846469 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:23:50.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.190+0000 7f669f7fe700 1 -- 172.21.15.118:0/2042846469 >> v1:172.21.15.174:6789/0 conn(0x7f66a00c4ab0 legacy=0x7f66a014f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:50.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.190+0000 7f669f7fe700 1 -- 172.21.15.118:0/2042846469 >> v1:172.21.15.118:6789/0 conn(0x7f66a00c5e30 legacy=0x7f66a00c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:50.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.190+0000 7f669f7fe700 1 -- 172.21.15.118:0/2042846469 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a00c6ab0 con 0x7f66a00ca6c0 2023-09-28T04:23:50.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.190+0000 7f669effd700 1 -- 172.21.15.118:0/2042846469 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075943481 0 0) 0x7f66a00c73e0 con 0x7f66a00c5e30 2023-09-28T04:23:50.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.190+0000 7f669f7fe700 1 --2- 172.21.15.118:0/2042846469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ca6c0 0x7f66a0156570 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f66940098e0 tx=0x7f66940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7464dff743f138a server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:50.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.190+0000 7f669effd700 1 -- 172.21.15.118:0/2042846469 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694009e80 con 0x7f66a00ca6c0 2023-09-28T04:23:50.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.190+0000 7f669effd700 1 -- 172.21.15.118:0/2042846469 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400b8f0 con 0x7f66a00ca6c0 2023-09-28T04:23:50.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.190+0000 7f669effd700 1 -- 172.21.15.118:0/2042846469 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400bc70 con 0x7f66a00ca6c0 2023-09-28T04:23:50.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.191+0000 7f66a65ff700 1 -- 172.21.15.118:0/2042846469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ca6c0 msgr2=0x7f66a0156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:50.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.191+0000 7f66a65ff700 1 --2- 172.21.15.118:0/2042846469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ca6c0 0x7f66a0156570 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f66940098e0 tx=0x7f66940091a0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.191+0000 7f66a65ff700 1 -- 172.21.15.118:0/2042846469 shutdown_connections 2023-09-28T04:23:50.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.191+0000 7f66a65ff700 1 --2- 172.21.15.118:0/2042846469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ca6c0 0x7f66a0156570 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.191+0000 7f66a65ff700 1 -- 172.21.15.118:0/2042846469 >> 172.21.15.118:0/2042846469 conn(0x7f66a0063230 msgr2=0x7f66a0063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:50.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.191+0000 7f66a65ff700 1 -- 172.21.15.118:0/2042846469 shutdown_connections 2023-09-28T04:23:50.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.191+0000 7f66a65ff700 1 -- 172.21.15.118:0/2042846469 wait complete. 2023-09-28T04:23:50.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.192+0000 7f66a65ff700 1 Processor -- start 2023-09-28T04:23:50.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.192+0000 7f66a65ff700 1 -- start start 2023-09-28T04:23:50.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.193+0000 7f66a65ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66a00c4ab0 0x7f66a015a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:50.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.193+0000 7f66a65ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66a00c5e30 0x7f66a0149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:50.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.193+0000 7f66a65ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ca6c0 0x7f66a01590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:50.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.193+0000 7f66a65ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0169840 con 0x7f66a00ca6c0 2023-09-28T04:23:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.193+0000 7f66a65ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0169320 con 0x7f66a00c5e30 2023-09-28T04:23:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.193+0000 7f66a65ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0148bb0 con 0x7f66a00c4ab0 2023-09-28T04:23:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.193+0000 7f66a4b9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ca6c0 0x7f66a01590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.193+0000 7f669f7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66a00c5e30 0x7f66a0149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.193+0000 7f66a4b9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ca6c0 0x7f66a01590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58844/0 (socket says 172.21.15.118:58844) 2023-09-28T04:23:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.194+0000 7f66a4b9c700 1 -- 172.21.15.118:0/2297058300 learned_addr learned my addr 172.21.15.118:0/2297058300 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:50.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.194+0000 7f669ffff700 1 --2- 172.21.15.118:0/2297058300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66a00c4ab0 0x7f66a015a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:50.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.194+0000 7f66a4b9c700 1 -- 172.21.15.118:0/2297058300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66a00c4ab0 msgr2=0x7f66a015a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:50.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.194+0000 7f66a4b9c700 1 --2- 172.21.15.118:0/2297058300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66a00c4ab0 0x7f66a015a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.194+0000 7f66a4b9c700 1 -- 172.21.15.118:0/2297058300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66a00c5e30 msgr2=0x7f66a0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:50.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.194+0000 7f66a4b9c700 1 --2- 172.21.15.118:0/2297058300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66a00c5e30 0x7f66a0149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.194+0000 7f66a4b9c700 1 -- 172.21.15.118:0/2297058300 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009420 con 0x7f66a00ca6c0 2023-09-28T04:23:50.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.194+0000 7f66a4b9c700 1 --2- 172.21.15.118:0/2297058300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ca6c0 0x7f66a01590e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f669800c8e0 tx=0x7f6698001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:50.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.194+0000 7f6687fff700 1 -- 172.21.15.118:0/2297058300 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698012630 con 0x7f66a00ca6c0 2023-09-28T04:23:50.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.194+0000 7f6687fff700 1 -- 172.21.15.118:0/2297058300 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6698012790 con 0x7f66a00ca6c0 2023-09-28T04:23:50.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.194+0000 7f66a65ff700 1 -- 172.21.15.118:0/2297058300 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a01485a0 con 0x7f66a00ca6c0 2023-09-28T04:23:50.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.194+0000 7f6687fff700 1 -- 172.21.15.118:0/2297058300 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698012b50 con 0x7f66a00ca6c0 2023-09-28T04:23:50.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.194+0000 7f66a65ff700 1 -- 172.21.15.118:0/2297058300 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a0169560 con 0x7f66a00ca6c0 2023-09-28T04:23:50.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.195+0000 7f66a65ff700 1 -- 172.21.15.118:0/2297058300 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a0148400 con 0x7f66a00ca6c0 2023-09-28T04:23:50.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.196+0000 7f6687fff700 1 -- 172.21.15.118:0/2297058300 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f669801a3a0 con 0x7f66a00ca6c0 2023-09-28T04:23:50.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.197+0000 7f6687fff700 1 --2- 172.21.15.118:0/2297058300 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f668c067330 0x7f668c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:50.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.197+0000 7f6687fff700 1 -- 172.21.15.118:0/2297058300 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6698084dd0 con 0x7f66a00ca6c0 2023-09-28T04:23:50.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.197+0000 7f669ffff700 1 --2- 172.21.15.118:0/2297058300 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f668c067330 0x7f668c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:50.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.198+0000 7f669ffff700 1 --2- 172.21.15.118:0/2297058300 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f668c067330 0x7f668c0697e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6690001360 tx=0x7f6690009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:50.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.201+0000 7f6687fff700 1 -- 172.21.15.118:0/2297058300 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f66a0148400 con 0x7f66a00ca6c0 2023-09-28T04:23:50.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.396+0000 7f66a65ff700 1 -- 172.21.15.118:0/2297058300 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f66a0148400 con 0x7f668c067330 2023-09-28T04:23:50.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.396+0000 7f6687fff700 1 -- 172.21.15.118:0/2297058300 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f66a0148400 con 0x7f668c067330 2023-09-28T04:23:50.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.399+0000 7f66a65ff700 1 -- 172.21.15.118:0/2297058300 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f668c067330 msgr2=0x7f668c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:50.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.399+0000 7f66a65ff700 1 --2- 172.21.15.118:0/2297058300 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f668c067330 0x7f668c0697e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6690001360 tx=0x7f6690009040 comp rx=0 tx=0).stop 2023-09-28T04:23:50.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.399+0000 7f66a65ff700 1 -- 172.21.15.118:0/2297058300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ca6c0 msgr2=0x7f66a01590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:50.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.399+0000 7f66a65ff700 1 --2- 172.21.15.118:0/2297058300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ca6c0 0x7f66a01590e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f669800c8e0 tx=0x7f6698001710 comp rx=0 tx=0).stop 2023-09-28T04:23:50.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.399+0000 7f66a65ff700 1 -- 172.21.15.118:0/2297058300 shutdown_connections 2023-09-28T04:23:50.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.399+0000 7f66a65ff700 1 --2- 172.21.15.118:0/2297058300 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f668c067330 0x7f668c0697e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.399+0000 7f66a65ff700 1 --2- 172.21.15.118:0/2297058300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ca6c0 0x7f66a01590e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.399+0000 7f66a65ff700 1 --2- 172.21.15.118:0/2297058300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66a00c4ab0 0x7f66a015a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.399+0000 7f66a65ff700 1 --2- 172.21.15.118:0/2297058300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66a00c5e30 0x7f66a0149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.399+0000 7f66a65ff700 1 -- 172.21.15.118:0/2297058300 >> 172.21.15.118:0/2297058300 conn(0x7f66a0063230 msgr2=0x7f66a0068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:50.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.399+0000 7f66a65ff700 1 -- 172.21.15.118:0/2297058300 shutdown_connections 2023-09-28T04:23:50.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.399+0000 7f66a65ff700 1 -- 172.21.15.118:0/2297058300 wait complete. 2023-09-28T04:23:50.402 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 7 to deep-scrub 2023-09-28T04:23:50.418 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T04:23:50.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.606+0000 7f6aa9fff700 1 Processor -- start 2023-09-28T04:23:50.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.606+0000 7f6aa9fff700 1 -- start start 2023-09-28T04:23:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.607+0000 7f6aa9fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6aa40c1850 0x7f6aa4153e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.607+0000 7f6aa9fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa414d230 0x7f6aa414d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.607+0000 7f6aa9fff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa414dc10 con 0x7f6aa40c1c20 2023-09-28T04:23:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.607+0000 7f6aa9fff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa40c5510 con 0x7f6aa40c1850 2023-09-28T04:23:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.607+0000 7f6aa9fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa40c2bd0 con 0x7f6aa414d230 2023-09-28T04:23:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.607+0000 7f6aa37fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6aa40c1850 0x7f6aa4153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.607+0000 7f6aa3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa414d230 0x7f6aa414d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.607+0000 7f6aa37fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6aa40c1850 0x7f6aa4153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58846/0 (socket says 172.21.15.118:58846) 2023-09-28T04:23:50.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.607+0000 7f6aa37fe700 1 -- 172.21.15.118:0/432303903 learned_addr learned my addr 172.21.15.118:0/432303903 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:50.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.607+0000 7f6aa2ffd700 1 --1- 172.21.15.118:0/432303903 >> v1:172.21.15.174:6789/0 conn(0x7f6aa40c1c20 0x7f6aa40c24c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:44700/0 (socket says 172.21.15.118:44700) 2023-09-28T04:23:50.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.608+0000 7f6aa37fe700 1 -- 172.21.15.118:0/432303903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa414d230 msgr2=0x7f6aa414d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:23:50.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.608+0000 7f6aa37fe700 1 --2- 172.21.15.118:0/432303903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa414d230 0x7f6aa414d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.608+0000 7f6aa37fe700 1 -- 172.21.15.118:0/432303903 >> v1:172.21.15.174:6789/0 conn(0x7f6aa40c1c20 legacy=0x7f6aa40c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:50.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.608+0000 7f6aa27fc700 1 -- 172.21.15.118:0/432303903 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292497292 0 0) 0x7f6aa414dc10 con 0x7f6aa40c1c20 2023-09-28T04:23:50.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.608+0000 7f6aa37fe700 1 -- 172.21.15.118:0/432303903 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa40bef30 con 0x7f6aa40c1850 2023-09-28T04:23:50.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.608+0000 7f6aa3fff700 1 --2- 172.21.15.118:0/432303903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa414d230 0x7f6aa414d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:23:50.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.608+0000 7f6aa37fe700 1 --2- 172.21.15.118:0/432303903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aa40c1850 0x7f6aa4153e70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6a940099b0 tx=0x7f6a94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6b8ffd0dc97641 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:50.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.608+0000 7f6aa27fc700 1 -- 172.21.15.118:0/432303903 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94009ea0 con 0x7f6aa40c1850 2023-09-28T04:23:50.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.608+0000 7f6aa27fc700 1 -- 172.21.15.118:0/432303903 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9400b8f0 con 0x7f6aa40c1850 2023-09-28T04:23:50.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.608+0000 7f6aa27fc700 1 -- 172.21.15.118:0/432303903 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400bc90 con 0x7f6aa40c1850 2023-09-28T04:23:50.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.609+0000 7f6aa9fff700 1 -- 172.21.15.118:0/432303903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aa40c1850 msgr2=0x7f6aa4153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:50.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.609+0000 7f6aa9fff700 1 --2- 172.21.15.118:0/432303903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aa40c1850 0x7f6aa4153e70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6a940099b0 tx=0x7f6a94009250 comp rx=0 tx=0).stop 2023-09-28T04:23:50.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.609+0000 7f6aa9fff700 1 -- 172.21.15.118:0/432303903 shutdown_connections 2023-09-28T04:23:50.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.609+0000 7f6aa9fff700 1 --2- 172.21.15.118:0/432303903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa414d230 0x7f6aa414d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.609+0000 7f6aa9fff700 1 --2- 172.21.15.118:0/432303903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aa40c1850 0x7f6aa4153e70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.609+0000 7f6aa9fff700 1 -- 172.21.15.118:0/432303903 >> 172.21.15.118:0/432303903 conn(0x7f6aa4067630 msgr2=0x7f6aa4067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:50.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.609+0000 7f6aa9fff700 1 -- 172.21.15.118:0/432303903 shutdown_connections 2023-09-28T04:23:50.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.609+0000 7f6aa9fff700 1 -- 172.21.15.118:0/432303903 wait complete. 2023-09-28T04:23:50.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.610+0000 7f6aa9fff700 1 Processor -- start 2023-09-28T04:23:50.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.610+0000 7f6aa9fff700 1 -- start start 2023-09-28T04:23:50.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.611+0000 7f6aa9fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aa40c1850 0x7f6aa40b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:50.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.611+0000 7f6aa9fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa40c1c20 0x7f6aa40bf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:50.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.611+0000 7f6aa9fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6aa414d230 0x7f6aa4169310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:50.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.611+0000 7f6aa9fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa414ffc0 con 0x7f6aa40c1850 2023-09-28T04:23:50.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.611+0000 7f6aa9fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa41502a0 con 0x7f6aa414d230 2023-09-28T04:23:50.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.611+0000 7f6aa9fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa4150580 con 0x7f6aa40c1c20 2023-09-28T04:23:50.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.612+0000 7f6aa37fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aa40c1850 0x7f6aa40b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:50.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.612+0000 7f6aa2ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa40c1c20 0x7f6aa40bf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:50.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.612+0000 7f6aa3fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6aa414d230 0x7f6aa4169310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:50.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.612+0000 7f6aa37fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aa40c1850 0x7f6aa40b8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58860/0 (socket says 172.21.15.118:58860) 2023-09-28T04:23:50.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.612+0000 7f6aa37fe700 1 -- 172.21.15.118:0/1991157476 learned_addr learned my addr 172.21.15.118:0/1991157476 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:23:50.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.612+0000 7f6aa37fe700 1 -- 172.21.15.118:0/1991157476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa40c1c20 msgr2=0x7f6aa40bf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:50.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.612+0000 7f6aa37fe700 1 --2- 172.21.15.118:0/1991157476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa40c1c20 0x7f6aa40bf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.612+0000 7f6aa37fe700 1 -- 172.21.15.118:0/1991157476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6aa414d230 msgr2=0x7f6aa4169310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:50.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.612+0000 7f6aa37fe700 1 --2- 172.21.15.118:0/1991157476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6aa414d230 0x7f6aa4169310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.612+0000 7f6aa37fe700 1 -- 172.21.15.118:0/1991157476 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c009a20 con 0x7f6aa40c1850 2023-09-28T04:23:50.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.612+0000 7f6aa37fe700 1 --2- 172.21.15.118:0/1991157476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aa40c1850 0x7f6aa40b8d60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a94006fd0 tx=0x7f6a94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:50.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.612+0000 7f6a8b7fe700 1 -- 172.21.15.118:0/1991157476 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400ba60 con 0x7f6aa40c1850 2023-09-28T04:23:50.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.612+0000 7f6a8b7fe700 1 -- 172.21.15.118:0/1991157476 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9400bbc0 con 0x7f6aa40c1850 2023-09-28T04:23:50.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.613+0000 7f6a8b7fe700 1 -- 172.21.15.118:0/1991157476 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94026680 con 0x7f6aa40c1850 2023-09-28T04:23:50.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.613+0000 7f6aa9fff700 1 -- 172.21.15.118:0/1991157476 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a940094f0 con 0x7f6aa40c1850 2023-09-28T04:23:50.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.613+0000 7f6aa9fff700 1 -- 172.21.15.118:0/1991157476 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa414f7b0 con 0x7f6aa40c1850 2023-09-28T04:23:50.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.614+0000 7f6aa9fff700 1 -- 172.21.15.118:0/1991157476 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa4150a20 con 0x7f6aa40c1850 2023-09-28T04:23:50.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.614+0000 7f6a8b7fe700 1 -- 172.21.15.118:0/1991157476 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6a94023030 con 0x7f6aa40c1850 2023-09-28T04:23:50.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.616+0000 7f6a8b7fe700 1 --2- 172.21.15.118:0/1991157476 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6a90067330 0x7f6a900697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:23:50.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.616+0000 7f6a8b7fe700 1 -- 172.21.15.118:0/1991157476 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6a94085ed0 con 0x7f6aa40c1850 2023-09-28T04:23:50.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.616+0000 7f6aa2ffd700 1 --2- 172.21.15.118:0/1991157476 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6a90067330 0x7f6a900697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:23:50.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.617+0000 7f6aa2ffd700 1 --2- 172.21.15.118:0/1991157476 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6a90067330 0x7f6a900697e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4156830 tx=0x7f6a98007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:23:50.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.620+0000 7f6a8b7fe700 1 -- 172.21.15.118:0/1991157476 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6a94052e70 con 0x7f6aa40c1850 2023-09-28T04:23:50.808 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.807+0000 7f6aa9fff700 1 -- 172.21.15.118:0/1991157476 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6aa4071980 con 0x7f6a90067330 2023-09-28T04:23:50.816 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.816+0000 7f6a8b7fe700 1 -- 172.21.15.118:0/1991157476 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282036 (secure 0 0 0) 0x7f6aa4071980 con 0x7f6a90067330 2023-09-28T04:23:50.820 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:23:50.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.820+0000 7f6aa9fff700 1 -- 172.21.15.118:0/1991157476 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6a90067330 msgr2=0x7f6a900697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:50.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.820+0000 7f6aa9fff700 1 --2- 172.21.15.118:0/1991157476 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6a90067330 0x7f6a900697e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4156830 tx=0x7f6a98007d50 comp rx=0 tx=0).stop 2023-09-28T04:23:50.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.820+0000 7f6aa9fff700 1 -- 172.21.15.118:0/1991157476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aa40c1850 msgr2=0x7f6aa40b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:23:50.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.820+0000 7f6aa9fff700 1 --2- 172.21.15.118:0/1991157476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aa40c1850 0x7f6aa40b8d60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a94006fd0 tx=0x7f6a94017000 comp rx=0 tx=0).stop 2023-09-28T04:23:50.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.820+0000 7f6aa9fff700 1 -- 172.21.15.118:0/1991157476 shutdown_connections 2023-09-28T04:23:50.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.820+0000 7f6aa9fff700 1 --2- 172.21.15.118:0/1991157476 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6a90067330 0x7f6a900697e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.820+0000 7f6aa9fff700 1 --2- 172.21.15.118:0/1991157476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6aa414d230 0x7f6aa4169310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.820+0000 7f6aa9fff700 1 --2- 172.21.15.118:0/1991157476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6aa40c1850 0x7f6aa40b8d60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.820+0000 7f6aa9fff700 1 --2- 172.21.15.118:0/1991157476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa40c1c20 0x7f6aa40bf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:23:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.820+0000 7f6aa9fff700 1 -- 172.21.15.118:0/1991157476 >> 172.21.15.118:0/1991157476 conn(0x7f6aa4067630 msgr2=0x7f6aa40c7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:23:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.820+0000 7f6aa9fff700 1 -- 172.21.15.118:0/1991157476 shutdown_connections 2023-09-28T04:23:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:23:50.820+0000 7f6aa9fff700 1 -- 172.21.15.118:0/1991157476 wait complete. 2023-09-28T04:23:50.824 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-09-28T04:23:50.838 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-09-28T04:23:50.533638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595334,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":284,"num_write_kb":2451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68480,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":66432,"kb_avail":754906240,"statfs":{"total":773094113280,"available":773023989760,"internally_reserved":0,"allocated":2031616,"data_stored":1824500,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68026368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003434"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172219+0000","last_change":"2023-09-28T04:23:18.400475+0000","last_active":"2023-09-28T04:23:20.172219+0000","last_peered":"2023-09-28T04:23:20.172219+0000","last_clean":"2023-09-28T04:23:20.172219+0000","last_became_active":"2023-09-28T04:23:18.400107+0000","last_became_peered":"2023-09-28T04:23:18.400107+0000","last_unstale":"2023-09-28T04:23:20.172219+0000","last_undegraded":"2023-09-28T04:23:20.172219+0000","last_fullsized":"2023-09-28T04:23:20.172219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376399+0000","last_change":"2023-09-28T04:23:18.385136+0000","last_active":"2023-09-28T04:23:19.376399+0000","last_peered":"2023-09-28T04:23:19.376399+0000","last_clean":"2023-09-28T04:23:19.376399+0000","last_became_active":"2023-09-28T04:23:18.384789+0000","last_became_peered":"2023-09-28T04:23:18.384789+0000","last_unstale":"2023-09-28T04:23:19.376399+0000","last_undegraded":"2023-09-28T04:23:19.376399+0000","last_fullsized":"2023-09-28T04:23:19.376399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376891+0000","last_change":"2023-09-28T04:23:18.393700+0000","last_active":"2023-09-28T04:23:19.376891+0000","last_peered":"2023-09-28T04:23:19.376891+0000","last_clean":"2023-09-28T04:23:19.376891+0000","last_became_active":"2023-09-28T04:23:18.390599+0000","last_became_peered":"2023-09-28T04:23:18.390599+0000","last_unstale":"2023-09-28T04:23:19.376891+0000","last_undegraded":"2023-09-28T04:23:19.376891+0000","last_fullsized":"2023-09-28T04:23:19.376891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392953+0000","last_change":"2023-09-28T04:23:18.390865+0000","last_active":"2023-09-28T04:23:18.392953+0000","last_peered":"2023-09-28T04:23:18.392953+0000","last_clean":"2023-09-28T04:23:18.392953+0000","last_became_active":"2023-09-28T04:23:18.390607+0000","last_became_peered":"2023-09-28T04:23:18.390607+0000","last_unstale":"2023-09-28T04:23:18.392953+0000","last_undegraded":"2023-09-28T04:23:18.392953+0000","last_fullsized":"2023-09-28T04:23:18.392953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:12.817007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172420+0000","last_change":"2023-09-28T04:23:18.404215+0000","last_active":"2023-09-28T04:23:20.172420+0000","last_peered":"2023-09-28T04:23:20.172420+0000","last_clean":"2023-09-28T04:23:20.172420+0000","last_became_active":"2023-09-28T04:23:18.403960+0000","last_became_peered":"2023-09-28T04:23:18.403960+0000","last_unstale":"2023-09-28T04:23:20.172420+0000","last_undegraded":"2023-09-28T04:23:20.172420+0000","last_fullsized":"2023-09-28T04:23:20.172420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377179+0000","last_change":"2023-09-28T04:23:18.393987+0000","last_active":"2023-09-28T04:23:19.377179+0000","last_peered":"2023-09-28T04:23:19.377179+0000","last_clean":"2023-09-28T04:23:19.377179+0000","last_became_active":"2023-09-28T04:23:18.390575+0000","last_became_peered":"2023-09-28T04:23:18.390575+0000","last_unstale":"2023-09-28T04:23:19.377179+0000","last_undegraded":"2023-09-28T04:23:19.377179+0000","last_fullsized":"2023-09-28T04:23:19.377179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.400984+0000","last_change":"2023-09-28T04:23:18.396733+0000","last_active":"2023-09-28T04:23:18.400984+0000","last_peered":"2023-09-28T04:23:18.400984+0000","last_clean":"2023-09-28T04:23:18.400984+0000","last_became_active":"2023-09-28T04:23:18.396038+0000","last_became_peered":"2023-09-28T04:23:18.396038+0000","last_unstale":"2023-09-28T04:23:18.400984+0000","last_undegraded":"2023-09-28T04:23:18.400984+0000","last_fullsized":"2023-09-28T04:23:18.400984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:56:44.557155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376188+0000","last_change":"2023-09-28T04:23:18.388208+0000","last_active":"2023-09-28T04:23:19.376188+0000","last_peered":"2023-09-28T04:23:19.376188+0000","last_clean":"2023-09-28T04:23:19.376188+0000","last_became_active":"2023-09-28T04:23:18.387260+0000","last_became_peered":"2023-09-28T04:23:18.387260+0000","last_unstale":"2023-09-28T04:23:19.376188+0000","last_undegraded":"2023-09-28T04:23:19.376188+0000","last_fullsized":"2023-09-28T04:23:19.376188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172205+0000","last_change":"2023-09-28T04:23:18.403803+0000","last_active":"2023-09-28T04:23:20.172205+0000","last_peered":"2023-09-28T04:23:20.172205+0000","last_clean":"2023-09-28T04:23:20.172205+0000","last_became_active":"2023-09-28T04:23:18.403565+0000","last_became_peered":"2023-09-28T04:23:18.403565+0000","last_unstale":"2023-09-28T04:23:20.172205+0000","last_undegraded":"2023-09-28T04:23:20.172205+0000","last_fullsized":"2023-09-28T04:23:20.172205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377404+0000","last_change":"2023-09-28T04:23:18.392418+0000","last_active":"2023-09-28T04:23:19.377404+0000","last_peered":"2023-09-28T04:23:19.377404+0000","last_clean":"2023-09-28T04:23:19.377404+0000","last_became_active":"2023-09-28T04:23:18.390911+0000","last_became_peered":"2023-09-28T04:23:18.390911+0000","last_unstale":"2023-09-28T04:23:19.377404+0000","last_undegraded":"2023-09-28T04:23:19.377404+0000","last_fullsized":"2023-09-28T04:23:19.377404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377013+0000","last_change":"2023-09-28T04:23:18.393845+0000","last_active":"2023-09-28T04:23:19.377013+0000","last_peered":"2023-09-28T04:23:19.377013+0000","last_clean":"2023-09-28T04:23:19.377013+0000","last_became_active":"2023-09-28T04:23:18.393524+0000","last_became_peered":"2023-09-28T04:23:18.393524+0000","last_unstale":"2023-09-28T04:23:19.377013+0000","last_undegraded":"2023-09-28T04:23:19.377013+0000","last_fullsized":"2023-09-28T04:23:19.377013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172358+0000","last_change":"2023-09-28T04:23:18.385250+0000","last_active":"2023-09-28T04:23:20.172358+0000","last_peered":"2023-09-28T04:23:20.172358+0000","last_clean":"2023-09-28T04:23:20.172358+0000","last_became_active":"2023-09-28T04:23:18.384986+0000","last_became_peered":"2023-09-28T04:23:18.384986+0000","last_unstale":"2023-09-28T04:23:20.172358+0000","last_undegraded":"2023-09-28T04:23:20.172358+0000","last_fullsized":"2023-09-28T04:23:20.172358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172321+0000","last_change":"2023-09-28T04:23:18.402417+0000","last_active":"2023-09-28T04:23:20.172321+0000","last_peered":"2023-09-28T04:23:20.172321+0000","last_clean":"2023-09-28T04:23:20.172321+0000","last_became_active":"2023-09-28T04:23:18.402161+0000","last_became_peered":"2023-09-28T04:23:18.402161+0000","last_unstale":"2023-09-28T04:23:20.172321+0000","last_undegraded":"2023-09-28T04:23:20.172321+0000","last_fullsized":"2023-09-28T04:23:20.172321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377012+0000","last_change":"2023-09-28T04:23:18.387808+0000","last_active":"2023-09-28T04:23:19.377012+0000","last_peered":"2023-09-28T04:23:19.377012+0000","last_clean":"2023-09-28T04:23:19.377012+0000","last_became_active":"2023-09-28T04:23:18.387471+0000","last_became_peered":"2023-09-28T04:23:18.387471+0000","last_unstale":"2023-09-28T04:23:19.377012+0000","last_undegraded":"2023-09-28T04:23:19.377012+0000","last_fullsized":"2023-09-28T04:23:19.377012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401004+0000","last_change":"2023-09-28T04:23:18.396945+0000","last_active":"2023-09-28T04:23:18.401004+0000","last_peered":"2023-09-28T04:23:18.401004+0000","last_clean":"2023-09-28T04:23:18.401004+0000","last_became_active":"2023-09-28T04:23:18.396395+0000","last_became_peered":"2023-09-28T04:23:18.396395+0000","last_unstale":"2023-09-28T04:23:18.401004+0000","last_undegraded":"2023-09-28T04:23:18.401004+0000","last_fullsized":"2023-09-28T04:23:18.401004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:53:51.275940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377230+0000","last_change":"2023-09-28T04:23:18.393975+0000","last_active":"2023-09-28T04:23:19.377230+0000","last_peered":"2023-09-28T04:23:19.377230+0000","last_clean":"2023-09-28T04:23:19.377230+0000","last_became_active":"2023-09-28T04:23:18.393683+0000","last_became_peered":"2023-09-28T04:23:18.393683+0000","last_unstale":"2023-09-28T04:23:19.377230+0000","last_undegraded":"2023-09-28T04:23:19.377230+0000","last_fullsized":"2023-09-28T04:23:19.377230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172301+0000","last_change":"2023-09-28T04:23:18.402518+0000","last_active":"2023-09-28T04:23:20.172301+0000","last_peered":"2023-09-28T04:23:20.172301+0000","last_clean":"2023-09-28T04:23:20.172301+0000","last_became_active":"2023-09-28T04:23:18.402275+0000","last_became_peered":"2023-09-28T04:23:18.402275+0000","last_unstale":"2023-09-28T04:23:20.172301+0000","last_undegraded":"2023-09-28T04:23:20.172301+0000","last_fullsized":"2023-09-28T04:23:20.172301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376867+0000","last_change":"2023-09-28T04:23:18.395032+0000","last_active":"2023-09-28T04:23:19.376867+0000","last_peered":"2023-09-28T04:23:19.376867+0000","last_clean":"2023-09-28T04:23:19.376867+0000","last_became_active":"2023-09-28T04:23:18.390678+0000","last_became_peered":"2023-09-28T04:23:18.390678+0000","last_unstale":"2023-09-28T04:23:19.376867+0000","last_undegraded":"2023-09-28T04:23:19.376867+0000","last_fullsized":"2023-09-28T04:23:19.376867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172614+0000","last_change":"2023-09-28T04:23:18.385209+0000","last_active":"2023-09-28T04:23:20.172614+0000","last_peered":"2023-09-28T04:23:20.172614+0000","last_clean":"2023-09-28T04:23:20.172614+0000","last_became_active":"2023-09-28T04:23:18.384916+0000","last_became_peered":"2023-09-28T04:23:18.384916+0000","last_unstale":"2023-09-28T04:23:20.172614+0000","last_undegraded":"2023-09-28T04:23:20.172614+0000","last_fullsized":"2023-09-28T04:23:20.172614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376892+0000","last_change":"2023-09-28T04:23:18.386692+0000","last_active":"2023-09-28T04:23:19.376892+0000","last_peered":"2023-09-28T04:23:19.376892+0000","last_clean":"2023-09-28T04:23:19.376892+0000","last_became_active":"2023-09-28T04:23:18.385805+0000","last_became_peered":"2023-09-28T04:23:18.385805+0000","last_unstale":"2023-09-28T04:23:19.376892+0000","last_undegraded":"2023-09-28T04:23:19.376892+0000","last_fullsized":"2023-09-28T04:23:19.376892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.401120+0000","last_change":"2023-09-28T04:23:18.400497+0000","last_active":"2023-09-28T04:23:18.401120+0000","last_peered":"2023-09-28T04:23:18.401120+0000","last_clean":"2023-09-28T04:23:18.401120+0000","last_became_active":"2023-09-28T04:23:18.400230+0000","last_became_peered":"2023-09-28T04:23:18.400230+0000","last_unstale":"2023-09-28T04:23:18.401120+0000","last_undegraded":"2023-09-28T04:23:18.401120+0000","last_fullsized":"2023-09-28T04:23:18.401120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:11:43.880043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172248+0000","last_change":"2023-09-28T04:23:18.391683+0000","last_active":"2023-09-28T04:23:20.172248+0000","last_peered":"2023-09-28T04:23:20.172248+0000","last_clean":"2023-09-28T04:23:20.172248+0000","last_became_active":"2023-09-28T04:23:18.391373+0000","last_became_peered":"2023-09-28T04:23:18.391373+0000","last_unstale":"2023-09-28T04:23:20.172248+0000","last_undegraded":"2023-09-28T04:23:20.172248+0000","last_fullsized":"2023-09-28T04:23:20.172248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.375899+0000","last_change":"2023-09-28T04:23:18.393381+0000","last_active":"2023-09-28T04:23:19.375899+0000","last_peered":"2023-09-28T04:23:19.375899+0000","last_clean":"2023-09-28T04:23:19.375899+0000","last_became_active":"2023-09-28T04:23:18.392723+0000","last_became_peered":"2023-09-28T04:23:18.392723+0000","last_unstale":"2023-09-28T04:23:19.375899+0000","last_undegraded":"2023-09-28T04:23:19.375899+0000","last_fullsized":"2023-09-28T04:23:19.375899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.403069+0000","last_change":"2023-09-28T04:23:18.402467+0000","last_active":"2023-09-28T04:23:18.403069+0000","last_peered":"2023-09-28T04:23:18.403069+0000","last_clean":"2023-09-28T04:23:18.403069+0000","last_became_active":"2023-09-28T04:23:18.402197+0000","last_became_peered":"2023-09-28T04:23:18.402197+0000","last_unstale":"2023-09-28T04:23:18.403069+0000","last_undegraded":"2023-09-28T04:23:18.403069+0000","last_fullsized":"2023-09-28T04:23:18.403069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:15:56.861795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.450821+0000","last_change":"2023-09-28T04:23:18.389242+0000","last_active":"2023-09-28T04:23:19.450821+0000","last_peered":"2023-09-28T04:23:19.450821+0000","last_clean":"2023-09-28T04:23:19.450821+0000","last_became_active":"2023-09-28T04:23:18.388936+0000","last_became_peered":"2023-09-28T04:23:18.388936+0000","last_unstale":"2023-09-28T04:23:19.450821+0000","last_undegraded":"2023-09-28T04:23:19.450821+0000","last_fullsized":"2023-09-28T04:23:19.450821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.450936+0000","last_change":"2023-09-28T04:23:18.388941+0000","last_active":"2023-09-28T04:23:19.450936+0000","last_peered":"2023-09-28T04:23:19.450936+0000","last_clean":"2023-09-28T04:23:19.450936+0000","last_became_active":"2023-09-28T04:23:18.388682+0000","last_became_peered":"2023-09-28T04:23:18.388682+0000","last_unstale":"2023-09-28T04:23:19.450936+0000","last_undegraded":"2023-09-28T04:23:19.450936+0000","last_fullsized":"2023-09-28T04:23:19.450936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376468+0000","last_change":"2023-09-28T04:23:18.391753+0000","last_active":"2023-09-28T04:23:19.376468+0000","last_peered":"2023-09-28T04:23:19.376468+0000","last_clean":"2023-09-28T04:23:19.376468+0000","last_became_active":"2023-09-28T04:23:18.391031+0000","last_became_peered":"2023-09-28T04:23:18.391031+0000","last_unstale":"2023-09-28T04:23:19.376468+0000","last_undegraded":"2023-09-28T04:23:19.376468+0000","last_fullsized":"2023-09-28T04:23:19.376468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440281+0000","last_change":"2023-09-28T04:23:17.914158+0000","last_active":"2023-09-28T04:23:33.440281+0000","last_peered":"2023-09-28T04:23:33.440281+0000","last_clean":"2023-09-28T04:23:33.440281+0000","last_became_active":"2023-09-28T04:23:17.913941+0000","last_became_peered":"2023-09-28T04:23:17.913941+0000","last_unstale":"2023-09-28T04:23:33.440281+0000","last_undegraded":"2023-09-28T04:23:33.440281+0000","last_fullsized":"2023-09-28T04:23:33.440281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.375976+0000","last_change":"2023-09-28T04:23:18.390288+0000","last_active":"2023-09-28T04:23:19.375976+0000","last_peered":"2023-09-28T04:23:19.375976+0000","last_clean":"2023-09-28T04:23:19.375976+0000","last_became_active":"2023-09-28T04:23:18.390030+0000","last_became_peered":"2023-09-28T04:23:18.390030+0000","last_unstale":"2023-09-28T04:23:19.375976+0000","last_undegraded":"2023-09-28T04:23:19.375976+0000","last_fullsized":"2023-09-28T04:23:19.375976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439638+0000","last_change":"2023-09-28T04:23:17.914311+0000","last_active":"2023-09-28T04:23:33.439638+0000","last_peered":"2023-09-28T04:23:33.439638+0000","last_clean":"2023-09-28T04:23:33.439638+0000","last_became_active":"2023-09-28T04:23:17.913950+0000","last_became_peered":"2023-09-28T04:23:17.913950+0000","last_unstale":"2023-09-28T04:23:33.439638+0000","last_undegraded":"2023-09-28T04:23:33.439638+0000","last_fullsized":"2023-09-28T04:23:33.439638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172587+0000","last_change":"2023-09-28T04:23:18.393402+0000","last_active":"2023-09-28T04:23:20.172587+0000","last_peered":"2023-09-28T04:23:20.172587+0000","last_clean":"2023-09-28T04:23:20.172587+0000","last_became_active":"2023-09-28T04:23:18.393106+0000","last_became_peered":"2023-09-28T04:23:18.393106+0000","last_unstale":"2023-09-28T04:23:20.172587+0000","last_undegraded":"2023-09-28T04:23:20.172587+0000","last_fullsized":"2023-09-28T04:23:20.172587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.409983+0000","last_change":"2023-09-28T04:23:17.911104+0000","last_active":"2023-09-28T04:23:28.409983+0000","last_peered":"2023-09-28T04:23:28.409983+0000","last_clean":"2023-09-28T04:23:28.409983+0000","last_became_active":"2023-09-28T04:23:17.910766+0000","last_became_peered":"2023-09-28T04:23:17.910766+0000","last_unstale":"2023-09-28T04:23:28.409983+0000","last_undegraded":"2023-09-28T04:23:28.409983+0000","last_fullsized":"2023-09-28T04:23:28.409983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.391763+0000","last_change":"2023-09-28T04:23:18.388098+0000","last_active":"2023-09-28T04:23:18.391763+0000","last_peered":"2023-09-28T04:23:18.391763+0000","last_clean":"2023-09-28T04:23:18.391763+0000","last_became_active":"2023-09-28T04:23:18.387581+0000","last_became_peered":"2023-09-28T04:23:18.387581+0000","last_unstale":"2023-09-28T04:23:18.391763+0000","last_undegraded":"2023-09-28T04:23:18.391763+0000","last_fullsized":"2023-09-28T04:23:18.391763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:11.090984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.410504+0000","last_change":"2023-09-28T04:23:17.917921+0000","last_active":"2023-09-28T04:23:28.410504+0000","last_peered":"2023-09-28T04:23:28.410504+0000","last_clean":"2023-09-28T04:23:28.410504+0000","last_became_active":"2023-09-28T04:23:17.917596+0000","last_became_peered":"2023-09-28T04:23:17.917596+0000","last_unstale":"2023-09-28T04:23:28.410504+0000","last_undegraded":"2023-09-28T04:23:28.410504+0000","last_fullsized":"2023-09-28T04:23:28.410504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.375794+0000","last_change":"2023-09-28T04:23:18.394460+0000","last_active":"2023-09-28T04:23:19.375794+0000","last_peered":"2023-09-28T04:23:19.375794+0000","last_clean":"2023-09-28T04:23:19.375794+0000","last_became_active":"2023-09-28T04:23:18.391773+0000","last_became_peered":"2023-09-28T04:23:18.391773+0000","last_unstale":"2023-09-28T04:23:19.375794+0000","last_undegraded":"2023-09-28T04:23:19.375794+0000","last_fullsized":"2023-09-28T04:23:19.375794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.408647+0000","last_change":"2023-09-28T04:23:17.908875+0000","last_active":"2023-09-28T04:23:28.408647+0000","last_peered":"2023-09-28T04:23:28.408647+0000","last_clean":"2023-09-28T04:23:28.408647+0000","last_became_active":"2023-09-28T04:23:17.908599+0000","last_became_peered":"2023-09-28T04:23:17.908599+0000","last_unstale":"2023-09-28T04:23:28.408647+0000","last_undegraded":"2023-09-28T04:23:28.408647+0000","last_fullsized":"2023-09-28T04:23:28.408647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376120+0000","last_change":"2023-09-28T04:23:18.393856+0000","last_active":"2023-09-28T04:23:19.376120+0000","last_peered":"2023-09-28T04:23:19.376120+0000","last_clean":"2023-09-28T04:23:19.376120+0000","last_became_active":"2023-09-28T04:23:18.393631+0000","last_became_peered":"2023-09-28T04:23:18.393631+0000","last_unstale":"2023-09-28T04:23:19.376120+0000","last_undegraded":"2023-09-28T04:23:19.376120+0000","last_fullsized":"2023-09-28T04:23:19.376120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.385554+0000","last_change":"2023-09-28T04:23:17.911594+0000","last_active":"2023-09-28T04:23:23.385554+0000","last_peered":"2023-09-28T04:23:23.385554+0000","last_clean":"2023-09-28T04:23:23.385554+0000","last_became_active":"2023-09-28T04:23:17.911361+0000","last_became_peered":"2023-09-28T04:23:17.911361+0000","last_unstale":"2023-09-28T04:23:23.385554+0000","last_undegraded":"2023-09-28T04:23:23.385554+0000","last_fullsized":"2023-09-28T04:23:23.385554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:07:05.677903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.450602+0000","last_change":"2023-09-28T04:23:18.387908+0000","last_active":"2023-09-28T04:23:19.450602+0000","last_peered":"2023-09-28T04:23:19.450602+0000","last_clean":"2023-09-28T04:23:19.450602+0000","last_became_active":"2023-09-28T04:23:18.387672+0000","last_became_peered":"2023-09-28T04:23:18.387672+0000","last_unstale":"2023-09-28T04:23:19.450602+0000","last_undegraded":"2023-09-28T04:23:19.450602+0000","last_fullsized":"2023-09-28T04:23:19.450602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412328+0000","last_change":"2023-09-28T04:23:17.904974+0000","last_active":"2023-09-28T04:23:28.412328+0000","last_peered":"2023-09-28T04:23:28.412328+0000","last_clean":"2023-09-28T04:23:28.412328+0000","last_became_active":"2023-09-28T04:23:17.904734+0000","last_became_peered":"2023-09-28T04:23:17.904734+0000","last_unstale":"2023-09-28T04:23:28.412328+0000","last_undegraded":"2023-09-28T04:23:28.412328+0000","last_fullsized":"2023-09-28T04:23:28.412328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376902+0000","last_change":"2023-09-28T04:23:18.389128+0000","last_active":"2023-09-28T04:23:19.376902+0000","last_peered":"2023-09-28T04:23:19.376902+0000","last_clean":"2023-09-28T04:23:19.376902+0000","last_became_active":"2023-09-28T04:23:18.388871+0000","last_became_peered":"2023-09-28T04:23:18.388871+0000","last_unstale":"2023-09-28T04:23:19.376902+0000","last_undegraded":"2023-09-28T04:23:19.376902+0000","last_fullsized":"2023-09-28T04:23:19.376902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440656+0000","last_change":"2023-09-28T04:23:17.910343+0000","last_active":"2023-09-28T04:23:33.440656+0000","last_peered":"2023-09-28T04:23:33.440656+0000","last_clean":"2023-09-28T04:23:33.440656+0000","last_became_active":"2023-09-28T04:23:17.909981+0000","last_became_peered":"2023-09-28T04:23:17.909981+0000","last_unstale":"2023-09-28T04:23:33.440656+0000","last_undegraded":"2023-09-28T04:23:33.440656+0000","last_fullsized":"2023-09-28T04:23:33.440656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:33:11.813106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.375977+0000","last_change":"2023-09-28T04:23:18.391696+0000","last_active":"2023-09-28T04:23:19.375977+0000","last_peered":"2023-09-28T04:23:19.375977+0000","last_clean":"2023-09-28T04:23:19.375977+0000","last_became_active":"2023-09-28T04:23:18.391441+0000","last_became_peered":"2023-09-28T04:23:18.391441+0000","last_unstale":"2023-09-28T04:23:19.375977+0000","last_undegraded":"2023-09-28T04:23:19.375977+0000","last_fullsized":"2023-09-28T04:23:19.375977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412917+0000","last_change":"2023-09-28T04:23:17.916730+0000","last_active":"2023-09-28T04:23:28.412917+0000","last_peered":"2023-09-28T04:23:28.412917+0000","last_clean":"2023-09-28T04:23:28.412917+0000","last_became_active":"2023-09-28T04:23:17.916424+0000","last_became_peered":"2023-09-28T04:23:17.916424+0000","last_unstale":"2023-09-28T04:23:28.412917+0000","last_undegraded":"2023-09-28T04:23:28.412917+0000","last_fullsized":"2023-09-28T04:23:28.412917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376560+0000","last_change":"2023-09-28T04:23:18.391510+0000","last_active":"2023-09-28T04:23:19.376560+0000","last_peered":"2023-09-28T04:23:19.376560+0000","last_clean":"2023-09-28T04:23:19.376560+0000","last_became_active":"2023-09-28T04:23:18.390613+0000","last_became_peered":"2023-09-28T04:23:18.390613+0000","last_unstale":"2023-09-28T04:23:19.376560+0000","last_undegraded":"2023-09-28T04:23:19.376560+0000","last_fullsized":"2023-09-28T04:23:19.376560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440750+0000","last_change":"2023-09-28T04:23:17.910760+0000","last_active":"2023-09-28T04:23:33.440750+0000","last_peered":"2023-09-28T04:23:33.440750+0000","last_clean":"2023-09-28T04:23:33.440750+0000","last_became_active":"2023-09-28T04:23:17.910457+0000","last_became_peered":"2023-09-28T04:23:17.910457+0000","last_unstale":"2023-09-28T04:23:33.440750+0000","last_undegraded":"2023-09-28T04:23:33.440750+0000","last_fullsized":"2023-09-28T04:23:33.440750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:51:10.087083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172536+0000","last_change":"2023-09-28T04:23:18.402823+0000","last_active":"2023-09-28T04:23:20.172536+0000","last_peered":"2023-09-28T04:23:20.172536+0000","last_clean":"2023-09-28T04:23:20.172536+0000","last_became_active":"2023-09-28T04:23:18.402559+0000","last_became_peered":"2023-09-28T04:23:18.402559+0000","last_unstale":"2023-09-28T04:23:20.172536+0000","last_undegraded":"2023-09-28T04:23:20.172536+0000","last_fullsized":"2023-09-28T04:23:20.172536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'15","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440298+0000","last_change":"2023-09-28T04:23:17.910972+0000","last_active":"2023-09-28T04:23:33.440298+0000","last_peered":"2023-09-28T04:23:33.440298+0000","last_clean":"2023-09-28T04:23:33.440298+0000","last_became_active":"2023-09-28T04:23:17.910650+0000","last_became_peered":"2023-09-28T04:23:17.910650+0000","last_unstale":"2023-09-28T04:23:33.440298+0000","last_undegraded":"2023-09-28T04:23:33.440298+0000","last_fullsized":"2023-09-28T04:23:33.440298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:03:36.553513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376292+0000","last_change":"2023-09-28T04:23:18.395424+0000","last_active":"2023-09-28T04:23:19.376292+0000","last_peered":"2023-09-28T04:23:19.376292+0000","last_clean":"2023-09-28T04:23:19.376292+0000","last_became_active":"2023-09-28T04:23:18.394721+0000","last_became_peered":"2023-09-28T04:23:18.394721+0000","last_unstale":"2023-09-28T04:23:19.376292+0000","last_undegraded":"2023-09-28T04:23:19.376292+0000","last_fullsized":"2023-09-28T04:23:19.376292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.385189+0000","last_change":"2023-09-28T04:23:17.907642+0000","last_active":"2023-09-28T04:23:23.385189+0000","last_peered":"2023-09-28T04:23:23.385189+0000","last_clean":"2023-09-28T04:23:23.385189+0000","last_became_active":"2023-09-28T04:23:17.907331+0000","last_became_peered":"2023-09-28T04:23:17.907331+0000","last_unstale":"2023-09-28T04:23:23.385189+0000","last_undegraded":"2023-09-28T04:23:23.385189+0000","last_fullsized":"2023-09-28T04:23:23.385189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:42:43.336378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376744+0000","last_change":"2023-09-28T04:23:18.390910+0000","last_active":"2023-09-28T04:23:19.376744+0000","last_peered":"2023-09-28T04:23:19.376744+0000","last_clean":"2023-09-28T04:23:19.376744+0000","last_became_active":"2023-09-28T04:23:18.390633+0000","last_became_peered":"2023-09-28T04:23:18.390633+0000","last_unstale":"2023-09-28T04:23:19.376744+0000","last_undegraded":"2023-09-28T04:23:19.376744+0000","last_fullsized":"2023-09-28T04:23:19.376744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.383758+0000","last_change":"2023-09-28T04:23:17.906320+0000","last_active":"2023-09-28T04:23:23.383758+0000","last_peered":"2023-09-28T04:23:23.383758+0000","last_clean":"2023-09-28T04:23:23.383758+0000","last_became_active":"2023-09-28T04:23:17.906036+0000","last_became_peered":"2023-09-28T04:23:17.906036+0000","last_unstale":"2023-09-28T04:23:23.383758+0000","last_undegraded":"2023-09-28T04:23:23.383758+0000","last_fullsized":"2023-09-28T04:23:23.383758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:46.693404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376545+0000","last_change":"2023-09-28T04:23:18.386196+0000","last_active":"2023-09-28T04:23:19.376545+0000","last_peered":"2023-09-28T04:23:19.376545+0000","last_clean":"2023-09-28T04:23:19.376545+0000","last_became_active":"2023-09-28T04:23:18.385693+0000","last_became_peered":"2023-09-28T04:23:18.385693+0000","last_unstale":"2023-09-28T04:23:19.376545+0000","last_undegraded":"2023-09-28T04:23:19.376545+0000","last_fullsized":"2023-09-28T04:23:19.376545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172978+0000","last_change":"2023-09-28T04:23:17.908768+0000","last_active":"2023-09-28T04:23:20.172978+0000","last_peered":"2023-09-28T04:23:20.172978+0000","last_clean":"2023-09-28T04:23:20.172978+0000","last_became_active":"2023-09-28T04:23:17.908493+0000","last_became_peered":"2023-09-28T04:23:17.908493+0000","last_unstale":"2023-09-28T04:23:20.172978+0000","last_undegraded":"2023-09-28T04:23:20.172978+0000","last_fullsized":"2023-09-28T04:23:20.172978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:05:05.933651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.388563+0000","last_change":"2023-09-28T04:23:18.385404+0000","last_active":"2023-09-28T04:23:18.388563+0000","last_peered":"2023-09-28T04:23:18.388563+0000","last_clean":"2023-09-28T04:23:18.388563+0000","last_became_active":"2023-09-28T04:23:18.385112+0000","last_became_peered":"2023-09-28T04:23:18.385112+0000","last_unstale":"2023-09-28T04:23:18.388563+0000","last_undegraded":"2023-09-28T04:23:18.388563+0000","last_fullsized":"2023-09-28T04:23:18.388563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:14:06.331056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440034+0000","last_change":"2023-09-28T04:23:17.898518+0000","last_active":"2023-09-28T04:23:33.440034+0000","last_peered":"2023-09-28T04:23:33.440034+0000","last_clean":"2023-09-28T04:23:33.440034+0000","last_became_active":"2023-09-28T04:23:17.898232+0000","last_became_peered":"2023-09-28T04:23:17.898232+0000","last_unstale":"2023-09-28T04:23:33.440034+0000","last_undegraded":"2023-09-28T04:23:33.440034+0000","last_fullsized":"2023-09-28T04:23:33.440034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172629+0000","last_change":"2023-09-28T04:23:18.392206+0000","last_active":"2023-09-28T04:23:20.172629+0000","last_peered":"2023-09-28T04:23:20.172629+0000","last_clean":"2023-09-28T04:23:20.172629+0000","last_became_active":"2023-09-28T04:23:18.391963+0000","last_became_peered":"2023-09-28T04:23:18.391963+0000","last_unstale":"2023-09-28T04:23:20.172629+0000","last_undegraded":"2023-09-28T04:23:20.172629+0000","last_fullsized":"2023-09-28T04:23:20.172629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.410121+0000","last_change":"2023-09-28T04:23:17.905390+0000","last_active":"2023-09-28T04:23:28.410121+0000","last_peered":"2023-09-28T04:23:28.410121+0000","last_clean":"2023-09-28T04:23:28.410121+0000","last_became_active":"2023-09-28T04:23:17.905089+0000","last_became_peered":"2023-09-28T04:23:17.905089+0000","last_unstale":"2023-09-28T04:23:28.410121+0000","last_undegraded":"2023-09-28T04:23:28.410121+0000","last_fullsized":"2023-09-28T04:23:28.410121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377096+0000","last_change":"2023-09-28T04:23:18.400110+0000","last_active":"2023-09-28T04:23:19.377096+0000","last_peered":"2023-09-28T04:23:19.377096+0000","last_clean":"2023-09-28T04:23:19.377096+0000","last_became_active":"2023-09-28T04:23:18.399839+0000","last_became_peered":"2023-09-28T04:23:18.399839+0000","last_unstale":"2023-09-28T04:23:19.377096+0000","last_undegraded":"2023-09-28T04:23:19.377096+0000","last_fullsized":"2023-09-28T04:23:19.377096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172225+0000","last_change":"2023-09-28T04:23:17.912734+0000","last_active":"2023-09-28T04:23:20.172225+0000","last_peered":"2023-09-28T04:23:20.172225+0000","last_clean":"2023-09-28T04:23:20.172225+0000","last_became_active":"2023-09-28T04:23:17.912560+0000","last_became_peered":"2023-09-28T04:23:17.912560+0000","last_unstale":"2023-09-28T04:23:20.172225+0000","last_undegraded":"2023-09-28T04:23:20.172225+0000","last_fullsized":"2023-09-28T04:23:20.172225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:24:42.267053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377220+0000","last_change":"2023-09-28T04:23:18.393554+0000","last_active":"2023-09-28T04:23:19.377220+0000","last_peered":"2023-09-28T04:23:19.377220+0000","last_clean":"2023-09-28T04:23:19.377220+0000","last_became_active":"2023-09-28T04:23:18.390268+0000","last_became_peered":"2023-09-28T04:23:18.390268+0000","last_unstale":"2023-09-28T04:23:19.377220+0000","last_undegraded":"2023-09-28T04:23:19.377220+0000","last_fullsized":"2023-09-28T04:23:19.377220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412481+0000","last_change":"2023-09-28T04:23:17.911218+0000","last_active":"2023-09-28T04:23:28.412481+0000","last_peered":"2023-09-28T04:23:28.412481+0000","last_clean":"2023-09-28T04:23:28.412481+0000","last_became_active":"2023-09-28T04:23:17.910887+0000","last_became_peered":"2023-09-28T04:23:17.910887+0000","last_unstale":"2023-09-28T04:23:28.412481+0000","last_undegraded":"2023-09-28T04:23:28.412481+0000","last_fullsized":"2023-09-28T04:23:28.412481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377004+0000","last_change":"2023-09-28T04:23:18.387932+0000","last_active":"2023-09-28T04:23:19.377004+0000","last_peered":"2023-09-28T04:23:19.377004+0000","last_clean":"2023-09-28T04:23:19.377004+0000","last_became_active":"2023-09-28T04:23:18.387667+0000","last_became_peered":"2023-09-28T04:23:18.387667+0000","last_unstale":"2023-09-28T04:23:19.377004+0000","last_undegraded":"2023-09-28T04:23:19.377004+0000","last_fullsized":"2023-09-28T04:23:19.377004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.410389+0000","last_change":"2023-09-28T04:23:17.911764+0000","last_active":"2023-09-28T04:23:28.410389+0000","last_peered":"2023-09-28T04:23:28.410389+0000","last_clean":"2023-09-28T04:23:28.410389+0000","last_became_active":"2023-09-28T04:23:17.911458+0000","last_became_peered":"2023-09-28T04:23:17.911458+0000","last_unstale":"2023-09-28T04:23:28.410389+0000","last_undegraded":"2023-09-28T04:23:28.410389+0000","last_fullsized":"2023-09-28T04:23:28.410389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.450899+0000","last_change":"2023-09-28T04:23:18.400278+0000","last_active":"2023-09-28T04:23:19.450899+0000","last_peered":"2023-09-28T04:23:19.450899+0000","last_clean":"2023-09-28T04:23:19.450899+0000","last_became_active":"2023-09-28T04:23:18.399957+0000","last_became_peered":"2023-09-28T04:23:18.399957+0000","last_unstale":"2023-09-28T04:23:19.450899+0000","last_undegraded":"2023-09-28T04:23:19.450899+0000","last_fullsized":"2023-09-28T04:23:19.450899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:49.012208+0000","last_change":"2023-09-28T04:23:49.012182+0000","last_active":"2023-09-28T04:23:49.012208+0000","last_peered":"2023-09-28T04:23:49.012208+0000","last_clean":"2023-09-28T04:23:49.012208+0000","last_became_active":"2023-09-28T04:23:13.017362+0000","last_became_peered":"2023-09-28T04:23:13.017362+0000","last_unstale":"2023-09-28T04:23:49.012208+0000","last_undegraded":"2023-09-28T04:23:49.012208+0000","last_fullsized":"2023-09-28T04:23:49.012208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:49.012108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:49.012108+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.012108+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:10.816331+0000","scrub_duration":0.001277809,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.410502+0000","last_change":"2023-09-28T04:23:17.899128+0000","last_active":"2023-09-28T04:23:28.410502+0000","last_peered":"2023-09-28T04:23:28.410502+0000","last_clean":"2023-09-28T04:23:28.410502+0000","last_became_active":"2023-09-28T04:23:17.898878+0000","last_became_peered":"2023-09-28T04:23:17.898878+0000","last_unstale":"2023-09-28T04:23:28.410502+0000","last_undegraded":"2023-09-28T04:23:28.410502+0000","last_fullsized":"2023-09-28T04:23:28.410502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.450615+0000","last_change":"2023-09-28T04:23:18.384565+0000","last_active":"2023-09-28T04:23:19.450615+0000","last_peered":"2023-09-28T04:23:19.450615+0000","last_clean":"2023-09-28T04:23:19.450615+0000","last_became_active":"2023-09-28T04:23:18.383969+0000","last_became_peered":"2023-09-28T04:23:18.383969+0000","last_unstale":"2023-09-28T04:23:19.450615+0000","last_undegraded":"2023-09-28T04:23:19.450615+0000","last_fullsized":"2023-09-28T04:23:19.450615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377118+0000","last_change":"2023-09-28T04:23:12.604091+0000","last_active":"2023-09-28T04:23:19.377118+0000","last_peered":"2023-09-28T04:23:19.377118+0000","last_clean":"2023-09-28T04:23:19.377118+0000","last_became_active":"2023-09-28T04:23:12.603804+0000","last_became_peered":"2023-09-28T04:23:12.603804+0000","last_unstale":"2023-09-28T04:23:19.377118+0000","last_undegraded":"2023-09-28T04:23:19.377118+0000","last_fullsized":"2023-09-28T04:23:19.377118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439867+0000","last_change":"2023-09-28T04:23:17.918999+0000","last_active":"2023-09-28T04:23:33.439867+0000","last_peered":"2023-09-28T04:23:33.439867+0000","last_clean":"2023-09-28T04:23:33.439867+0000","last_became_active":"2023-09-28T04:23:17.918740+0000","last_became_peered":"2023-09-28T04:23:17.918740+0000","last_unstale":"2023-09-28T04:23:33.439867+0000","last_undegraded":"2023-09-28T04:23:33.439867+0000","last_fullsized":"2023-09-28T04:23:33.439867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.450781+0000","last_change":"2023-09-28T04:23:18.389350+0000","last_active":"2023-09-28T04:23:19.450781+0000","last_peered":"2023-09-28T04:23:19.450781+0000","last_clean":"2023-09-28T04:23:19.450781+0000","last_became_active":"2023-09-28T04:23:18.389059+0000","last_became_peered":"2023-09-28T04:23:18.389059+0000","last_unstale":"2023-09-28T04:23:19.450781+0000","last_undegraded":"2023-09-28T04:23:19.450781+0000","last_fullsized":"2023-09-28T04:23:19.450781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:47.823966+0000","last_change":"2023-09-28T04:23:47.823943+0000","last_active":"2023-09-28T04:23:47.823966+0000","last_peered":"2023-09-28T04:23:47.823966+0000","last_clean":"2023-09-28T04:23:47.823966+0000","last_became_active":"2023-09-28T04:23:12.601652+0000","last_became_peered":"2023-09-28T04:23:12.601652+0000","last_unstale":"2023-09-28T04:23:47.823966+0000","last_undegraded":"2023-09-28T04:23:47.823966+0000","last_fullsized":"2023-09-28T04:23:47.823966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:47.823864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:47.823864+0000","last_clean_scrub_stamp":"2023-09-28T04:23:47.823864+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:46:58.420448+0000","scrub_duration":0.0014653960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439208+0000","last_change":"2023-09-28T04:23:17.911566+0000","last_active":"2023-09-28T04:23:33.439208+0000","last_peered":"2023-09-28T04:23:33.439208+0000","last_clean":"2023-09-28T04:23:33.439208+0000","last_became_active":"2023-09-28T04:23:17.911308+0000","last_became_peered":"2023-09-28T04:23:17.911308+0000","last_unstale":"2023-09-28T04:23:33.439208+0000","last_undegraded":"2023-09-28T04:23:33.439208+0000","last_fullsized":"2023-09-28T04:23:33.439208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.450904+0000","last_change":"2023-09-28T04:23:18.388204+0000","last_active":"2023-09-28T04:23:19.450904+0000","last_peered":"2023-09-28T04:23:19.450904+0000","last_clean":"2023-09-28T04:23:19.450904+0000","last_became_active":"2023-09-28T04:23:18.387945+0000","last_became_peered":"2023-09-28T04:23:18.387945+0000","last_unstale":"2023-09-28T04:23:19.450904+0000","last_undegraded":"2023-09-28T04:23:19.450904+0000","last_fullsized":"2023-09-28T04:23:19.450904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376377+0000","last_change":"2023-09-28T04:23:12.604212+0000","last_active":"2023-09-28T04:23:19.376377+0000","last_peered":"2023-09-28T04:23:19.376377+0000","last_clean":"2023-09-28T04:23:19.376377+0000","last_became_active":"2023-09-28T04:23:12.603930+0000","last_became_peered":"2023-09-28T04:23:12.603930+0000","last_unstale":"2023-09-28T04:23:19.376377+0000","last_undegraded":"2023-09-28T04:23:19.376377+0000","last_fullsized":"2023-09-28T04:23:19.376377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386718+0000","last_change":"2023-09-28T04:23:11.608534+0000","last_active":"2023-09-28T04:23:18.386718+0000","last_peered":"2023-09-28T04:23:18.386718+0000","last_clean":"2023-09-28T04:23:18.386718+0000","last_became_active":"2023-09-28T04:23:11.608249+0000","last_became_peered":"2023-09-28T04:23:11.608249+0000","last_unstale":"2023-09-28T04:23:18.386718+0000","last_undegraded":"2023-09-28T04:23:18.386718+0000","last_fullsized":"2023-09-28T04:23:18.386718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:10.587579+0000","last_clean_scrub_stamp":"2023-09-28T04:23:10.587579+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:10.828301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439489+0000","last_change":"2023-09-28T04:23:17.902709+0000","last_active":"2023-09-28T04:23:33.439489+0000","last_peered":"2023-09-28T04:23:33.439489+0000","last_clean":"2023-09-28T04:23:33.439489+0000","last_became_active":"2023-09-28T04:23:17.902341+0000","last_became_peered":"2023-09-28T04:23:17.902341+0000","last_unstale":"2023-09-28T04:23:33.439489+0000","last_undegraded":"2023-09-28T04:23:33.439489+0000","last_fullsized":"2023-09-28T04:23:33.439489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392913+0000","last_change":"2023-09-28T04:23:18.389982+0000","last_active":"2023-09-28T04:23:18.392913+0000","last_peered":"2023-09-28T04:23:18.392913+0000","last_clean":"2023-09-28T04:23:18.392913+0000","last_became_active":"2023-09-28T04:23:18.389692+0000","last_became_peered":"2023-09-28T04:23:18.389692+0000","last_unstale":"2023-09-28T04:23:18.392913+0000","last_undegraded":"2023-09-28T04:23:18.392913+0000","last_fullsized":"2023-09-28T04:23:18.392913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:50:22.141906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386996+0000","last_change":"2023-09-28T04:23:12.605908+0000","last_active":"2023-09-28T04:23:18.386996+0000","last_peered":"2023-09-28T04:23:18.386996+0000","last_clean":"2023-09-28T04:23:18.386996+0000","last_became_active":"2023-09-28T04:23:12.605668+0000","last_became_peered":"2023-09-28T04:23:12.605668+0000","last_unstale":"2023-09-28T04:23:18.386996+0000","last_undegraded":"2023-09-28T04:23:18.386996+0000","last_fullsized":"2023-09-28T04:23:18.386996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:57:24.909371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"21'4","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:47.343078+0000","last_change":"2023-09-28T04:23:47.343034+0000","last_active":"2023-09-28T04:23:47.343078+0000","last_peered":"2023-09-28T04:23:47.343078+0000","last_clean":"2023-09-28T04:23:47.343078+0000","last_became_active":"2023-09-28T04:23:17.918130+0000","last_became_peered":"2023-09-28T04:23:17.918130+0000","last_unstale":"2023-09-28T04:23:47.343078+0000","last_undegraded":"2023-09-28T04:23:47.343078+0000","last_fullsized":"2023-09-28T04:23:47.343078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4","last_scrub_stamp":"2023-09-28T04:23:47.342937+0000","last_deep_scrub":"21'4","last_deep_scrub_stamp":"2023-09-28T04:23:47.342937+0000","last_clean_scrub_stamp":"2023-09-28T04:23:47.342937+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:43.795926+0000","scrub_duration":0.0023882230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172696+0000","last_change":"2023-09-28T04:23:18.391987+0000","last_active":"2023-09-28T04:23:20.172696+0000","last_peered":"2023-09-28T04:23:20.172696+0000","last_clean":"2023-09-28T04:23:20.172696+0000","last_became_active":"2023-09-28T04:23:18.391709+0000","last_became_peered":"2023-09-28T04:23:18.391709+0000","last_unstale":"2023-09-28T04:23:20.172696+0000","last_undegraded":"2023-09-28T04:23:20.172696+0000","last_fullsized":"2023-09-28T04:23:20.172696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.386509+0000","last_change":"2023-09-28T04:23:13.017715+0000","last_active":"2023-09-28T04:23:18.386509+0000","last_peered":"2023-09-28T04:23:18.386509+0000","last_clean":"2023-09-28T04:23:18.386509+0000","last_became_active":"2023-09-28T04:23:13.017398+0000","last_became_peered":"2023-09-28T04:23:13.017398+0000","last_unstale":"2023-09-28T04:23:18.386509+0000","last_undegraded":"2023-09-28T04:23:18.386509+0000","last_fullsized":"2023-09-28T04:23:18.386509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:37:41.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.450844+0000","last_change":"2023-09-28T04:23:17.912291+0000","last_active":"2023-09-28T04:23:19.450844+0000","last_peered":"2023-09-28T04:23:19.450844+0000","last_clean":"2023-09-28T04:23:19.450844+0000","last_became_active":"2023-09-28T04:23:17.912023+0000","last_became_peered":"2023-09-28T04:23:17.912023+0000","last_unstale":"2023-09-28T04:23:19.450844+0000","last_undegraded":"2023-09-28T04:23:19.450844+0000","last_fullsized":"2023-09-28T04:23:19.450844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172522+0000","last_change":"2023-09-28T04:23:18.396451+0000","last_active":"2023-09-28T04:23:20.172522+0000","last_peered":"2023-09-28T04:23:20.172522+0000","last_clean":"2023-09-28T04:23:20.172522+0000","last_became_active":"2023-09-28T04:23:18.396190+0000","last_became_peered":"2023-09-28T04:23:18.396190+0000","last_unstale":"2023-09-28T04:23:20.172522+0000","last_undegraded":"2023-09-28T04:23:20.172522+0000","last_fullsized":"2023-09-28T04:23:20.172522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:28.412816+0000","last_change":"2023-09-28T04:23:17.904739+0000","last_active":"2023-09-28T04:23:28.412816+0000","last_peered":"2023-09-28T04:23:28.412816+0000","last_clean":"2023-09-28T04:23:28.412816+0000","last_became_active":"2023-09-28T04:23:17.903844+0000","last_became_peered":"2023-09-28T04:23:17.903844+0000","last_unstale":"2023-09-28T04:23:28.412816+0000","last_undegraded":"2023-09-28T04:23:28.412816+0000","last_fullsized":"2023-09-28T04:23:28.412816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:48.024416+0000","last_change":"2023-09-28T04:23:48.024392+0000","last_active":"2023-09-28T04:23:48.024416+0000","last_peered":"2023-09-28T04:23:48.024416+0000","last_clean":"2023-09-28T04:23:48.024416+0000","last_became_active":"2023-09-28T04:23:12.606143+0000","last_became_peered":"2023-09-28T04:23:12.606143+0000","last_unstale":"2023-09-28T04:23:48.024416+0000","last_undegraded":"2023-09-28T04:23:48.024416+0000","last_fullsized":"2023-09-28T04:23:48.024416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:48.024316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:48.024316+0000","last_clean_scrub_stamp":"2023-09-28T04:23:48.024316+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:49:31.414222+0000","scrub_duration":0.001689442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.375689+0000","last_change":"2023-09-28T04:23:18.396153+0000","last_active":"2023-09-28T04:23:19.375689+0000","last_peered":"2023-09-28T04:23:19.375689+0000","last_clean":"2023-09-28T04:23:19.375689+0000","last_became_active":"2023-09-28T04:23:18.392092+0000","last_became_peered":"2023-09-28T04:23:18.392092+0000","last_unstale":"2023-09-28T04:23:19.375689+0000","last_undegraded":"2023-09-28T04:23:19.375689+0000","last_fullsized":"2023-09-28T04:23:19.375689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.379277+0000","last_change":"2023-09-28T04:23:12.606390+0000","last_active":"2023-09-28T04:23:18.379277+0000","last_peered":"2023-09-28T04:23:18.379277+0000","last_clean":"2023-09-28T04:23:18.379277+0000","last_became_active":"2023-09-28T04:23:12.605965+0000","last_became_peered":"2023-09-28T04:23:12.605965+0000","last_unstale":"2023-09-28T04:23:18.379277+0000","last_undegraded":"2023-09-28T04:23:18.379277+0000","last_fullsized":"2023-09-28T04:23:18.379277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:11.593117+0000","last_clean_scrub_stamp":"2023-09-28T04:23:11.593117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:06:11.833839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:46.366961+0000","last_change":"2023-09-28T04:23:46.366937+0000","last_active":"2023-09-28T04:23:46.366961+0000","last_peered":"2023-09-28T04:23:46.366961+0000","last_clean":"2023-09-28T04:23:46.366961+0000","last_became_active":"2023-09-28T04:23:17.914697+0000","last_became_peered":"2023-09-28T04:23:17.914697+0000","last_unstale":"2023-09-28T04:23:46.366961+0000","last_undegraded":"2023-09-28T04:23:46.366961+0000","last_fullsized":"2023-09-28T04:23:46.366961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:46.366859+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:46.366859+0000","last_clean_scrub_stamp":"2023-09-28T04:23:46.366859+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:07:57.413533+0000","scrub_duration":0.001760176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376586+0000","last_change":"2023-09-28T04:23:18.386681+0000","last_active":"2023-09-28T04:23:19.376586+0000","last_peered":"2023-09-28T04:23:19.376586+0000","last_clean":"2023-09-28T04:23:19.376586+0000","last_became_active":"2023-09-28T04:23:18.386380+0000","last_became_peered":"2023-09-28T04:23:18.386380+0000","last_unstale":"2023-09-28T04:23:19.376586+0000","last_undegraded":"2023-09-28T04:23:19.376586+0000","last_fullsized":"2023-09-28T04:23:19.376586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"21'5","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:49.335189+0000","last_change":"2023-09-28T04:23:49.335161+0000","last_active":"2023-09-28T04:23:49.335189+0000","last_peered":"2023-09-28T04:23:49.335189+0000","last_clean":"2023-09-28T04:23:49.335189+0000","last_became_active":"2023-09-28T04:23:17.918116+0000","last_became_peered":"2023-09-28T04:23:17.918116+0000","last_unstale":"2023-09-28T04:23:49.335189+0000","last_undegraded":"2023-09-28T04:23:49.335189+0000","last_fullsized":"2023-09-28T04:23:49.335189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'5","last_scrub_stamp":"2023-09-28T04:23:49.335088+0000","last_deep_scrub":"21'5","last_deep_scrub_stamp":"2023-09-28T04:23:49.335088+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.335088+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:33.998499+0000","scrub_duration":0.002053263,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:20.172442+0000","last_change":"2023-09-28T04:23:18.385213+0000","last_active":"2023-09-28T04:23:20.172442+0000","last_peered":"2023-09-28T04:23:20.172442+0000","last_clean":"2023-09-28T04:23:20.172442+0000","last_became_active":"2023-09-28T04:23:18.384930+0000","last_became_peered":"2023-09-28T04:23:18.384930+0000","last_unstale":"2023-09-28T04:23:20.172442+0000","last_undegraded":"2023-09-28T04:23:20.172442+0000","last_fullsized":"2023-09-28T04:23:20.172442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:23.384967+0000","last_change":"2023-09-28T04:23:17.905986+0000","last_active":"2023-09-28T04:23:23.384967+0000","last_peered":"2023-09-28T04:23:23.384967+0000","last_clean":"2023-09-28T04:23:23.384967+0000","last_became_active":"2023-09-28T04:23:17.905667+0000","last_became_peered":"2023-09-28T04:23:17.905667+0000","last_unstale":"2023-09-28T04:23:23.384967+0000","last_undegraded":"2023-09-28T04:23:23.384967+0000","last_fullsized":"2023-09-28T04:23:23.384967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376625+0000","last_change":"2023-09-28T04:23:18.400970+0000","last_active":"2023-09-28T04:23:19.376625+0000","last_peered":"2023-09-28T04:23:19.376625+0000","last_clean":"2023-09-28T04:23:19.376625+0000","last_became_active":"2023-09-28T04:23:18.400683+0000","last_became_peered":"2023-09-28T04:23:18.400683+0000","last_unstale":"2023-09-28T04:23:19.376625+0000","last_undegraded":"2023-09-28T04:23:19.376625+0000","last_fullsized":"2023-09-28T04:23:19.376625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.440606+0000","last_change":"2023-09-28T04:23:17.905162+0000","last_active":"2023-09-28T04:23:33.440606+0000","last_peered":"2023-09-28T04:23:33.440606+0000","last_clean":"2023-09-28T04:23:33.440606+0000","last_became_active":"2023-09-28T04:23:17.904895+0000","last_became_peered":"2023-09-28T04:23:17.904895+0000","last_unstale":"2023-09-28T04:23:33.440606+0000","last_undegraded":"2023-09-28T04:23:33.440606+0000","last_fullsized":"2023-09-28T04:23:33.440606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377397+0000","last_change":"2023-09-28T04:23:18.400714+0000","last_active":"2023-09-28T04:23:19.377397+0000","last_peered":"2023-09-28T04:23:19.377397+0000","last_clean":"2023-09-28T04:23:19.377397+0000","last_became_active":"2023-09-28T04:23:18.400410+0000","last_became_peered":"2023-09-28T04:23:18.400410+0000","last_unstale":"2023-09-28T04:23:19.377397+0000","last_undegraded":"2023-09-28T04:23:19.377397+0000","last_fullsized":"2023-09-28T04:23:19.377397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.442551+0000","last_change":"2023-09-28T04:23:17.905493+0000","last_active":"2023-09-28T04:23:33.442551+0000","last_peered":"2023-09-28T04:23:33.442551+0000","last_clean":"2023-09-28T04:23:33.442551+0000","last_became_active":"2023-09-28T04:23:17.905198+0000","last_became_peered":"2023-09-28T04:23:17.905198+0000","last_unstale":"2023-09-28T04:23:33.442551+0000","last_undegraded":"2023-09-28T04:23:33.442551+0000","last_fullsized":"2023-09-28T04:23:33.442551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376030+0000","last_change":"2023-09-28T04:23:18.393194+0000","last_active":"2023-09-28T04:23:19.376030+0000","last_peered":"2023-09-28T04:23:19.376030+0000","last_clean":"2023-09-28T04:23:19.376030+0000","last_became_active":"2023-09-28T04:23:18.392400+0000","last_became_peered":"2023-09-28T04:23:18.392400+0000","last_unstale":"2023-09-28T04:23:19.376030+0000","last_undegraded":"2023-09-28T04:23:19.376030+0000","last_fullsized":"2023-09-28T04:23:19.376030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'9","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:33.439062+0000","last_change":"2023-09-28T04:23:17.917604+0000","last_active":"2023-09-28T04:23:33.439062+0000","last_peered":"2023-09-28T04:23:33.439062+0000","last_clean":"2023-09-28T04:23:33.439062+0000","last_became_active":"2023-09-28T04:23:17.917266+0000","last_became_peered":"2023-09-28T04:23:17.917266+0000","last_unstale":"2023-09-28T04:23:33.439062+0000","last_undegraded":"2023-09-28T04:23:33.439062+0000","last_fullsized":"2023-09-28T04:23:33.439062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377100+0000","last_change":"2023-09-28T04:23:18.386391+0000","last_active":"2023-09-28T04:23:19.377100+0000","last_peered":"2023-09-28T04:23:19.377100+0000","last_clean":"2023-09-28T04:23:19.377100+0000","last_became_active":"2023-09-28T04:23:18.386051+0000","last_became_peered":"2023-09-28T04:23:18.386051+0000","last_unstale":"2023-09-28T04:23:19.377100+0000","last_undegraded":"2023-09-28T04:23:19.377100+0000","last_fullsized":"2023-09-28T04:23:19.377100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-28T04:23:18.392882+0000","last_change":"2023-09-28T04:23:18.389600+0000","last_active":"2023-09-28T04:23:18.392882+0000","last_peered":"2023-09-28T04:23:18.392882+0000","last_clean":"2023-09-28T04:23:18.392882+0000","last_became_active":"2023-09-28T04:23:18.389280+0000","last_became_peered":"2023-09-28T04:23:18.389280+0000","last_unstale":"2023-09-28T04:23:18.392882+0000","last_undegraded":"2023-09-28T04:23:18.392882+0000","last_fullsized":"2023-09-28T04:23:18.392882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:14:47.697305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.375795+0000","last_change":"2023-09-28T04:23:18.392980+0000","last_active":"2023-09-28T04:23:19.375795+0000","last_peered":"2023-09-28T04:23:19.375795+0000","last_clean":"2023-09-28T04:23:19.375795+0000","last_became_active":"2023-09-28T04:23:18.390929+0000","last_became_peered":"2023-09-28T04:23:18.390929+0000","last_unstale":"2023-09-28T04:23:19.375795+0000","last_undegraded":"2023-09-28T04:23:19.375795+0000","last_fullsized":"2023-09-28T04:23:19.375795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.377157+0000","last_change":"2023-09-28T04:23:18.387348+0000","last_active":"2023-09-28T04:23:19.377157+0000","last_peered":"2023-09-28T04:23:19.377157+0000","last_clean":"2023-09-28T04:23:19.377157+0000","last_became_active":"2023-09-28T04:23:18.385870+0000","last_became_peered":"2023-09-28T04:23:18.385870+0000","last_unstale":"2023-09-28T04:23:19.377157+0000","last_undegraded":"2023-09-28T04:23:19.377157+0000","last_fullsized":"2023-09-28T04:23:19.377157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.376390+0000","last_change":"2023-09-28T04:23:18.392534+0000","last_active":"2023-09-28T04:23:19.376390+0000","last_peered":"2023-09-28T04:23:19.376390+0000","last_clean":"2023-09-28T04:23:19.376390+0000","last_became_active":"2023-09-28T04:23:18.392245+0000","last_became_peered":"2023-09-28T04:23:18.392245+0000","last_unstale":"2023-09-28T04:23:19.376390+0000","last_undegraded":"2023-09-28T04:23:19.376390+0000","last_fullsized":"2023-09-28T04:23:19.376390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-28T04:23:19.450682+0000","last_change":"2023-09-28T04:23:18.391490+0000","last_active":"2023-09-28T04:23:19.450682+0000","last_peered":"2023-09-28T04:23:19.450682+0000","last_clean":"2023-09-28T04:23:19.450682+0000","last_became_active":"2023-09-28T04:23:18.391256+0000","last_became_peered":"2023-09-28T04:23:18.391256+0000","last_unstale":"2023-09-28T04:23:19.450682+0000","last_undegraded":"2023-09-28T04:23:19.450682+0000","last_fullsized":"2023-09-28T04:23:19.450682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4966,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":9932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8960,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362880,"statfs":{"total":96636764160,"available":96627589120,"internally_reserved":0,"allocated":319488,"data_stored":672443,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8356,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363484,"statfs":{"total":96636764160,"available":96628207616,"internally_reserved":0,"allocated":225280,"data_stored":79341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8412,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363428,"statfs":{"total":96636764160,"available":96628150272,"internally_reserved":0,"allocated":217088,"data_stored":79229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9020,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362820,"statfs":{"total":96636764160,"available":96627527680,"internally_reserved":0,"allocated":315392,"data_stored":671051,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8352,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363488,"statfs":{"total":96636764160,"available":96628211712,"internally_reserved":0,"allocated":221184,"data_stored":79319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8428,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363412,"statfs":{"total":96636764160,"available":96628133888,"internally_reserved":0,"allocated":233472,"data_stored":80449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8520,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363320,"statfs":{"total":96636764160,"available":96628039680,"internally_reserved":0,"allocated":262144,"data_stored":82149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8432,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363408,"statfs":{"total":96636764160,"available":96628129792,"internally_reserved":0,"allocated":237568,"data_stored":80519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T04:23:50.846 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.846 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.846 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.846 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.847 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.847 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.847 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.847 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.847 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.848 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.848 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.848 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.848 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.848 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.849 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.849 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.849 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.849 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.849 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.850 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.850 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.850 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.850 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.850 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.850 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.851 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.851 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.851 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.851 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.851 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.851 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.852 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.852 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.852 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.852 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.852 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.852 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.853 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.853 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.853 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.853 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.853 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.854 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.854 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.854 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.854 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.854 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.854 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.855 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.855 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.855 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.855 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.855 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.855 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.856 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.856 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.856 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.856 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.856 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.857 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.857 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.857 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.857 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.857 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.857 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.858 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.858 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.858 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-28T04:23:11.593117+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=11, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.858 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.858 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.858 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.859 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.859 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-28T04:23:11.593117+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=11, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.859 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-28T04:23:10.587579+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=10, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.859 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.859 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.860 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-28T04:23:11.593117+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=11, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.860 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.860 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-28T04:23:11.593117+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=11, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.860 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.860 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.860 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.861 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.861 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-28T04:23:11.593117+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=11, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.861 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.861 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.861 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.861 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.862 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.862 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.862 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.862 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.862 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.863 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.863 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.863 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.863 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.863 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.863 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:23:50.864 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T04:23:51.823 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T04:23:51.828 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T04:24:10.865 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T04:24:11.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.070+0000 7f6f2a9ff700 1 Processor -- start 2023-09-28T04:24:11.071 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.070+0000 7f6f2a9ff700 1 -- start start 2023-09-28T04:24:11.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.071+0000 7f6f2a9ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6f240c5e30 0x7f6f24156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:11.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.071+0000 7f6f2a9ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6f240c4ab0 0x7f6f240c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:11.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.071+0000 7f6f2a9ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f240c73e0 con 0x7f6f240c6200 2023-09-28T04:24:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.071+0000 7f6f2a9ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f240c0b60 con 0x7f6f240c4ab0 2023-09-28T04:24:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.071+0000 7f6f2a9ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f240c67d0 con 0x7f6f240c5e30 2023-09-28T04:24:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.071+0000 7f6f237fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6f240c4ab0 0x7f6f240c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.071+0000 7f6f237fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6f240c4ab0 0x7f6f240c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58496/0 (socket says 172.21.15.118:58496) 2023-09-28T04:24:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.071+0000 7f6f237fe700 1 -- 172.21.15.118:0/1659979905 learned_addr learned my addr 172.21.15.118:0/1659979905 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:11.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.071+0000 7f6f23fff700 1 --2- 172.21.15.118:0/1659979905 >> v2:172.21.15.174:3300/0 conn(0x7f6f240c5e30 0x7f6f24156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:11.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.072+0000 7f6f237fe700 1 -- 172.21.15.118:0/1659979905 >> v2:172.21.15.174:3300/0 conn(0x7f6f240c5e30 msgr2=0x7f6f24156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:24:11.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.072+0000 7f6f237fe700 1 --2- 172.21.15.118:0/1659979905 >> v2:172.21.15.174:3300/0 conn(0x7f6f240c5e30 0x7f6f24156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:11.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.072+0000 7f6f237fe700 1 -- 172.21.15.118:0/1659979905 >> v1:172.21.15.174:6789/0 conn(0x7f6f240c6200 legacy=0x7f6f24159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:11.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.072+0000 7f6f237fe700 1 -- 172.21.15.118:0/1659979905 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f240c6ab0 con 0x7f6f240c4ab0 2023-09-28T04:24:11.075 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.072+0000 7f6f237fe700 1 --2- 172.21.15.118:0/1659979905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f240c4ab0 0x7f6f240c9fb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6f240711e0 tx=0x7f6f18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fcf8f5668754a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:11.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.072+0000 7f6f22ffd700 1 -- 172.21.15.118:0/1659979905 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18009e70 con 0x7f6f240c4ab0 2023-09-28T04:24:11.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.072+0000 7f6f22ffd700 1 -- 172.21.15.118:0/1659979905 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1800b8f0 con 0x7f6f240c4ab0 2023-09-28T04:24:11.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.072+0000 7f6f22ffd700 1 -- 172.21.15.118:0/1659979905 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800bc90 con 0x7f6f240c4ab0 2023-09-28T04:24:11.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.073+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/1659979905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f240c4ab0 msgr2=0x7f6f240c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:11.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.073+0000 7f6f2a9ff700 1 --2- 172.21.15.118:0/1659979905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f240c4ab0 0x7f6f240c9fb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6f240711e0 tx=0x7f6f18009250 comp rx=0 tx=0).stop 2023-09-28T04:24:11.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.073+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/1659979905 shutdown_connections 2023-09-28T04:24:11.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.073+0000 7f6f2a9ff700 1 --2- 172.21.15.118:0/1659979905 >> v2:172.21.15.174:3300/0 conn(0x7f6f240c5e30 0x7f6f24156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:11.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.073+0000 7f6f2a9ff700 1 --2- 172.21.15.118:0/1659979905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f240c4ab0 0x7f6f240c9fb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:11.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.073+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/1659979905 >> 172.21.15.118:0/1659979905 conn(0x7f6f24063230 msgr2=0x7f6f24063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:11.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.073+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/1659979905 shutdown_connections 2023-09-28T04:24:11.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.073+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/1659979905 wait complete. 2023-09-28T04:24:11.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.075+0000 7f6f2a9ff700 1 Processor -- start 2023-09-28T04:24:11.078 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.075+0000 7f6f2a9ff700 1 -- start start 2023-09-28T04:24:11.079 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.076+0000 7f6f2a9ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f240c4ab0 0x7f6f24149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:11.080 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.076+0000 7f6f2a9ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f240c5e30 0x7f6f24166960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:11.080 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.076+0000 7f6f2a9ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f240c6200 0x7f6f240c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:11.080 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.076+0000 7f6f2a9ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240c8bb0 con 0x7f6f240c4ab0 2023-09-28T04:24:11.080 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.076+0000 7f6f2a9ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f241496a0 con 0x7f6f240c5e30 2023-09-28T04:24:11.080 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.076+0000 7f6f2a9ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240c96c0 con 0x7f6f240c6200 2023-09-28T04:24:11.080 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.077+0000 7f6f23fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f240c4ab0 0x7f6f24149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:11.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.077+0000 7f6f23fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f240c4ab0 0x7f6f24149b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58500/0 (socket says 172.21.15.118:58500) 2023-09-28T04:24:11.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.077+0000 7f6f23fff700 1 -- 172.21.15.118:0/952613026 learned_addr learned my addr 172.21.15.118:0/952613026 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:11.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.077+0000 7f6f237fe700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f240c5e30 0x7f6f24166960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:11.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.077+0000 7f6f28f9c700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f240c6200 0x7f6f240c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:11.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.077+0000 7f6f23fff700 1 -- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f240c6200 msgr2=0x7f6f240c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:11.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.077+0000 7f6f23fff700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f240c6200 0x7f6f240c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:11.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.077+0000 7f6f23fff700 1 -- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f240c5e30 msgr2=0x7f6f24166960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:11.082 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.077+0000 7f6f23fff700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f240c5e30 0x7f6f24166960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:11.082 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.077+0000 7f6f23fff700 1 -- 172.21.15.118:0/952613026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f180094f0 con 0x7f6f240c4ab0 2023-09-28T04:24:11.082 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.077+0000 7f6f23fff700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f240c4ab0 0x7f6f24149b30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400ec80 tx=0x7f6f14009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:11.082 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.077+0000 7f6f0bfff700 1 -- 172.21.15.118:0/952613026 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1400c8e0 con 0x7f6f240c4ab0 2023-09-28T04:24:11.082 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.078+0000 7f6f0bfff700 1 -- 172.21.15.118:0/952613026 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1400ca40 con 0x7f6f240c4ab0 2023-09-28T04:24:11.082 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.078+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/952613026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f240c99a0 con 0x7f6f240c4ab0 2023-09-28T04:24:11.082 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.078+0000 7f6f0bfff700 1 -- 172.21.15.118:0/952613026 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1400cdc0 con 0x7f6f240c4ab0 2023-09-28T04:24:11.082 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.078+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/952613026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f24149330 con 0x7f6f240c4ab0 2023-09-28T04:24:11.083 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.079+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/952613026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f24148eb0 con 0x7f6f240c4ab0 2023-09-28T04:24:11.083 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.080+0000 7f6f0bfff700 1 -- 172.21.15.118:0/952613026 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6f14013680 con 0x7f6f240c4ab0 2023-09-28T04:24:11.084 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.080+0000 7f6f0bfff700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6f10067330 0x7f6f100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:11.084 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.080+0000 7f6f0bfff700 1 -- 172.21.15.118:0/952613026 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f6f14085260 con 0x7f6f240c4ab0 2023-09-28T04:24:11.084 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.081+0000 7f6f237fe700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6f10067330 0x7f6f100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:11.084 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.081+0000 7f6f237fe700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6f10067330 0x7f6f100697e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6f240711e0 tx=0x7f6f18017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:11.085 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.085+0000 7f6f0bfff700 1 -- 172.21.15.118:0/952613026 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6f24148eb0 con 0x7f6f240c4ab0 2023-09-28T04:24:11.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.272+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/952613026 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f24148eb0 con 0x7f6f10067330 2023-09-28T04:24:11.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.281+0000 7f6f0bfff700 1 -- 172.21.15.118:0/952613026 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284037 (secure 0 0 0) 0x7f6f24148eb0 con 0x7f6f10067330 2023-09-28T04:24:11.285 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:24:11.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.285+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6f10067330 msgr2=0x7f6f100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:11.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.285+0000 7f6f2a9ff700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6f10067330 0x7f6f100697e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6f240711e0 tx=0x7f6f18017000 comp rx=0 tx=0).stop 2023-09-28T04:24:11.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.285+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/952613026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f240c4ab0 msgr2=0x7f6f24149b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:11.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.285+0000 7f6f2a9ff700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f240c4ab0 0x7f6f24149b30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400ec80 tx=0x7f6f14009120 comp rx=0 tx=0).stop 2023-09-28T04:24:11.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.285+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/952613026 shutdown_connections 2023-09-28T04:24:11.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.285+0000 7f6f2a9ff700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f6f10067330 0x7f6f100697e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:11.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.285+0000 7f6f2a9ff700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f240c6200 0x7f6f240c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:11.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.285+0000 7f6f2a9ff700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f240c4ab0 0x7f6f24149b30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:11.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.285+0000 7f6f2a9ff700 1 --2- 172.21.15.118:0/952613026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f240c5e30 0x7f6f24166960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:11.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.285+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/952613026 >> 172.21.15.118:0/952613026 conn(0x7f6f24063230 msgr2=0x7f6f2414cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:11.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.285+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/952613026 shutdown_connections 2023-09-28T04:24:11.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:11.285+0000 7f6f2a9ff700 1 -- 172.21.15.118:0/952613026 wait complete. 2023-09-28T04:24:11.289 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-09-28T04:24:11.303 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2023-09-28T04:24:10.538673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595334,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":284,"num_write_kb":2451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69056,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":66816,"kb_avail":754905664,"statfs":{"total":773094113280,"available":773023399936,"internally_reserved":0,"allocated":2228224,"data_stored":1926020,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68419584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001724"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958623+0000","last_change":"2023-09-28T04:23:57.902240+0000","last_active":"2023-09-28T04:24:04.958623+0000","last_peered":"2023-09-28T04:24:04.958623+0000","last_clean":"2023-09-28T04:24:04.958623+0000","last_became_active":"2023-09-28T04:23:18.400107+0000","last_became_peered":"2023-09-28T04:23:18.400107+0000","last_unstale":"2023-09-28T04:24:04.958623+0000","last_undegraded":"2023-09-28T04:24:04.958623+0000","last_fullsized":"2023-09-28T04:24:04.958623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:57.902154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:57.902154+0000","last_clean_scrub_stamp":"2023-09-28T04:23:57.902154+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:54.355143+0000","scrub_duration":0.001620238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960860+0000","last_change":"2023-09-28T04:23:18.385136+0000","last_active":"2023-09-28T04:24:04.960860+0000","last_peered":"2023-09-28T04:24:04.960860+0000","last_clean":"2023-09-28T04:24:04.960860+0000","last_became_active":"2023-09-28T04:23:18.384789+0000","last_became_peered":"2023-09-28T04:23:18.384789+0000","last_unstale":"2023-09-28T04:24:04.960860+0000","last_undegraded":"2023-09-28T04:24:04.960860+0000","last_fullsized":"2023-09-28T04:24:04.960860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958381+0000","last_change":"2023-09-28T04:23:18.393700+0000","last_active":"2023-09-28T04:24:04.958381+0000","last_peered":"2023-09-28T04:24:04.958381+0000","last_clean":"2023-09-28T04:24:04.958381+0000","last_became_active":"2023-09-28T04:23:18.390599+0000","last_became_peered":"2023-09-28T04:23:18.390599+0000","last_unstale":"2023-09-28T04:24:04.958381+0000","last_undegraded":"2023-09-28T04:24:04.958381+0000","last_fullsized":"2023-09-28T04:24:04.958381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980319+0000","last_change":"2023-09-28T04:24:02.002562+0000","last_active":"2023-09-28T04:24:04.980319+0000","last_peered":"2023-09-28T04:24:04.980319+0000","last_clean":"2023-09-28T04:24:04.980319+0000","last_became_active":"2023-09-28T04:23:18.390607+0000","last_became_peered":"2023-09-28T04:23:18.390607+0000","last_unstale":"2023-09-28T04:24:04.980319+0000","last_undegraded":"2023-09-28T04:24:04.980319+0000","last_fullsized":"2023-09-28T04:24:04.980319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:02.002433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:02.002433+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.002433+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:59.844481+0000","scrub_duration":0.0021539319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:05.980718+0000","last_change":"2023-09-28T04:24:05.980718+0000","last_active":"2023-09-28T04:24:05.980718+0000","last_peered":"2023-09-28T04:24:05.980718+0000","last_clean":"2023-09-28T04:24:05.980718+0000","last_became_active":"2023-09-28T04:24:05.980489+0000","last_became_peered":"2023-09-28T04:24:05.980489+0000","last_unstale":"2023-09-28T04:24:05.980718+0000","last_undegraded":"2023-09-28T04:24:05.980718+0000","last_fullsized":"2023-09-28T04:24:05.980718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958217+0000","last_change":"2023-09-28T04:23:18.393987+0000","last_active":"2023-09-28T04:24:04.958217+0000","last_peered":"2023-09-28T04:24:04.958217+0000","last_clean":"2023-09-28T04:24:04.958217+0000","last_became_active":"2023-09-28T04:23:18.390575+0000","last_became_peered":"2023-09-28T04:23:18.390575+0000","last_unstale":"2023-09-28T04:24:04.958217+0000","last_undegraded":"2023-09-28T04:24:04.958217+0000","last_fullsized":"2023-09-28T04:24:04.958217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979225+0000","last_change":"2023-09-28T04:23:18.396733+0000","last_active":"2023-09-28T04:24:04.979225+0000","last_peered":"2023-09-28T04:24:04.979225+0000","last_clean":"2023-09-28T04:24:04.979225+0000","last_became_active":"2023-09-28T04:23:18.396038+0000","last_became_peered":"2023-09-28T04:23:18.396038+0000","last_unstale":"2023-09-28T04:24:04.979225+0000","last_undegraded":"2023-09-28T04:24:04.979225+0000","last_fullsized":"2023-09-28T04:24:04.979225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960569+0000","last_change":"2023-09-28T04:23:18.388208+0000","last_active":"2023-09-28T04:24:04.960569+0000","last_peered":"2023-09-28T04:24:04.960569+0000","last_clean":"2023-09-28T04:24:04.960569+0000","last_became_active":"2023-09-28T04:23:18.387260+0000","last_became_peered":"2023-09-28T04:23:18.387260+0000","last_unstale":"2023-09-28T04:24:04.960569+0000","last_undegraded":"2023-09-28T04:24:04.960569+0000","last_fullsized":"2023-09-28T04:24:04.960569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962280+0000","last_change":"2023-09-28T04:23:18.403803+0000","last_active":"2023-09-28T04:24:04.962280+0000","last_peered":"2023-09-28T04:24:04.962280+0000","last_clean":"2023-09-28T04:24:04.962280+0000","last_became_active":"2023-09-28T04:23:18.403565+0000","last_became_peered":"2023-09-28T04:23:18.403565+0000","last_unstale":"2023-09-28T04:24:04.962280+0000","last_undegraded":"2023-09-28T04:24:04.962280+0000","last_fullsized":"2023-09-28T04:24:04.962280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960960+0000","last_change":"2023-09-28T04:23:18.392418+0000","last_active":"2023-09-28T04:24:04.960960+0000","last_peered":"2023-09-28T04:24:04.960960+0000","last_clean":"2023-09-28T04:24:04.960960+0000","last_became_active":"2023-09-28T04:23:18.390911+0000","last_became_peered":"2023-09-28T04:23:18.390911+0000","last_unstale":"2023-09-28T04:24:04.960960+0000","last_undegraded":"2023-09-28T04:24:04.960960+0000","last_fullsized":"2023-09-28T04:24:04.960960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958619+0000","last_change":"2023-09-28T04:23:18.393845+0000","last_active":"2023-09-28T04:24:04.958619+0000","last_peered":"2023-09-28T04:24:04.958619+0000","last_clean":"2023-09-28T04:24:04.958619+0000","last_became_active":"2023-09-28T04:23:18.393524+0000","last_became_peered":"2023-09-28T04:23:18.393524+0000","last_unstale":"2023-09-28T04:24:04.958619+0000","last_undegraded":"2023-09-28T04:24:04.958619+0000","last_fullsized":"2023-09-28T04:24:04.958619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958887+0000","last_change":"2023-09-28T04:23:56.891326+0000","last_active":"2023-09-28T04:24:04.958887+0000","last_peered":"2023-09-28T04:24:04.958887+0000","last_clean":"2023-09-28T04:24:04.958887+0000","last_became_active":"2023-09-28T04:23:18.384986+0000","last_became_peered":"2023-09-28T04:23:18.384986+0000","last_unstale":"2023-09-28T04:24:04.958887+0000","last_undegraded":"2023-09-28T04:24:04.958887+0000","last_fullsized":"2023-09-28T04:24:04.958887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:56.891226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:56.891226+0000","last_clean_scrub_stamp":"2023-09-28T04:23:56.891226+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:08:07.937900+0000","scrub_duration":0.0017418970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958728+0000","last_change":"2023-09-28T04:23:54.890454+0000","last_active":"2023-09-28T04:24:04.958728+0000","last_peered":"2023-09-28T04:24:04.958728+0000","last_clean":"2023-09-28T04:24:04.958728+0000","last_became_active":"2023-09-28T04:23:18.402161+0000","last_became_peered":"2023-09-28T04:23:18.402161+0000","last_unstale":"2023-09-28T04:24:04.958728+0000","last_undegraded":"2023-09-28T04:24:04.958728+0000","last_fullsized":"2023-09-28T04:24:04.958728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:54.890326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:54.890326+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.890326+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:49:38.280232+0000","scrub_duration":0.0015513899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960628+0000","last_change":"2023-09-28T04:23:18.387808+0000","last_active":"2023-09-28T04:24:04.960628+0000","last_peered":"2023-09-28T04:24:04.960628+0000","last_clean":"2023-09-28T04:24:04.960628+0000","last_became_active":"2023-09-28T04:23:18.387471+0000","last_became_peered":"2023-09-28T04:23:18.387471+0000","last_unstale":"2023-09-28T04:24:04.960628+0000","last_undegraded":"2023-09-28T04:24:04.960628+0000","last_fullsized":"2023-09-28T04:24:04.960628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979320+0000","last_change":"2023-09-28T04:23:18.396945+0000","last_active":"2023-09-28T04:24:04.979320+0000","last_peered":"2023-09-28T04:24:04.979320+0000","last_clean":"2023-09-28T04:24:04.979320+0000","last_became_active":"2023-09-28T04:23:18.396395+0000","last_became_peered":"2023-09-28T04:23:18.396395+0000","last_unstale":"2023-09-28T04:24:04.979320+0000","last_undegraded":"2023-09-28T04:24:04.979320+0000","last_fullsized":"2023-09-28T04:24:04.979320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958149+0000","last_change":"2023-09-28T04:23:54.995899+0000","last_active":"2023-09-28T04:24:04.958149+0000","last_peered":"2023-09-28T04:24:04.958149+0000","last_clean":"2023-09-28T04:24:04.958149+0000","last_became_active":"2023-09-28T04:23:18.393683+0000","last_became_peered":"2023-09-28T04:23:18.393683+0000","last_unstale":"2023-09-28T04:24:04.958149+0000","last_undegraded":"2023-09-28T04:24:04.958149+0000","last_fullsized":"2023-09-28T04:24:04.958149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:54.995805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:54.995805+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.995805+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:35:31.530749+0000","scrub_duration":0.0019654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962372+0000","last_change":"2023-09-28T04:23:18.402518+0000","last_active":"2023-09-28T04:24:04.962372+0000","last_peered":"2023-09-28T04:24:04.962372+0000","last_clean":"2023-09-28T04:24:04.962372+0000","last_became_active":"2023-09-28T04:23:18.402275+0000","last_became_peered":"2023-09-28T04:23:18.402275+0000","last_unstale":"2023-09-28T04:24:04.962372+0000","last_undegraded":"2023-09-28T04:24:04.962372+0000","last_fullsized":"2023-09-28T04:24:04.962372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958680+0000","last_change":"2023-09-28T04:23:18.395032+0000","last_active":"2023-09-28T04:24:04.958680+0000","last_peered":"2023-09-28T04:24:04.958680+0000","last_clean":"2023-09-28T04:24:04.958680+0000","last_became_active":"2023-09-28T04:23:18.390678+0000","last_became_peered":"2023-09-28T04:23:18.390678+0000","last_unstale":"2023-09-28T04:24:04.958680+0000","last_undegraded":"2023-09-28T04:24:04.958680+0000","last_fullsized":"2023-09-28T04:24:04.958680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958958+0000","last_change":"2023-09-28T04:23:49.794039+0000","last_active":"2023-09-28T04:24:04.958958+0000","last_peered":"2023-09-28T04:24:04.958958+0000","last_clean":"2023-09-28T04:24:04.958958+0000","last_became_active":"2023-09-28T04:23:18.384916+0000","last_became_peered":"2023-09-28T04:23:18.384916+0000","last_unstale":"2023-09-28T04:24:04.958958+0000","last_undegraded":"2023-09-28T04:24:04.958958+0000","last_fullsized":"2023-09-28T04:24:04.958958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:49.793956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:49.793956+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.793956+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:00:36.299231+0000","scrub_duration":0.001933169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958463+0000","last_change":"2023-09-28T04:23:18.386692+0000","last_active":"2023-09-28T04:24:04.958463+0000","last_peered":"2023-09-28T04:24:04.958463+0000","last_clean":"2023-09-28T04:24:04.958463+0000","last_became_active":"2023-09-28T04:23:18.385805+0000","last_became_peered":"2023-09-28T04:23:18.385805+0000","last_unstale":"2023-09-28T04:24:04.958463+0000","last_undegraded":"2023-09-28T04:24:04.958463+0000","last_fullsized":"2023-09-28T04:24:04.958463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979403+0000","last_change":"2023-09-28T04:23:18.400497+0000","last_active":"2023-09-28T04:24:04.979403+0000","last_peered":"2023-09-28T04:24:04.979403+0000","last_clean":"2023-09-28T04:24:04.979403+0000","last_became_active":"2023-09-28T04:23:18.400230+0000","last_became_peered":"2023-09-28T04:23:18.400230+0000","last_unstale":"2023-09-28T04:24:04.979403+0000","last_undegraded":"2023-09-28T04:24:04.979403+0000","last_fullsized":"2023-09-28T04:24:04.979403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961552+0000","last_change":"2023-09-28T04:23:18.391683+0000","last_active":"2023-09-28T04:24:04.961552+0000","last_peered":"2023-09-28T04:24:04.961552+0000","last_clean":"2023-09-28T04:24:04.961552+0000","last_became_active":"2023-09-28T04:23:18.391373+0000","last_became_peered":"2023-09-28T04:23:18.391373+0000","last_unstale":"2023-09-28T04:24:04.961552+0000","last_undegraded":"2023-09-28T04:24:04.961552+0000","last_fullsized":"2023-09-28T04:24:04.961552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957206+0000","last_change":"2023-09-28T04:23:18.393381+0000","last_active":"2023-09-28T04:24:04.957206+0000","last_peered":"2023-09-28T04:24:04.957206+0000","last_clean":"2023-09-28T04:24:04.957206+0000","last_became_active":"2023-09-28T04:23:18.392723+0000","last_became_peered":"2023-09-28T04:23:18.392723+0000","last_unstale":"2023-09-28T04:24:04.957206+0000","last_undegraded":"2023-09-28T04:24:04.957206+0000","last_fullsized":"2023-09-28T04:24:04.957206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979219+0000","last_change":"2023-09-28T04:23:18.402467+0000","last_active":"2023-09-28T04:24:04.979219+0000","last_peered":"2023-09-28T04:24:04.979219+0000","last_clean":"2023-09-28T04:24:04.979219+0000","last_became_active":"2023-09-28T04:23:18.402197+0000","last_became_peered":"2023-09-28T04:23:18.402197+0000","last_unstale":"2023-09-28T04:24:04.979219+0000","last_undegraded":"2023-09-28T04:24:04.979219+0000","last_fullsized":"2023-09-28T04:24:04.979219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961160+0000","last_change":"2023-09-28T04:23:18.389242+0000","last_active":"2023-09-28T04:24:04.961160+0000","last_peered":"2023-09-28T04:24:04.961160+0000","last_clean":"2023-09-28T04:24:04.961160+0000","last_became_active":"2023-09-28T04:23:18.388936+0000","last_became_peered":"2023-09-28T04:23:18.388936+0000","last_unstale":"2023-09-28T04:24:04.961160+0000","last_undegraded":"2023-09-28T04:24:04.961160+0000","last_fullsized":"2023-09-28T04:24:04.961160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961636+0000","last_change":"2023-09-28T04:24:01.069603+0000","last_active":"2023-09-28T04:24:04.961636+0000","last_peered":"2023-09-28T04:24:04.961636+0000","last_clean":"2023-09-28T04:24:04.961636+0000","last_became_active":"2023-09-28T04:23:18.388682+0000","last_became_peered":"2023-09-28T04:23:18.388682+0000","last_unstale":"2023-09-28T04:24:04.961636+0000","last_undegraded":"2023-09-28T04:24:04.961636+0000","last_fullsized":"2023-09-28T04:24:04.961636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:01.069506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:01.069506+0000","last_clean_scrub_stamp":"2023-09-28T04:24:01.069506+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:46.779927+0000","scrub_duration":0.0017421419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960825+0000","last_change":"2023-09-28T04:23:18.391753+0000","last_active":"2023-09-28T04:24:04.960825+0000","last_peered":"2023-09-28T04:24:04.960825+0000","last_clean":"2023-09-28T04:24:04.960825+0000","last_became_active":"2023-09-28T04:23:18.391031+0000","last_became_peered":"2023-09-28T04:23:18.391031+0000","last_unstale":"2023-09-28T04:24:04.960825+0000","last_undegraded":"2023-09-28T04:24:04.960825+0000","last_fullsized":"2023-09-28T04:24:04.960825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958331+0000","last_change":"2023-09-28T04:23:58.912287+0000","last_active":"2023-09-28T04:24:04.958331+0000","last_peered":"2023-09-28T04:24:04.958331+0000","last_clean":"2023-09-28T04:24:04.958331+0000","last_became_active":"2023-09-28T04:23:17.913941+0000","last_became_peered":"2023-09-28T04:23:17.913941+0000","last_unstale":"2023-09-28T04:24:04.958331+0000","last_undegraded":"2023-09-28T04:24:04.958331+0000","last_fullsized":"2023-09-28T04:24:04.958331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:58.912190+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:58.912190+0000","last_clean_scrub_stamp":"2023-09-28T04:23:58.912190+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:08:05.307587+0000","scrub_duration":0.0025180559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957383+0000","last_change":"2023-09-28T04:23:18.390288+0000","last_active":"2023-09-28T04:24:04.957383+0000","last_peered":"2023-09-28T04:24:04.957383+0000","last_clean":"2023-09-28T04:24:04.957383+0000","last_became_active":"2023-09-28T04:23:18.390030+0000","last_became_peered":"2023-09-28T04:23:18.390030+0000","last_unstale":"2023-09-28T04:24:04.957383+0000","last_undegraded":"2023-09-28T04:24:04.957383+0000","last_fullsized":"2023-09-28T04:24:04.957383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"21'2","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962534+0000","last_change":"2023-09-28T04:23:53.085718+0000","last_active":"2023-09-28T04:24:04.962534+0000","last_peered":"2023-09-28T04:24:04.962534+0000","last_clean":"2023-09-28T04:24:04.962534+0000","last_became_active":"2023-09-28T04:23:17.913950+0000","last_became_peered":"2023-09-28T04:23:17.913950+0000","last_unstale":"2023-09-28T04:24:04.962534+0000","last_undegraded":"2023-09-28T04:24:04.962534+0000","last_fullsized":"2023-09-28T04:24:04.962534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'2","last_scrub_stamp":"2023-09-28T04:23:53.085638+0000","last_deep_scrub":"21'2","last_deep_scrub_stamp":"2023-09-28T04:23:53.085638+0000","last_clean_scrub_stamp":"2023-09-28T04:23:53.085638+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:37.749049+0000","scrub_duration":0.0019832040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961961+0000","last_change":"2023-09-28T04:23:18.393402+0000","last_active":"2023-09-28T04:24:04.961961+0000","last_peered":"2023-09-28T04:24:04.961961+0000","last_clean":"2023-09-28T04:24:04.961961+0000","last_became_active":"2023-09-28T04:23:18.393106+0000","last_became_peered":"2023-09-28T04:23:18.393106+0000","last_unstale":"2023-09-28T04:24:04.961961+0000","last_undegraded":"2023-09-28T04:24:04.961961+0000","last_fullsized":"2023-09-28T04:24:04.961961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"21'1","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957087+0000","last_change":"2023-09-28T04:24:00.077099+0000","last_active":"2023-09-28T04:24:04.957087+0000","last_peered":"2023-09-28T04:24:04.957087+0000","last_clean":"2023-09-28T04:24:04.957087+0000","last_became_active":"2023-09-28T04:23:17.910766+0000","last_became_peered":"2023-09-28T04:23:17.910766+0000","last_unstale":"2023-09-28T04:24:04.957087+0000","last_undegraded":"2023-09-28T04:24:04.957087+0000","last_fullsized":"2023-09-28T04:24:04.957087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'1","last_scrub_stamp":"2023-09-28T04:24:00.076945+0000","last_deep_scrub":"21'1","last_deep_scrub_stamp":"2023-09-28T04:24:00.076945+0000","last_clean_scrub_stamp":"2023-09-28T04:24:00.076945+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:53.222003+0000","scrub_duration":0.0016068569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980295+0000","last_change":"2023-09-28T04:24:03.982527+0000","last_active":"2023-09-28T04:24:04.980295+0000","last_peered":"2023-09-28T04:24:04.980295+0000","last_clean":"2023-09-28T04:24:04.980295+0000","last_became_active":"2023-09-28T04:23:18.387581+0000","last_became_peered":"2023-09-28T04:23:18.387581+0000","last_unstale":"2023-09-28T04:24:04.980295+0000","last_undegraded":"2023-09-28T04:24:04.980295+0000","last_fullsized":"2023-09-28T04:24:04.980295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:03.982444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:03.982444+0000","last_clean_scrub_stamp":"2023-09-28T04:24:03.982444+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:12.421076+0000","scrub_duration":0.001244752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962459+0000","last_change":"2023-09-28T04:23:55.393407+0000","last_active":"2023-09-28T04:24:04.962459+0000","last_peered":"2023-09-28T04:24:04.962459+0000","last_clean":"2023-09-28T04:24:04.962459+0000","last_became_active":"2023-09-28T04:23:17.917596+0000","last_became_peered":"2023-09-28T04:23:17.917596+0000","last_unstale":"2023-09-28T04:24:04.962459+0000","last_undegraded":"2023-09-28T04:24:04.962459+0000","last_fullsized":"2023-09-28T04:24:04.962459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:55.393324+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:55.393324+0000","last_clean_scrub_stamp":"2023-09-28T04:23:55.393324+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:03.831956+0000","scrub_duration":0.0023423250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.956954+0000","last_change":"2023-09-28T04:23:18.394460+0000","last_active":"2023-09-28T04:24:04.956954+0000","last_peered":"2023-09-28T04:24:04.956954+0000","last_clean":"2023-09-28T04:24:04.956954+0000","last_became_active":"2023-09-28T04:23:18.391773+0000","last_became_peered":"2023-09-28T04:23:18.391773+0000","last_unstale":"2023-09-28T04:24:04.956954+0000","last_undegraded":"2023-09-28T04:24:04.956954+0000","last_fullsized":"2023-09-28T04:24:04.956954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"21'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960940+0000","last_change":"2023-09-28T04:23:17.908875+0000","last_active":"2023-09-28T04:24:04.960940+0000","last_peered":"2023-09-28T04:24:04.960940+0000","last_clean":"2023-09-28T04:24:04.960940+0000","last_became_active":"2023-09-28T04:23:17.908599+0000","last_became_peered":"2023-09-28T04:23:17.908599+0000","last_unstale":"2023-09-28T04:24:04.960940+0000","last_undegraded":"2023-09-28T04:24:04.960940+0000","last_fullsized":"2023-09-28T04:24:04.960940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957322+0000","last_change":"2023-09-28T04:23:18.393856+0000","last_active":"2023-09-28T04:24:04.957322+0000","last_peered":"2023-09-28T04:24:04.957322+0000","last_clean":"2023-09-28T04:24:04.957322+0000","last_became_active":"2023-09-28T04:23:18.393631+0000","last_became_peered":"2023-09-28T04:23:18.393631+0000","last_unstale":"2023-09-28T04:24:04.957322+0000","last_undegraded":"2023-09-28T04:24:04.957322+0000","last_fullsized":"2023-09-28T04:24:04.957322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979535+0000","last_change":"2023-09-28T04:23:17.911594+0000","last_active":"2023-09-28T04:24:04.979535+0000","last_peered":"2023-09-28T04:24:04.979535+0000","last_clean":"2023-09-28T04:24:04.979535+0000","last_became_active":"2023-09-28T04:23:17.911361+0000","last_became_peered":"2023-09-28T04:23:17.911361+0000","last_unstale":"2023-09-28T04:24:04.979535+0000","last_undegraded":"2023-09-28T04:24:04.979535+0000","last_fullsized":"2023-09-28T04:24:04.979535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961380+0000","last_change":"2023-09-28T04:23:18.387908+0000","last_active":"2023-09-28T04:24:04.961380+0000","last_peered":"2023-09-28T04:24:04.961380+0000","last_clean":"2023-09-28T04:24:04.961380+0000","last_became_active":"2023-09-28T04:23:18.387672+0000","last_became_peered":"2023-09-28T04:23:18.387672+0000","last_unstale":"2023-09-28T04:24:04.961380+0000","last_undegraded":"2023-09-28T04:24:04.961380+0000","last_fullsized":"2023-09-28T04:24:04.961380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'13","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958562+0000","last_change":"2023-09-28T04:24:02.967980+0000","last_active":"2023-09-28T04:24:04.958562+0000","last_peered":"2023-09-28T04:24:04.958562+0000","last_clean":"2023-09-28T04:24:04.958562+0000","last_became_active":"2023-09-28T04:23:17.904734+0000","last_became_peered":"2023-09-28T04:23:17.904734+0000","last_unstale":"2023-09-28T04:24:04.958562+0000","last_undegraded":"2023-09-28T04:24:04.958562+0000","last_fullsized":"2023-09-28T04:24:04.958562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'13","last_scrub_stamp":"2023-09-28T04:24:02.967889+0000","last_deep_scrub":"21'13","last_deep_scrub_stamp":"2023-09-28T04:24:02.967889+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.967889+0000","objects_scrubbed":5,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:23:04.165306+0000","scrub_duration":0.0065805229999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958578+0000","last_change":"2023-09-28T04:23:49.989615+0000","last_active":"2023-09-28T04:24:04.958578+0000","last_peered":"2023-09-28T04:24:04.958578+0000","last_clean":"2023-09-28T04:24:04.958578+0000","last_became_active":"2023-09-28T04:23:18.388871+0000","last_became_peered":"2023-09-28T04:23:18.388871+0000","last_unstale":"2023-09-28T04:24:04.958578+0000","last_undegraded":"2023-09-28T04:24:04.958578+0000","last_fullsized":"2023-09-28T04:24:04.958578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:49.989518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:49.989518+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.989518+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:35.699939+0000","scrub_duration":0.0014560160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'9","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979336+0000","last_change":"2023-09-28T04:23:59.951180+0000","last_active":"2023-09-28T04:24:04.979336+0000","last_peered":"2023-09-28T04:24:04.979336+0000","last_clean":"2023-09-28T04:24:04.979336+0000","last_became_active":"2023-09-28T04:23:17.909981+0000","last_became_peered":"2023-09-28T04:23:17.909981+0000","last_unstale":"2023-09-28T04:24:04.979336+0000","last_undegraded":"2023-09-28T04:24:04.979336+0000","last_fullsized":"2023-09-28T04:24:04.979336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'9","last_scrub_stamp":"2023-09-28T04:23:59.951098+0000","last_deep_scrub":"21'9","last_deep_scrub_stamp":"2023-09-28T04:23:59.951098+0000","last_clean_scrub_stamp":"2023-09-28T04:23:59.951098+0000","objects_scrubbed":4,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:08.389729+0000","scrub_duration":0.0082831610000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:05.962181+0000","last_change":"2023-09-28T04:24:05.962181+0000","last_active":"2023-09-28T04:24:05.962181+0000","last_peered":"2023-09-28T04:24:05.962181+0000","last_clean":"2023-09-28T04:24:05.962181+0000","last_became_active":"2023-09-28T04:24:05.961816+0000","last_became_peered":"2023-09-28T04:24:05.961816+0000","last_unstale":"2023-09-28T04:24:05.962181+0000","last_undegraded":"2023-09-28T04:24:05.962181+0000","last_fullsized":"2023-09-28T04:24:05.962181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961454+0000","last_change":"2023-09-28T04:23:57.340861+0000","last_active":"2023-09-28T04:24:04.961454+0000","last_peered":"2023-09-28T04:24:04.961454+0000","last_clean":"2023-09-28T04:24:04.961454+0000","last_became_active":"2023-09-28T04:23:17.916424+0000","last_became_peered":"2023-09-28T04:23:17.916424+0000","last_unstale":"2023-09-28T04:24:04.961454+0000","last_undegraded":"2023-09-28T04:24:04.961454+0000","last_fullsized":"2023-09-28T04:24:04.961454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:57.340759+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:57.340759+0000","last_clean_scrub_stamp":"2023-09-28T04:23:57.340759+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:43.051180+0000","scrub_duration":0.0023571410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960893+0000","last_change":"2023-09-28T04:23:18.391510+0000","last_active":"2023-09-28T04:24:04.960893+0000","last_peered":"2023-09-28T04:24:04.960893+0000","last_clean":"2023-09-28T04:24:04.960893+0000","last_became_active":"2023-09-28T04:23:18.390613+0000","last_became_peered":"2023-09-28T04:23:18.390613+0000","last_unstale":"2023-09-28T04:24:04.960893+0000","last_undegraded":"2023-09-28T04:24:04.960893+0000","last_fullsized":"2023-09-28T04:24:04.960893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979364+0000","last_change":"2023-09-28T04:24:03.053560+0000","last_active":"2023-09-28T04:24:04.979364+0000","last_peered":"2023-09-28T04:24:04.979364+0000","last_clean":"2023-09-28T04:24:04.979364+0000","last_became_active":"2023-09-28T04:23:17.910457+0000","last_became_peered":"2023-09-28T04:23:17.910457+0000","last_unstale":"2023-09-28T04:24:04.979364+0000","last_undegraded":"2023-09-28T04:24:04.979364+0000","last_fullsized":"2023-09-28T04:24:04.979364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:24:03.053473+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:24:03.053473+0000","last_clean_scrub_stamp":"2023-09-28T04:24:03.053473+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:18.309826+0000","scrub_duration":0.0021293890000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961878+0000","last_change":"2023-09-28T04:23:18.402823+0000","last_active":"2023-09-28T04:24:04.961878+0000","last_peered":"2023-09-28T04:24:04.961878+0000","last_clean":"2023-09-28T04:24:04.961878+0000","last_became_active":"2023-09-28T04:23:18.402559+0000","last_became_peered":"2023-09-28T04:23:18.402559+0000","last_unstale":"2023-09-28T04:24:04.961878+0000","last_undegraded":"2023-09-28T04:24:04.961878+0000","last_fullsized":"2023-09-28T04:24:04.961878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'19","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979016+0000","last_change":"2023-09-28T04:23:54.968698+0000","last_active":"2023-09-28T04:24:04.979016+0000","last_peered":"2023-09-28T04:24:04.979016+0000","last_clean":"2023-09-28T04:24:04.979016+0000","last_became_active":"2023-09-28T04:23:17.910650+0000","last_became_peered":"2023-09-28T04:23:17.910650+0000","last_unstale":"2023-09-28T04:24:04.979016+0000","last_undegraded":"2023-09-28T04:24:04.979016+0000","last_fullsized":"2023-09-28T04:24:04.979016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'19","last_scrub_stamp":"2023-09-28T04:23:54.968612+0000","last_deep_scrub":"21'19","last_deep_scrub_stamp":"2023-09-28T04:23:54.968612+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.968612+0000","objects_scrubbed":8,"log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:31:52.914472+0000","scrub_duration":0.0052817860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957952+0000","last_change":"2023-09-28T04:23:18.395424+0000","last_active":"2023-09-28T04:24:04.957952+0000","last_peered":"2023-09-28T04:24:04.957952+0000","last_clean":"2023-09-28T04:24:04.957952+0000","last_became_active":"2023-09-28T04:23:18.394721+0000","last_became_peered":"2023-09-28T04:23:18.394721+0000","last_unstale":"2023-09-28T04:24:04.957952+0000","last_undegraded":"2023-09-28T04:24:04.957952+0000","last_fullsized":"2023-09-28T04:24:04.957952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979548+0000","last_change":"2023-09-28T04:24:02.004448+0000","last_active":"2023-09-28T04:24:04.979548+0000","last_peered":"2023-09-28T04:24:04.979548+0000","last_clean":"2023-09-28T04:24:04.979548+0000","last_became_active":"2023-09-28T04:23:17.907331+0000","last_became_peered":"2023-09-28T04:23:17.907331+0000","last_unstale":"2023-09-28T04:24:04.979548+0000","last_undegraded":"2023-09-28T04:24:04.979548+0000","last_fullsized":"2023-09-28T04:24:04.979548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:24:02.004356+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:24:02.004356+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.004356+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:47.714777+0000","scrub_duration":0.0031667269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960575+0000","last_change":"2023-09-28T04:23:18.390910+0000","last_active":"2023-09-28T04:24:04.960575+0000","last_peered":"2023-09-28T04:24:04.960575+0000","last_clean":"2023-09-28T04:24:04.960575+0000","last_became_active":"2023-09-28T04:23:18.390633+0000","last_became_peered":"2023-09-28T04:23:18.390633+0000","last_unstale":"2023-09-28T04:24:04.960575+0000","last_undegraded":"2023-09-28T04:24:04.960575+0000","last_fullsized":"2023-09-28T04:24:04.960575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'3","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:07.132164+0000","last_change":"2023-09-28T04:24:07.132123+0000","last_active":"2023-09-28T04:24:07.132164+0000","last_peered":"2023-09-28T04:24:07.132164+0000","last_clean":"2023-09-28T04:24:07.132164+0000","last_became_active":"2023-09-28T04:23:17.906036+0000","last_became_peered":"2023-09-28T04:23:17.906036+0000","last_unstale":"2023-09-28T04:24:07.132164+0000","last_undegraded":"2023-09-28T04:24:07.132164+0000","last_fullsized":"2023-09-28T04:24:07.132164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-09-28T04:24:07.132035+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-09-28T04:24:07.132035+0000","last_clean_scrub_stamp":"2023-09-28T04:24:07.132035+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:35:43.666979+0000","scrub_duration":0.0027056010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958192+0000","last_change":"2023-09-28T04:23:18.386196+0000","last_active":"2023-09-28T04:24:04.958192+0000","last_peered":"2023-09-28T04:24:04.958192+0000","last_clean":"2023-09-28T04:24:04.958192+0000","last_became_active":"2023-09-28T04:23:18.385693+0000","last_became_peered":"2023-09-28T04:23:18.385693+0000","last_unstale":"2023-09-28T04:24:04.958192+0000","last_undegraded":"2023-09-28T04:24:04.958192+0000","last_fullsized":"2023-09-28T04:24:04.958192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'2","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:05.075483+0000","last_change":"2023-09-28T04:24:05.075438+0000","last_active":"2023-09-28T04:24:05.075483+0000","last_peered":"2023-09-28T04:24:05.075483+0000","last_clean":"2023-09-28T04:24:05.075483+0000","last_became_active":"2023-09-28T04:23:17.908493+0000","last_became_peered":"2023-09-28T04:23:17.908493+0000","last_unstale":"2023-09-28T04:24:05.075483+0000","last_undegraded":"2023-09-28T04:24:05.075483+0000","last_fullsized":"2023-09-28T04:24:05.075483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-28T04:24:05.075329+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-28T04:24:05.075329+0000","last_clean_scrub_stamp":"2023-09-28T04:24:05.075329+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:58.220387+0000","scrub_duration":0.0028904540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980151+0000","last_change":"2023-09-28T04:23:59.965660+0000","last_active":"2023-09-28T04:24:04.980151+0000","last_peered":"2023-09-28T04:24:04.980151+0000","last_clean":"2023-09-28T04:24:04.980151+0000","last_became_active":"2023-09-28T04:23:18.385112+0000","last_became_peered":"2023-09-28T04:23:18.385112+0000","last_unstale":"2023-09-28T04:24:04.980151+0000","last_undegraded":"2023-09-28T04:24:04.980151+0000","last_fullsized":"2023-09-28T04:24:04.980151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:59.965563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:59.965563+0000","last_clean_scrub_stamp":"2023-09-28T04:23:59.965563+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:30.361361+0000","scrub_duration":0.0020436289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960810+0000","last_change":"2023-09-28T04:23:59.641629+0000","last_active":"2023-09-28T04:24:04.960810+0000","last_peered":"2023-09-28T04:24:04.960810+0000","last_clean":"2023-09-28T04:24:04.960810+0000","last_became_active":"2023-09-28T04:23:17.898232+0000","last_became_peered":"2023-09-28T04:23:17.898232+0000","last_unstale":"2023-09-28T04:24:04.960810+0000","last_undegraded":"2023-09-28T04:24:04.960810+0000","last_fullsized":"2023-09-28T04:24:04.960810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:59.641543+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:59.641543+0000","last_clean_scrub_stamp":"2023-09-28T04:23:59.641543+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:45.351964+0000","scrub_duration":0.0027926169999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962286+0000","last_change":"2023-09-28T04:23:18.392206+0000","last_active":"2023-09-28T04:24:04.962286+0000","last_peered":"2023-09-28T04:24:04.962286+0000","last_clean":"2023-09-28T04:24:04.962286+0000","last_became_active":"2023-09-28T04:23:18.391963+0000","last_became_peered":"2023-09-28T04:23:18.391963+0000","last_unstale":"2023-09-28T04:24:04.962286+0000","last_undegraded":"2023-09-28T04:24:04.962286+0000","last_fullsized":"2023-09-28T04:24:04.962286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'4","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957603+0000","last_change":"2023-09-28T04:23:53.004623+0000","last_active":"2023-09-28T04:24:04.957603+0000","last_peered":"2023-09-28T04:24:04.957603+0000","last_clean":"2023-09-28T04:24:04.957603+0000","last_became_active":"2023-09-28T04:23:17.905089+0000","last_became_peered":"2023-09-28T04:23:17.905089+0000","last_unstale":"2023-09-28T04:24:04.957603+0000","last_undegraded":"2023-09-28T04:24:04.957603+0000","last_fullsized":"2023-09-28T04:24:04.957603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4","last_scrub_stamp":"2023-09-28T04:23:53.004535+0000","last_deep_scrub":"21'4","last_deep_scrub_stamp":"2023-09-28T04:23:53.004535+0000","last_clean_scrub_stamp":"2023-09-28T04:23:53.004535+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:50.846583+0000","scrub_duration":0.0020402789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958704+0000","last_change":"2023-09-28T04:23:18.400110+0000","last_active":"2023-09-28T04:24:04.958704+0000","last_peered":"2023-09-28T04:24:04.958704+0000","last_clean":"2023-09-28T04:24:04.958704+0000","last_became_active":"2023-09-28T04:23:18.399839+0000","last_became_peered":"2023-09-28T04:23:18.399839+0000","last_unstale":"2023-09-28T04:24:04.958704+0000","last_undegraded":"2023-09-28T04:24:04.958704+0000","last_fullsized":"2023-09-28T04:24:04.958704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"21'1","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980153+0000","last_change":"2023-09-28T04:23:55.943781+0000","last_active":"2023-09-28T04:24:04.980153+0000","last_peered":"2023-09-28T04:24:04.980153+0000","last_clean":"2023-09-28T04:24:04.980153+0000","last_became_active":"2023-09-28T04:23:17.912560+0000","last_became_peered":"2023-09-28T04:23:17.912560+0000","last_unstale":"2023-09-28T04:24:04.980153+0000","last_undegraded":"2023-09-28T04:24:04.980153+0000","last_fullsized":"2023-09-28T04:24:04.980153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'1","last_scrub_stamp":"2023-09-28T04:23:55.943684+0000","last_deep_scrub":"21'1","last_deep_scrub_stamp":"2023-09-28T04:23:55.943684+0000","last_clean_scrub_stamp":"2023-09-28T04:23:55.943684+0000","objects_scrubbed":1,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:08:06.990358+0000","scrub_duration":0.001753884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958701+0000","last_change":"2023-09-28T04:23:18.393554+0000","last_active":"2023-09-28T04:24:04.958701+0000","last_peered":"2023-09-28T04:24:04.958701+0000","last_clean":"2023-09-28T04:24:04.958701+0000","last_became_active":"2023-09-28T04:23:18.390268+0000","last_became_peered":"2023-09-28T04:23:18.390268+0000","last_unstale":"2023-09-28T04:24:04.958701+0000","last_undegraded":"2023-09-28T04:24:04.958701+0000","last_fullsized":"2023-09-28T04:24:04.958701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"21'5","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958284+0000","last_change":"2023-09-28T04:24:03.964617+0000","last_active":"2023-09-28T04:24:04.958284+0000","last_peered":"2023-09-28T04:24:04.958284+0000","last_clean":"2023-09-28T04:24:04.958284+0000","last_became_active":"2023-09-28T04:23:17.910887+0000","last_became_peered":"2023-09-28T04:23:17.910887+0000","last_unstale":"2023-09-28T04:24:04.958284+0000","last_undegraded":"2023-09-28T04:24:04.958284+0000","last_fullsized":"2023-09-28T04:24:04.958284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'5","last_scrub_stamp":"2023-09-28T04:24:03.964445+0000","last_deep_scrub":"21'5","last_deep_scrub_stamp":"2023-09-28T04:24:03.964445+0000","last_clean_scrub_stamp":"2023-09-28T04:24:03.964445+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:17.472237+0000","scrub_duration":0.0046695920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958754+0000","last_change":"2023-09-28T04:23:51.981578+0000","last_active":"2023-09-28T04:24:04.958754+0000","last_peered":"2023-09-28T04:24:04.958754+0000","last_clean":"2023-09-28T04:24:04.958754+0000","last_became_active":"2023-09-28T04:23:18.387667+0000","last_became_peered":"2023-09-28T04:23:18.387667+0000","last_unstale":"2023-09-28T04:24:04.958754+0000","last_undegraded":"2023-09-28T04:24:04.958754+0000","last_fullsized":"2023-09-28T04:24:04.958754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:51.981479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:51.981479+0000","last_clean_scrub_stamp":"2023-09-28T04:23:51.981479+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:07.237832+0000","scrub_duration":0.0013352010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"21'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957012+0000","last_change":"2023-09-28T04:23:56.044349+0000","last_active":"2023-09-28T04:24:04.957012+0000","last_peered":"2023-09-28T04:24:04.957012+0000","last_clean":"2023-09-28T04:24:04.957012+0000","last_became_active":"2023-09-28T04:23:17.911458+0000","last_became_peered":"2023-09-28T04:23:17.911458+0000","last_unstale":"2023-09-28T04:24:04.957012+0000","last_undegraded":"2023-09-28T04:24:04.957012+0000","last_fullsized":"2023-09-28T04:24:04.957012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962709+0000","last_change":"2023-09-28T04:23:56.044482+0000","last_active":"2023-09-28T04:24:04.962709+0000","last_peered":"2023-09-28T04:24:04.962709+0000","last_clean":"2023-09-28T04:24:04.962709+0000","last_became_active":"2023-09-28T04:23:18.399957+0000","last_became_peered":"2023-09-28T04:23:18.399957+0000","last_unstale":"2023-09-28T04:24:04.962709+0000","last_undegraded":"2023-09-28T04:24:04.962709+0000","last_fullsized":"2023-09-28T04:24:04.962709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961872+0000","last_change":"2023-09-28T04:23:49.012182+0000","last_active":"2023-09-28T04:24:04.961872+0000","last_peered":"2023-09-28T04:24:04.961872+0000","last_clean":"2023-09-28T04:24:04.961872+0000","last_became_active":"2023-09-28T04:23:13.017362+0000","last_became_peered":"2023-09-28T04:23:13.017362+0000","last_unstale":"2023-09-28T04:24:04.961872+0000","last_undegraded":"2023-09-28T04:24:04.961872+0000","last_fullsized":"2023-09-28T04:24:04.961872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:49.012108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:49.012108+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.012108+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:10.816331+0000","scrub_duration":0.001277809,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960931+0000","last_change":"2023-09-28T04:23:17.899128+0000","last_active":"2023-09-28T04:24:04.960931+0000","last_peered":"2023-09-28T04:24:04.960931+0000","last_clean":"2023-09-28T04:24:04.960931+0000","last_became_active":"2023-09-28T04:23:17.898878+0000","last_became_peered":"2023-09-28T04:23:17.898878+0000","last_unstale":"2023-09-28T04:24:04.960931+0000","last_undegraded":"2023-09-28T04:24:04.960931+0000","last_fullsized":"2023-09-28T04:24:04.960931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961521+0000","last_change":"2023-09-28T04:23:18.384565+0000","last_active":"2023-09-28T04:24:04.961521+0000","last_peered":"2023-09-28T04:24:04.961521+0000","last_clean":"2023-09-28T04:24:04.961521+0000","last_became_active":"2023-09-28T04:23:18.383969+0000","last_became_peered":"2023-09-28T04:23:18.383969+0000","last_unstale":"2023-09-28T04:24:04.961521+0000","last_undegraded":"2023-09-28T04:24:04.961521+0000","last_fullsized":"2023-09-28T04:24:04.961521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960700+0000","last_change":"2023-09-28T04:23:56.636147+0000","last_active":"2023-09-28T04:24:04.960700+0000","last_peered":"2023-09-28T04:24:04.960700+0000","last_clean":"2023-09-28T04:24:04.960700+0000","last_became_active":"2023-09-28T04:23:12.603804+0000","last_became_peered":"2023-09-28T04:23:12.603804+0000","last_unstale":"2023-09-28T04:24:04.960700+0000","last_undegraded":"2023-09-28T04:24:04.960700+0000","last_fullsized":"2023-09-28T04:24:04.960700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:56.636037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:56.636037+0000","last_clean_scrub_stamp":"2023-09-28T04:23:56.636037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:54.478085+0000","scrub_duration":0.001916528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"21'3","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958472+0000","last_change":"2023-09-28T04:23:17.918999+0000","last_active":"2023-09-28T04:24:04.958472+0000","last_peered":"2023-09-28T04:24:04.958472+0000","last_clean":"2023-09-28T04:24:04.958472+0000","last_became_active":"2023-09-28T04:23:17.918740+0000","last_became_peered":"2023-09-28T04:23:17.918740+0000","last_unstale":"2023-09-28T04:24:04.958472+0000","last_undegraded":"2023-09-28T04:24:04.958472+0000","last_fullsized":"2023-09-28T04:24:04.958472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961947+0000","last_change":"2023-09-28T04:24:02.073340+0000","last_active":"2023-09-28T04:24:04.961947+0000","last_peered":"2023-09-28T04:24:04.961947+0000","last_clean":"2023-09-28T04:24:04.961947+0000","last_became_active":"2023-09-28T04:23:18.389059+0000","last_became_peered":"2023-09-28T04:23:18.389059+0000","last_unstale":"2023-09-28T04:24:04.961947+0000","last_undegraded":"2023-09-28T04:24:04.961947+0000","last_fullsized":"2023-09-28T04:24:04.961947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:02.073236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:02.073236+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.073236+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:17.329589+0000","scrub_duration":0.001749675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958963+0000","last_change":"2023-09-28T04:23:47.823943+0000","last_active":"2023-09-28T04:24:04.958963+0000","last_peered":"2023-09-28T04:24:04.958963+0000","last_clean":"2023-09-28T04:24:04.958963+0000","last_became_active":"2023-09-28T04:23:12.601652+0000","last_became_peered":"2023-09-28T04:23:12.601652+0000","last_unstale":"2023-09-28T04:24:04.958963+0000","last_undegraded":"2023-09-28T04:24:04.958963+0000","last_fullsized":"2023-09-28T04:24:04.958963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:47.823864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:47.823864+0000","last_clean_scrub_stamp":"2023-09-28T04:23:47.823864+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:46:58.420448+0000","scrub_duration":0.0014653960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962209+0000","last_change":"2023-09-28T04:23:51.025577+0000","last_active":"2023-09-28T04:24:04.962209+0000","last_peered":"2023-09-28T04:24:04.962209+0000","last_clean":"2023-09-28T04:24:04.962209+0000","last_became_active":"2023-09-28T04:23:17.911308+0000","last_became_peered":"2023-09-28T04:23:17.911308+0000","last_unstale":"2023-09-28T04:24:04.962209+0000","last_undegraded":"2023-09-28T04:24:04.962209+0000","last_fullsized":"2023-09-28T04:24:04.962209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:51.025504+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:51.025504+0000","last_clean_scrub_stamp":"2023-09-28T04:23:51.025504+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:47.478493+0000","scrub_duration":0.0017633309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961254+0000","last_change":"2023-09-28T04:24:04.013915+0000","last_active":"2023-09-28T04:24:04.961254+0000","last_peered":"2023-09-28T04:24:04.961254+0000","last_clean":"2023-09-28T04:24:04.961254+0000","last_became_active":"2023-09-28T04:23:18.387945+0000","last_became_peered":"2023-09-28T04:23:18.387945+0000","last_unstale":"2023-09-28T04:24:04.961254+0000","last_undegraded":"2023-09-28T04:24:04.961254+0000","last_fullsized":"2023-09-28T04:24:04.961254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:04.013825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:04.013825+0000","last_clean_scrub_stamp":"2023-09-28T04:24:04.013825+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:57.158883+0000","scrub_duration":0.0018077939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960722+0000","last_change":"2023-09-28T04:23:57.656015+0000","last_active":"2023-09-28T04:24:04.960722+0000","last_peered":"2023-09-28T04:24:04.960722+0000","last_clean":"2023-09-28T04:24:04.960722+0000","last_became_active":"2023-09-28T04:23:12.603930+0000","last_became_peered":"2023-09-28T04:23:12.603930+0000","last_unstale":"2023-09-28T04:24:04.960722+0000","last_undegraded":"2023-09-28T04:24:04.960722+0000","last_fullsized":"2023-09-28T04:24:04.960722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:57.655933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:57.655933+0000","last_clean_scrub_stamp":"2023-09-28T04:23:57.655933+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:06.094564+0000","scrub_duration":0.0020224029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"21'119","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979187+0000","last_change":"2023-09-28T04:23:50.766454+0000","last_active":"2023-09-28T04:24:04.979187+0000","last_peered":"2023-09-28T04:24:04.979187+0000","last_clean":"2023-09-28T04:24:04.979187+0000","last_became_active":"2023-09-28T04:23:11.608249+0000","last_became_peered":"2023-09-28T04:23:11.608249+0000","last_unstale":"2023-09-28T04:24:04.979187+0000","last_undegraded":"2023-09-28T04:24:04.979187+0000","last_fullsized":"2023-09-28T04:24:04.979187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'119","last_scrub_stamp":"2023-09-28T04:23:50.766319+0000","last_deep_scrub":"21'119","last_deep_scrub_stamp":"2023-09-28T04:23:50.766319+0000","last_clean_scrub_stamp":"2023-09-28T04:23:50.766319+0000","objects_scrubbed":2,"log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:08:01.812993+0000","scrub_duration":0.0050644219999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957100+0000","last_change":"2023-09-28T04:23:58.005588+0000","last_active":"2023-09-28T04:24:04.957100+0000","last_peered":"2023-09-28T04:24:04.957100+0000","last_clean":"2023-09-28T04:24:04.957100+0000","last_became_active":"2023-09-28T04:23:17.902341+0000","last_became_peered":"2023-09-28T04:23:17.902341+0000","last_unstale":"2023-09-28T04:24:04.957100+0000","last_undegraded":"2023-09-28T04:24:04.957100+0000","last_fullsized":"2023-09-28T04:24:04.957100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'1","last_scrub_stamp":"2023-09-28T04:23:58.005486+0000","last_deep_scrub":"21'1","last_deep_scrub_stamp":"2023-09-28T04:23:58.005486+0000","last_clean_scrub_stamp":"2023-09-28T04:23:58.005486+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:13.261839+0000","scrub_duration":0.0018512579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980195+0000","last_change":"2023-09-28T04:23:59.007251+0000","last_active":"2023-09-28T04:24:04.980195+0000","last_peered":"2023-09-28T04:24:04.980195+0000","last_clean":"2023-09-28T04:24:04.980195+0000","last_became_active":"2023-09-28T04:23:18.389692+0000","last_became_peered":"2023-09-28T04:23:18.389692+0000","last_unstale":"2023-09-28T04:24:04.980195+0000","last_undegraded":"2023-09-28T04:24:04.980195+0000","last_fullsized":"2023-09-28T04:24:04.980195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:59.007146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:59.007146+0000","last_clean_scrub_stamp":"2023-09-28T04:23:59.007146+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:43.670556+0000","scrub_duration":0.0017131609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979292+0000","last_change":"2023-09-28T04:23:51.802452+0000","last_active":"2023-09-28T04:24:04.979292+0000","last_peered":"2023-09-28T04:24:04.979292+0000","last_clean":"2023-09-28T04:24:04.979292+0000","last_became_active":"2023-09-28T04:23:12.605668+0000","last_became_peered":"2023-09-28T04:23:12.605668+0000","last_unstale":"2023-09-28T04:24:04.979292+0000","last_undegraded":"2023-09-28T04:24:04.979292+0000","last_fullsized":"2023-09-28T04:24:04.979292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:51.802351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:51.802351+0000","last_clean_scrub_stamp":"2023-09-28T04:23:51.802351+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:48.255340+0000","scrub_duration":0.0022909250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"21'4","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961258+0000","last_change":"2023-09-28T04:23:47.343034+0000","last_active":"2023-09-28T04:24:04.961258+0000","last_peered":"2023-09-28T04:24:04.961258+0000","last_clean":"2023-09-28T04:24:04.961258+0000","last_became_active":"2023-09-28T04:23:17.918130+0000","last_became_peered":"2023-09-28T04:23:17.918130+0000","last_unstale":"2023-09-28T04:24:04.961258+0000","last_undegraded":"2023-09-28T04:24:04.961258+0000","last_fullsized":"2023-09-28T04:24:04.961258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4","last_scrub_stamp":"2023-09-28T04:23:47.342937+0000","last_deep_scrub":"21'4","last_deep_scrub_stamp":"2023-09-28T04:23:47.342937+0000","last_clean_scrub_stamp":"2023-09-28T04:23:47.342937+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:43.795926+0000","scrub_duration":0.0023882230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:07.188744+0000","last_change":"2023-09-28T04:24:07.188712+0000","last_active":"2023-09-28T04:24:07.188744+0000","last_peered":"2023-09-28T04:24:07.188744+0000","last_clean":"2023-09-28T04:24:07.188744+0000","last_became_active":"2023-09-28T04:23:18.391709+0000","last_became_peered":"2023-09-28T04:23:18.391709+0000","last_unstale":"2023-09-28T04:24:07.188744+0000","last_undegraded":"2023-09-28T04:24:07.188744+0000","last_fullsized":"2023-09-28T04:24:07.188744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:07.188594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:07.188594+0000","last_clean_scrub_stamp":"2023-09-28T04:24:07.188594+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:08:13.583991+0000","scrub_duration":0.0016524879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979559+0000","last_change":"2023-09-28T04:23:53.836344+0000","last_active":"2023-09-28T04:24:04.979559+0000","last_peered":"2023-09-28T04:24:04.979559+0000","last_clean":"2023-09-28T04:24:04.979559+0000","last_became_active":"2023-09-28T04:23:13.017398+0000","last_became_peered":"2023-09-28T04:23:13.017398+0000","last_unstale":"2023-09-28T04:24:04.979559+0000","last_undegraded":"2023-09-28T04:24:04.979559+0000","last_fullsized":"2023-09-28T04:24:04.979559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:53.836227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:53.836227+0000","last_clean_scrub_stamp":"2023-09-28T04:23:53.836227+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:38.499638+0000","scrub_duration":0.0019584490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961951+0000","last_change":"2023-09-28T04:23:54.055450+0000","last_active":"2023-09-28T04:24:04.961951+0000","last_peered":"2023-09-28T04:24:04.961951+0000","last_clean":"2023-09-28T04:24:04.961951+0000","last_became_active":"2023-09-28T04:23:17.912023+0000","last_became_peered":"2023-09-28T04:23:17.912023+0000","last_unstale":"2023-09-28T04:24:04.961951+0000","last_undegraded":"2023-09-28T04:24:04.961951+0000","last_fullsized":"2023-09-28T04:24:04.961951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:54.055357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:54.055357+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.055357+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:24.451155+0000","scrub_duration":0.0015336760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962101+0000","last_change":"2023-09-28T04:23:18.396451+0000","last_active":"2023-09-28T04:24:04.962101+0000","last_peered":"2023-09-28T04:24:04.962101+0000","last_clean":"2023-09-28T04:24:04.962101+0000","last_became_active":"2023-09-28T04:23:18.396190+0000","last_became_peered":"2023-09-28T04:23:18.396190+0000","last_unstale":"2023-09-28T04:24:04.962101+0000","last_undegraded":"2023-09-28T04:24:04.962101+0000","last_fullsized":"2023-09-28T04:24:04.962101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'5","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957862+0000","last_change":"2023-09-28T04:23:54.007568+0000","last_active":"2023-09-28T04:24:04.957862+0000","last_peered":"2023-09-28T04:24:04.957862+0000","last_clean":"2023-09-28T04:24:04.957862+0000","last_became_active":"2023-09-28T04:23:17.903844+0000","last_became_peered":"2023-09-28T04:23:17.903844+0000","last_unstale":"2023-09-28T04:24:04.957862+0000","last_undegraded":"2023-09-28T04:24:04.957862+0000","last_fullsized":"2023-09-28T04:24:04.957862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'5","last_scrub_stamp":"2023-09-28T04:23:54.007483+0000","last_deep_scrub":"21'5","last_deep_scrub_stamp":"2023-09-28T04:23:54.007483+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.007483+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:02.446114+0000","scrub_duration":0.0036125480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961733+0000","last_change":"2023-09-28T04:23:48.024392+0000","last_active":"2023-09-28T04:24:04.961733+0000","last_peered":"2023-09-28T04:24:04.961733+0000","last_clean":"2023-09-28T04:24:04.961733+0000","last_became_active":"2023-09-28T04:23:12.606143+0000","last_became_peered":"2023-09-28T04:23:12.606143+0000","last_unstale":"2023-09-28T04:24:04.961733+0000","last_undegraded":"2023-09-28T04:24:04.961733+0000","last_fullsized":"2023-09-28T04:24:04.961733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:48.024316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:48.024316+0000","last_clean_scrub_stamp":"2023-09-28T04:23:48.024316+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:49:31.414222+0000","scrub_duration":0.001689442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:06.038793+0000","last_change":"2023-09-28T04:24:06.038793+0000","last_active":"2023-09-28T04:24:06.038793+0000","last_peered":"2023-09-28T04:24:06.038793+0000","last_clean":"2023-09-28T04:24:06.038793+0000","last_became_active":"2023-09-28T04:23:18.392092+0000","last_became_peered":"2023-09-28T04:23:18.392092+0000","last_unstale":"2023-09-28T04:24:06.038793+0000","last_undegraded":"2023-09-28T04:24:06.038793+0000","last_fullsized":"2023-09-28T04:24:06.038793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980247+0000","last_change":"2023-09-28T04:23:50.941989+0000","last_active":"2023-09-28T04:24:04.980247+0000","last_peered":"2023-09-28T04:24:04.980247+0000","last_clean":"2023-09-28T04:24:04.980247+0000","last_became_active":"2023-09-28T04:23:12.605965+0000","last_became_peered":"2023-09-28T04:23:12.605965+0000","last_unstale":"2023-09-28T04:24:04.980247+0000","last_undegraded":"2023-09-28T04:24:04.980247+0000","last_fullsized":"2023-09-28T04:24:04.980247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:50.941893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:50.941893+0000","last_clean_scrub_stamp":"2023-09-28T04:23:50.941893+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:00:20.487845+0000","scrub_duration":0.001623038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962066+0000","last_change":"2023-09-28T04:23:46.366937+0000","last_active":"2023-09-28T04:24:04.962066+0000","last_peered":"2023-09-28T04:24:04.962066+0000","last_clean":"2023-09-28T04:24:04.962066+0000","last_became_active":"2023-09-28T04:23:17.914697+0000","last_became_peered":"2023-09-28T04:23:17.914697+0000","last_unstale":"2023-09-28T04:24:04.962066+0000","last_undegraded":"2023-09-28T04:24:04.962066+0000","last_fullsized":"2023-09-28T04:24:04.962066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:46.366859+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:46.366859+0000","last_clean_scrub_stamp":"2023-09-28T04:23:46.366859+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:07:57.413533+0000","scrub_duration":0.001760176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958233+0000","last_change":"2023-09-28T04:23:18.386681+0000","last_active":"2023-09-28T04:24:04.958233+0000","last_peered":"2023-09-28T04:24:04.958233+0000","last_clean":"2023-09-28T04:24:04.958233+0000","last_became_active":"2023-09-28T04:23:18.386380+0000","last_became_peered":"2023-09-28T04:23:18.386380+0000","last_unstale":"2023-09-28T04:24:04.958233+0000","last_undegraded":"2023-09-28T04:24:04.958233+0000","last_fullsized":"2023-09-28T04:24:04.958233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"21'5","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962194+0000","last_change":"2023-09-28T04:23:49.335161+0000","last_active":"2023-09-28T04:24:04.962194+0000","last_peered":"2023-09-28T04:24:04.962194+0000","last_clean":"2023-09-28T04:24:04.962194+0000","last_became_active":"2023-09-28T04:23:17.918116+0000","last_became_peered":"2023-09-28T04:23:17.918116+0000","last_unstale":"2023-09-28T04:24:04.962194+0000","last_undegraded":"2023-09-28T04:24:04.962194+0000","last_fullsized":"2023-09-28T04:24:04.962194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'5","last_scrub_stamp":"2023-09-28T04:23:49.335088+0000","last_deep_scrub":"21'5","last_deep_scrub_stamp":"2023-09-28T04:23:49.335088+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.335088+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:33.998499+0000","scrub_duration":0.002053263,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958898+0000","last_change":"2023-09-28T04:23:50.777493+0000","last_active":"2023-09-28T04:24:04.958898+0000","last_peered":"2023-09-28T04:24:04.958898+0000","last_clean":"2023-09-28T04:24:04.958898+0000","last_became_active":"2023-09-28T04:23:18.384930+0000","last_became_peered":"2023-09-28T04:23:18.384930+0000","last_unstale":"2023-09-28T04:24:04.958898+0000","last_undegraded":"2023-09-28T04:24:04.958898+0000","last_fullsized":"2023-09-28T04:24:04.958898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:50.777427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:50.777427+0000","last_clean_scrub_stamp":"2023-09-28T04:23:50.777427+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:00:20.323379+0000","scrub_duration":0.0012506990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960799+0000","last_change":"2023-09-28T04:24:03.718903+0000","last_active":"2023-09-28T04:24:04.960799+0000","last_peered":"2023-09-28T04:24:04.960799+0000","last_clean":"2023-09-28T04:24:04.960799+0000","last_became_active":"2023-09-28T04:23:17.905667+0000","last_became_peered":"2023-09-28T04:23:17.905667+0000","last_unstale":"2023-09-28T04:24:04.960799+0000","last_undegraded":"2023-09-28T04:24:04.960799+0000","last_fullsized":"2023-09-28T04:24:04.960799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:24:03.718793+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:24:03.718793+0000","last_clean_scrub_stamp":"2023-09-28T04:24:03.718793+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:56.863850+0000","scrub_duration":0.0029125269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958376+0000","last_change":"2023-09-28T04:23:18.400970+0000","last_active":"2023-09-28T04:24:04.958376+0000","last_peered":"2023-09-28T04:24:04.958376+0000","last_clean":"2023-09-28T04:24:04.958376+0000","last_became_active":"2023-09-28T04:23:18.400683+0000","last_became_peered":"2023-09-28T04:23:18.400683+0000","last_unstale":"2023-09-28T04:24:04.958376+0000","last_undegraded":"2023-09-28T04:24:04.958376+0000","last_fullsized":"2023-09-28T04:24:04.958376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960993+0000","last_change":"2023-09-28T04:23:17.905162+0000","last_active":"2023-09-28T04:24:04.960993+0000","last_peered":"2023-09-28T04:24:04.960993+0000","last_clean":"2023-09-28T04:24:04.960993+0000","last_became_active":"2023-09-28T04:23:17.904895+0000","last_became_peered":"2023-09-28T04:23:17.904895+0000","last_unstale":"2023-09-28T04:24:04.960993+0000","last_undegraded":"2023-09-28T04:24:04.960993+0000","last_fullsized":"2023-09-28T04:24:04.960993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:16.878027+0000","last_clean_scrub_stamp":"2023-09-28T04:23:16.878027+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958425+0000","last_change":"2023-09-28T04:23:53.988936+0000","last_active":"2023-09-28T04:24:04.958425+0000","last_peered":"2023-09-28T04:24:04.958425+0000","last_clean":"2023-09-28T04:24:04.958425+0000","last_became_active":"2023-09-28T04:23:18.400410+0000","last_became_peered":"2023-09-28T04:23:18.400410+0000","last_unstale":"2023-09-28T04:24:04.958425+0000","last_undegraded":"2023-09-28T04:24:04.958425+0000","last_fullsized":"2023-09-28T04:24:04.958425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:53.988832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:53.988832+0000","last_clean_scrub_stamp":"2023-09-28T04:23:53.988832+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:47.133890+0000","scrub_duration":0.0018249080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'2","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957853+0000","last_change":"2023-09-28T04:24:02.045496+0000","last_active":"2023-09-28T04:24:04.957853+0000","last_peered":"2023-09-28T04:24:04.957853+0000","last_clean":"2023-09-28T04:24:04.957853+0000","last_became_active":"2023-09-28T04:23:17.905198+0000","last_became_peered":"2023-09-28T04:23:17.905198+0000","last_unstale":"2023-09-28T04:24:04.957853+0000","last_undegraded":"2023-09-28T04:24:04.957853+0000","last_fullsized":"2023-09-28T04:24:04.957853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'2","last_scrub_stamp":"2023-09-28T04:24:02.045403+0000","last_deep_scrub":"21'2","last_deep_scrub_stamp":"2023-09-28T04:24:02.045403+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.045403+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:35:38.580346+0000","scrub_duration":0.0016629049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957040+0000","last_change":"2023-09-28T04:23:18.393194+0000","last_active":"2023-09-28T04:24:04.957040+0000","last_peered":"2023-09-28T04:24:04.957040+0000","last_clean":"2023-09-28T04:24:04.957040+0000","last_became_active":"2023-09-28T04:23:18.392400+0000","last_became_peered":"2023-09-28T04:23:18.392400+0000","last_unstale":"2023-09-28T04:24:04.957040+0000","last_undegraded":"2023-09-28T04:24:04.957040+0000","last_fullsized":"2023-09-28T04:24:04.957040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'11","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962550+0000","last_change":"2023-09-28T04:24:01.316338+0000","last_active":"2023-09-28T04:24:04.962550+0000","last_peered":"2023-09-28T04:24:04.962550+0000","last_clean":"2023-09-28T04:24:04.962550+0000","last_became_active":"2023-09-28T04:23:17.917266+0000","last_became_peered":"2023-09-28T04:23:17.917266+0000","last_unstale":"2023-09-28T04:24:04.962550+0000","last_undegraded":"2023-09-28T04:24:04.962550+0000","last_fullsized":"2023-09-28T04:24:04.962550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'11","last_scrub_stamp":"2023-09-28T04:24:01.316223+0000","last_deep_scrub":"21'11","last_deep_scrub_stamp":"2023-09-28T04:24:01.316223+0000","last_clean_scrub_stamp":"2023-09-28T04:24:01.316223+0000","objects_scrubbed":4,"log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:54.461281+0000","scrub_duration":0.0043941819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958078+0000","last_change":"2023-09-28T04:23:18.386391+0000","last_active":"2023-09-28T04:24:04.958078+0000","last_peered":"2023-09-28T04:24:04.958078+0000","last_clean":"2023-09-28T04:24:04.958078+0000","last_became_active":"2023-09-28T04:23:18.386051+0000","last_became_peered":"2023-09-28T04:23:18.386051+0000","last_unstale":"2023-09-28T04:24:04.958078+0000","last_undegraded":"2023-09-28T04:24:04.958078+0000","last_fullsized":"2023-09-28T04:24:04.958078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980037+0000","last_change":"2023-09-28T04:23:56.946309+0000","last_active":"2023-09-28T04:24:04.980037+0000","last_peered":"2023-09-28T04:24:04.980037+0000","last_clean":"2023-09-28T04:24:04.980037+0000","last_became_active":"2023-09-28T04:23:18.389280+0000","last_became_peered":"2023-09-28T04:23:18.389280+0000","last_unstale":"2023-09-28T04:24:04.980037+0000","last_undegraded":"2023-09-28T04:24:04.980037+0000","last_fullsized":"2023-09-28T04:24:04.980037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:56.946199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:56.946199+0000","last_clean_scrub_stamp":"2023-09-28T04:23:56.946199+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:53.399188+0000","scrub_duration":0.001773848,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.956934+0000","last_change":"2023-09-28T04:23:18.392980+0000","last_active":"2023-09-28T04:24:04.956934+0000","last_peered":"2023-09-28T04:24:04.956934+0000","last_clean":"2023-09-28T04:24:04.956934+0000","last_became_active":"2023-09-28T04:23:18.390929+0000","last_became_peered":"2023-09-28T04:23:18.390929+0000","last_unstale":"2023-09-28T04:24:04.956934+0000","last_undegraded":"2023-09-28T04:24:04.956934+0000","last_fullsized":"2023-09-28T04:24:04.956934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958329+0000","last_change":"2023-09-28T04:23:18.387348+0000","last_active":"2023-09-28T04:24:04.958329+0000","last_peered":"2023-09-28T04:24:04.958329+0000","last_clean":"2023-09-28T04:24:04.958329+0000","last_became_active":"2023-09-28T04:23:18.385870+0000","last_became_peered":"2023-09-28T04:23:18.385870+0000","last_unstale":"2023-09-28T04:24:04.958329+0000","last_undegraded":"2023-09-28T04:24:04.958329+0000","last_fullsized":"2023-09-28T04:24:04.958329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957736+0000","last_change":"2023-09-28T04:23:18.392534+0000","last_active":"2023-09-28T04:24:04.957736+0000","last_peered":"2023-09-28T04:24:04.957736+0000","last_clean":"2023-09-28T04:24:04.957736+0000","last_became_active":"2023-09-28T04:23:18.392245+0000","last_became_peered":"2023-09-28T04:23:18.392245+0000","last_unstale":"2023-09-28T04:24:04.957736+0000","last_undegraded":"2023-09-28T04:24:04.957736+0000","last_fullsized":"2023-09-28T04:24:04.957736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:06.038524+0000","last_change":"2023-09-28T04:24:06.038471+0000","last_active":"2023-09-28T04:24:06.038524+0000","last_peered":"2023-09-28T04:24:06.038524+0000","last_clean":"2023-09-28T04:24:06.038524+0000","last_became_active":"2023-09-28T04:23:18.391256+0000","last_became_peered":"2023-09-28T04:23:18.391256+0000","last_unstale":"2023-09-28T04:24:06.038524+0000","last_undegraded":"2023-09-28T04:24:06.038524+0000","last_fullsized":"2023-09-28T04:24:06.038524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:06.038393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:06.038393+0000","last_clean_scrub_stamp":"2023-09-28T04:24:06.038393+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:35:42.573336+0000","scrub_duration":0.0017123869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4966,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":9932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9048,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362792,"statfs":{"total":96636764160,"available":96627499008,"internally_reserved":0,"allocated":344064,"data_stored":685133,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8444,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363396,"statfs":{"total":96636764160,"available":96628117504,"internally_reserved":0,"allocated":249856,"data_stored":92031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8500,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363340,"statfs":{"total":96636764160,"available":96628060160,"internally_reserved":0,"allocated":241664,"data_stored":91919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":339968,"data_stored":683741,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8376,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363464,"statfs":{"total":96636764160,"available":96628187136,"internally_reserved":0,"allocated":245760,"data_stored":92009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8516,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363324,"statfs":{"total":96636764160,"available":96628043776,"internally_reserved":0,"allocated":258048,"data_stored":93139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8608,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363232,"statfs":{"total":96636764160,"available":96627949568,"internally_reserved":0,"allocated":286720,"data_stored":94839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8456,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363384,"statfs":{"total":96636764160,"available":96628105216,"internally_reserved":0,"allocated":262144,"data_stored":93209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T04:24:11.310 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.311 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.311 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.311 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.311 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.311 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.312 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.312 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.312 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.312 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.312 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.313 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.313 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.313 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.313 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.313 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.313 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.314 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.314 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.314 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.314 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.314 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.315 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.315 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.315 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.315 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.315 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.315 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.316 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.316 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.316 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.316 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.316 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.317 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.317 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.317 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.317 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.317 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.317 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.318 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.318 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.318 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.318 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.319 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.319 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.319 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-09-28T04:23:16.878027+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=16, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.319 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.319 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.320 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.320 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.320 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:11.320 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T04:24:21.928 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T04:24:21.934 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T04:24:31.321 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T04:24:31.521 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.521+0000 7f41b8bff700 1 Processor -- start 2023-09-28T04:24:31.522 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.521+0000 7f41b8bff700 1 -- start start 2023-09-28T04:24:31.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.522+0000 7f41b8bff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41b414c6a0 0x7f41b4152370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:31.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.522+0000 7f41b8bff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f41b40c4310 0x7f41b40c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:31.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.522+0000 7f41b8bff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b40c3450 con 0x7f41b40c0590 2023-09-28T04:24:31.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.522+0000 7f41b8bff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b40bfbb0 con 0x7f41b40c4310 2023-09-28T04:24:31.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.522+0000 7f41b8bff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b414ca70 con 0x7f41b414c6a0 2023-09-28T04:24:31.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.523+0000 7f41b2d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f41b40c4310 0x7f41b40c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:31.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.523+0000 7f41b259c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41b414c6a0 0x7f41b4152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:31.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.523+0000 7f41b1d9b700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f41b40c0590 0x7f41b40c09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:60290/0 (socket says 172.21.15.118:60290) 2023-09-28T04:24:31.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.523+0000 7f41b1d9b700 1 -- 172.21.15.118:0/873494936 learned_addr learned my addr 172.21.15.118:0/873494936 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:24:31.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.523+0000 7f41b159a700 1 -- 172.21.15.118:0/873494936 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323857103 0 0) 0x7f41b40c3450 con 0x7f41b40c0590 2023-09-28T04:24:31.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.523+0000 7f41b259c700 1 -- 172.21.15.118:0/873494936 >> v2:172.21.15.118:3300/0 conn(0x7f41b40c4310 msgr2=0x7f41b40c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:24:31.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.523+0000 7f41b259c700 1 --2- 172.21.15.118:0/873494936 >> v2:172.21.15.118:3300/0 conn(0x7f41b40c4310 0x7f41b40c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:31.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.523+0000 7f41b259c700 1 -- 172.21.15.118:0/873494936 >> v1:172.21.15.174:6789/0 conn(0x7f41b40c0590 legacy=0x7f41b40c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:31.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.523+0000 7f41b259c700 1 -- 172.21.15.118:0/873494936 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b40c2560 con 0x7f41b414c6a0 2023-09-28T04:24:31.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.523+0000 7f41b2d9d700 1 --2- 172.21.15.118:0/873494936 >> v2:172.21.15.118:3300/0 conn(0x7f41b40c4310 0x7f41b40c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:24:31.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.523+0000 7f41b259c700 1 --2- 172.21.15.118:0/873494936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41b414c6a0 0x7f41b4152370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41a40098e0 tx=0x7f41a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2260a2b763335475 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:31.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.524+0000 7f41b159a700 1 -- 172.21.15.118:0/873494936 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a400b640 con 0x7f41b414c6a0 2023-09-28T04:24:31.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.524+0000 7f41b159a700 1 -- 172.21.15.118:0/873494936 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a400b7a0 con 0x7f41b414c6a0 2023-09-28T04:24:31.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.524+0000 7f41b159a700 1 -- 172.21.15.118:0/873494936 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a400bb40 con 0x7f41b414c6a0 2023-09-28T04:24:31.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.524+0000 7f41b8bff700 1 -- 172.21.15.118:0/873494936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41b414c6a0 msgr2=0x7f41b4152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:31.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.524+0000 7f41b8bff700 1 --2- 172.21.15.118:0/873494936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41b414c6a0 0x7f41b4152370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41a40098e0 tx=0x7f41a40091a0 comp rx=0 tx=0).stop 2023-09-28T04:24:31.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.524+0000 7f41b8bff700 1 -- 172.21.15.118:0/873494936 shutdown_connections 2023-09-28T04:24:31.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.524+0000 7f41b8bff700 1 --2- 172.21.15.118:0/873494936 >> v2:172.21.15.118:3300/0 conn(0x7f41b40c4310 0x7f41b40c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:31.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.524+0000 7f41b8bff700 1 --2- 172.21.15.118:0/873494936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41b414c6a0 0x7f41b4152370 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:31.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.524+0000 7f41b8bff700 1 -- 172.21.15.118:0/873494936 >> 172.21.15.118:0/873494936 conn(0x7f41b4067630 msgr2=0x7f41b4067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:31.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.524+0000 7f41b8bff700 1 -- 172.21.15.118:0/873494936 shutdown_connections 2023-09-28T04:24:31.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.524+0000 7f41b8bff700 1 -- 172.21.15.118:0/873494936 wait complete. 2023-09-28T04:24:31.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.526+0000 7f41b8bff700 1 Processor -- start 2023-09-28T04:24:31.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.526+0000 7f41b8bff700 1 -- start start 2023-09-28T04:24:31.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.527+0000 7f41b8bff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41b40c0590 0x7f41b4151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:31.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.527+0000 7f41b8bff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41b40c4310 0x7f41b41694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:31.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.527+0000 7f41b8bff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41b414c6a0 0x7f41b414b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:31.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.527+0000 7f41b8bff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b4169020 con 0x7f41b40c0590 2023-09-28T04:24:31.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.527+0000 7f41b8bff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b40c0e70 con 0x7f41b40c4310 2023-09-28T04:24:31.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.527+0000 7f41b8bff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b41664e0 con 0x7f41b414c6a0 2023-09-28T04:24:31.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.527+0000 7f41b259c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41b40c0590 0x7f41b4151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:31.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.527+0000 7f41b259c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41b40c0590 0x7f41b4151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57954/0 (socket says 172.21.15.118:57954) 2023-09-28T04:24:31.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.527+0000 7f41b259c700 1 -- 172.21.15.118:0/2138800755 learned_addr learned my addr 172.21.15.118:0/2138800755 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:31.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.527+0000 7f41b1d9b700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41b40c4310 0x7f41b41694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:31.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.527+0000 7f41b2d9d700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41b414c6a0 0x7f41b414b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:31.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.528+0000 7f41b259c700 1 -- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41b414c6a0 msgr2=0x7f41b414b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:31.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.528+0000 7f41b259c700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41b414c6a0 0x7f41b414b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:31.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.528+0000 7f41b259c700 1 -- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41b40c4310 msgr2=0x7f41b41694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:31.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.528+0000 7f41b259c700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41b40c4310 0x7f41b41694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:31.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.528+0000 7f41b259c700 1 -- 172.21.15.118:0/2138800755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac009a20 con 0x7f41b40c0590 2023-09-28T04:24:31.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.528+0000 7f41b259c700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41b40c0590 0x7f41b4151030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f41b414cbb0 tx=0x7f41a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:31.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.528+0000 7f41a27fc700 1 -- 172.21.15.118:0/2138800755 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4000d10 con 0x7f41b40c0590 2023-09-28T04:24:31.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.528+0000 7f41a27fc700 1 -- 172.21.15.118:0/2138800755 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a400bb20 con 0x7f41b40c0590 2023-09-28T04:24:31.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.528+0000 7f41a27fc700 1 -- 172.21.15.118:0/2138800755 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4011650 con 0x7f41b40c0590 2023-09-28T04:24:31.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.528+0000 7f41b8bff700 1 -- 172.21.15.118:0/2138800755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a4009420 con 0x7f41b40c0590 2023-09-28T04:24:31.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.528+0000 7f41b8bff700 1 -- 172.21.15.118:0/2138800755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b4151f20 con 0x7f41b40c0590 2023-09-28T04:24:31.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.529+0000 7f41b8bff700 1 -- 172.21.15.118:0/2138800755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b4169300 con 0x7f41b40c0590 2023-09-28T04:24:31.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.530+0000 7f41a27fc700 1 -- 172.21.15.118:0/2138800755 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f41a4011a00 con 0x7f41b40c0590 2023-09-28T04:24:31.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.531+0000 7f41a27fc700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4194067330 0x7f41940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:31.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.531+0000 7f41a27fc700 1 -- 172.21.15.118:0/2138800755 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f41a4086210 con 0x7f41b40c0590 2023-09-28T04:24:31.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.531+0000 7f41b1d9b700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4194067330 0x7f41940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:31.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.532+0000 7f41b1d9b700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4194067330 0x7f41940697e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f41b40c39a0 tx=0x7f41a8007f50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:31.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.535+0000 7f41a27fc700 1 -- 172.21.15.118:0/2138800755 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f41a40530f0 con 0x7f41b40c0590 2023-09-28T04:24:31.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.720+0000 7f41b8bff700 1 -- 172.21.15.118:0/2138800755 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41b4169160 con 0x7f4194067330 2023-09-28T04:24:31.730 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.730+0000 7f41a27fc700 1 -- 172.21.15.118:0/2138800755 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310538 (secure 0 0 0) 0x7f41a80058a0 con 0x7f4194067330 2023-09-28T04:24:31.734 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:24:31.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.734+0000 7f41b8bff700 1 -- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4194067330 msgr2=0x7f41940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:31.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.734+0000 7f41b8bff700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4194067330 0x7f41940697e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f41b40c39a0 tx=0x7f41a8007f50 comp rx=0 tx=0).stop 2023-09-28T04:24:31.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.734+0000 7f41b8bff700 1 -- 172.21.15.118:0/2138800755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41b40c0590 msgr2=0x7f41b4151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:31.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.734+0000 7f41b8bff700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41b40c0590 0x7f41b4151030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f41b414cbb0 tx=0x7f41a4017000 comp rx=0 tx=0).stop 2023-09-28T04:24:31.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.734+0000 7f41b8bff700 1 -- 172.21.15.118:0/2138800755 shutdown_connections 2023-09-28T04:24:31.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.734+0000 7f41b8bff700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f4194067330 0x7f41940697e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:31.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.734+0000 7f41b8bff700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41b414c6a0 0x7f41b414b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:31.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.734+0000 7f41b8bff700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41b40c0590 0x7f41b4151030 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:31.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.734+0000 7f41b8bff700 1 --2- 172.21.15.118:0/2138800755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41b40c4310 0x7f41b41694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:31.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.734+0000 7f41b8bff700 1 -- 172.21.15.118:0/2138800755 >> 172.21.15.118:0/2138800755 conn(0x7f41b4067630 msgr2=0x7f41b41524f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:31.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.734+0000 7f41b8bff700 1 -- 172.21.15.118:0/2138800755 shutdown_connections 2023-09-28T04:24:31.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:31.734+0000 7f41b8bff700 1 -- 172.21.15.118:0/2138800755 wait complete. 2023-09-28T04:24:31.738 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-09-28T04:24:31.752 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-09-28T04:24:30.544061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595334,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":284,"num_write_kb":2451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14640,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":260,"ondisk_log_size":260,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69184,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":66944,"kb_avail":754905536,"statfs":{"total":773094113280,"available":773023268864,"internally_reserved":0,"allocated":2228224,"data_stored":1926020,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68550656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003300"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958623+0000","last_change":"2023-09-28T04:23:57.902240+0000","last_active":"2023-09-28T04:24:04.958623+0000","last_peered":"2023-09-28T04:24:04.958623+0000","last_clean":"2023-09-28T04:24:04.958623+0000","last_became_active":"2023-09-28T04:23:18.400107+0000","last_became_peered":"2023-09-28T04:23:18.400107+0000","last_unstale":"2023-09-28T04:24:04.958623+0000","last_undegraded":"2023-09-28T04:24:04.958623+0000","last_fullsized":"2023-09-28T04:24:04.958623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:57.902154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:57.902154+0000","last_clean_scrub_stamp":"2023-09-28T04:23:57.902154+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:54.355143+0000","scrub_duration":0.001620238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960860+0000","last_change":"2023-09-28T04:23:18.385136+0000","last_active":"2023-09-28T04:24:04.960860+0000","last_peered":"2023-09-28T04:24:04.960860+0000","last_clean":"2023-09-28T04:24:04.960860+0000","last_became_active":"2023-09-28T04:23:18.384789+0000","last_became_peered":"2023-09-28T04:23:18.384789+0000","last_unstale":"2023-09-28T04:24:04.960860+0000","last_undegraded":"2023-09-28T04:24:04.960860+0000","last_fullsized":"2023-09-28T04:24:04.960860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958381+0000","last_change":"2023-09-28T04:23:18.393700+0000","last_active":"2023-09-28T04:24:04.958381+0000","last_peered":"2023-09-28T04:24:04.958381+0000","last_clean":"2023-09-28T04:24:04.958381+0000","last_became_active":"2023-09-28T04:23:18.390599+0000","last_became_peered":"2023-09-28T04:23:18.390599+0000","last_unstale":"2023-09-28T04:24:04.958381+0000","last_undegraded":"2023-09-28T04:24:04.958381+0000","last_fullsized":"2023-09-28T04:24:04.958381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980319+0000","last_change":"2023-09-28T04:24:02.002562+0000","last_active":"2023-09-28T04:24:04.980319+0000","last_peered":"2023-09-28T04:24:04.980319+0000","last_clean":"2023-09-28T04:24:04.980319+0000","last_became_active":"2023-09-28T04:23:18.390607+0000","last_became_peered":"2023-09-28T04:23:18.390607+0000","last_unstale":"2023-09-28T04:24:04.980319+0000","last_undegraded":"2023-09-28T04:24:04.980319+0000","last_fullsized":"2023-09-28T04:24:04.980319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:02.002433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:02.002433+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.002433+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:59.844481+0000","scrub_duration":0.0021539319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:29.144775+0000","last_change":"2023-09-28T04:24:29.144745+0000","last_active":"2023-09-28T04:24:29.144775+0000","last_peered":"2023-09-28T04:24:29.144775+0000","last_clean":"2023-09-28T04:24:29.144775+0000","last_became_active":"2023-09-28T04:24:05.980489+0000","last_became_peered":"2023-09-28T04:24:05.980489+0000","last_unstale":"2023-09-28T04:24:29.144775+0000","last_undegraded":"2023-09-28T04:24:29.144775+0000","last_fullsized":"2023-09-28T04:24:29.144775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:29.144616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:29.144616+0000","last_clean_scrub_stamp":"2023-09-28T04:24:29.144616+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:23:15.959534+0000","scrub_duration":0.0015750880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958217+0000","last_change":"2023-09-28T04:23:18.393987+0000","last_active":"2023-09-28T04:24:04.958217+0000","last_peered":"2023-09-28T04:24:04.958217+0000","last_clean":"2023-09-28T04:24:04.958217+0000","last_became_active":"2023-09-28T04:23:18.390575+0000","last_became_peered":"2023-09-28T04:23:18.390575+0000","last_unstale":"2023-09-28T04:24:04.958217+0000","last_undegraded":"2023-09-28T04:24:04.958217+0000","last_fullsized":"2023-09-28T04:24:04.958217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:25.319298+0000","last_change":"2023-09-28T04:24:25.319273+0000","last_active":"2023-09-28T04:24:25.319298+0000","last_peered":"2023-09-28T04:24:25.319298+0000","last_clean":"2023-09-28T04:24:25.319298+0000","last_became_active":"2023-09-28T04:23:18.396038+0000","last_became_peered":"2023-09-28T04:23:18.396038+0000","last_unstale":"2023-09-28T04:24:25.319298+0000","last_undegraded":"2023-09-28T04:24:25.319298+0000","last_fullsized":"2023-09-28T04:24:25.319298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:25.319182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:25.319182+0000","last_clean_scrub_stamp":"2023-09-28T04:24:25.319182+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:56:26.909111+0000","scrub_duration":0.0018734209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960569+0000","last_change":"2023-09-28T04:23:18.388208+0000","last_active":"2023-09-28T04:24:04.960569+0000","last_peered":"2023-09-28T04:24:04.960569+0000","last_clean":"2023-09-28T04:24:04.960569+0000","last_became_active":"2023-09-28T04:23:18.387260+0000","last_became_peered":"2023-09-28T04:23:18.387260+0000","last_unstale":"2023-09-28T04:24:04.960569+0000","last_undegraded":"2023-09-28T04:24:04.960569+0000","last_fullsized":"2023-09-28T04:24:04.960569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962280+0000","last_change":"2023-09-28T04:23:18.403803+0000","last_active":"2023-09-28T04:24:04.962280+0000","last_peered":"2023-09-28T04:24:04.962280+0000","last_clean":"2023-09-28T04:24:04.962280+0000","last_became_active":"2023-09-28T04:23:18.403565+0000","last_became_peered":"2023-09-28T04:23:18.403565+0000","last_unstale":"2023-09-28T04:24:04.962280+0000","last_undegraded":"2023-09-28T04:24:04.962280+0000","last_fullsized":"2023-09-28T04:24:04.962280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:22.579159+0000","last_change":"2023-09-28T04:24:22.579132+0000","last_active":"2023-09-28T04:24:22.579159+0000","last_peered":"2023-09-28T04:24:22.579159+0000","last_clean":"2023-09-28T04:24:22.579159+0000","last_became_active":"2023-09-28T04:23:18.390911+0000","last_became_peered":"2023-09-28T04:23:18.390911+0000","last_unstale":"2023-09-28T04:24:22.579159+0000","last_undegraded":"2023-09-28T04:24:22.579159+0000","last_fullsized":"2023-09-28T04:24:22.579159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:22.579035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:22.579035+0000","last_clean_scrub_stamp":"2023-09-28T04:24:22.579035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:31.023906+0000","scrub_duration":0.0018620100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958619+0000","last_change":"2023-09-28T04:23:18.393845+0000","last_active":"2023-09-28T04:24:04.958619+0000","last_peered":"2023-09-28T04:24:04.958619+0000","last_clean":"2023-09-28T04:24:04.958619+0000","last_became_active":"2023-09-28T04:23:18.393524+0000","last_became_peered":"2023-09-28T04:23:18.393524+0000","last_unstale":"2023-09-28T04:24:04.958619+0000","last_undegraded":"2023-09-28T04:24:04.958619+0000","last_fullsized":"2023-09-28T04:24:04.958619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958887+0000","last_change":"2023-09-28T04:23:56.891326+0000","last_active":"2023-09-28T04:24:04.958887+0000","last_peered":"2023-09-28T04:24:04.958887+0000","last_clean":"2023-09-28T04:24:04.958887+0000","last_became_active":"2023-09-28T04:23:18.384986+0000","last_became_peered":"2023-09-28T04:23:18.384986+0000","last_unstale":"2023-09-28T04:24:04.958887+0000","last_undegraded":"2023-09-28T04:24:04.958887+0000","last_fullsized":"2023-09-28T04:24:04.958887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:56.891226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:56.891226+0000","last_clean_scrub_stamp":"2023-09-28T04:23:56.891226+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:08:07.937900+0000","scrub_duration":0.0017418970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958728+0000","last_change":"2023-09-28T04:23:54.890454+0000","last_active":"2023-09-28T04:24:04.958728+0000","last_peered":"2023-09-28T04:24:04.958728+0000","last_clean":"2023-09-28T04:24:04.958728+0000","last_became_active":"2023-09-28T04:23:18.402161+0000","last_became_peered":"2023-09-28T04:23:18.402161+0000","last_unstale":"2023-09-28T04:24:04.958728+0000","last_undegraded":"2023-09-28T04:24:04.958728+0000","last_fullsized":"2023-09-28T04:24:04.958728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:54.890326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:54.890326+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.890326+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:49:38.280232+0000","scrub_duration":0.0015513899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960628+0000","last_change":"2023-09-28T04:23:18.387808+0000","last_active":"2023-09-28T04:24:04.960628+0000","last_peered":"2023-09-28T04:24:04.960628+0000","last_clean":"2023-09-28T04:24:04.960628+0000","last_became_active":"2023-09-28T04:23:18.387471+0000","last_became_peered":"2023-09-28T04:23:18.387471+0000","last_unstale":"2023-09-28T04:24:04.960628+0000","last_undegraded":"2023-09-28T04:24:04.960628+0000","last_fullsized":"2023-09-28T04:24:04.960628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:16.223152+0000","last_change":"2023-09-28T04:24:16.223112+0000","last_active":"2023-09-28T04:24:16.223152+0000","last_peered":"2023-09-28T04:24:16.223152+0000","last_clean":"2023-09-28T04:24:16.223152+0000","last_became_active":"2023-09-28T04:23:18.396395+0000","last_became_peered":"2023-09-28T04:23:18.396395+0000","last_unstale":"2023-09-28T04:24:16.223152+0000","last_undegraded":"2023-09-28T04:24:16.223152+0000","last_fullsized":"2023-09-28T04:24:16.223152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:16.223014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:16.223014+0000","last_clean_scrub_stamp":"2023-09-28T04:24:16.223014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:44:44.110757+0000","scrub_duration":0.0022018570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958149+0000","last_change":"2023-09-28T04:23:54.995899+0000","last_active":"2023-09-28T04:24:04.958149+0000","last_peered":"2023-09-28T04:24:04.958149+0000","last_clean":"2023-09-28T04:24:04.958149+0000","last_became_active":"2023-09-28T04:23:18.393683+0000","last_became_peered":"2023-09-28T04:23:18.393683+0000","last_unstale":"2023-09-28T04:24:04.958149+0000","last_undegraded":"2023-09-28T04:24:04.958149+0000","last_fullsized":"2023-09-28T04:24:04.958149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:54.995805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:54.995805+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.995805+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:35:31.530749+0000","scrub_duration":0.0019654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:23.084535+0000","last_change":"2023-09-28T04:24:23.084502+0000","last_active":"2023-09-28T04:24:23.084535+0000","last_peered":"2023-09-28T04:24:23.084535+0000","last_clean":"2023-09-28T04:24:23.084535+0000","last_became_active":"2023-09-28T04:23:18.402275+0000","last_became_peered":"2023-09-28T04:23:18.402275+0000","last_unstale":"2023-09-28T04:24:23.084535+0000","last_undegraded":"2023-09-28T04:24:23.084535+0000","last_fullsized":"2023-09-28T04:24:23.084535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:23.084416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:23.084416+0000","last_clean_scrub_stamp":"2023-09-28T04:24:23.084416+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:03:46.754938+0000","scrub_duration":0.001654151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:27.170330+0000","last_change":"2023-09-28T04:24:27.170265+0000","last_active":"2023-09-28T04:24:27.170330+0000","last_peered":"2023-09-28T04:24:27.170330+0000","last_clean":"2023-09-28T04:24:27.170330+0000","last_became_active":"2023-09-28T04:23:18.390678+0000","last_became_peered":"2023-09-28T04:23:18.390678+0000","last_unstale":"2023-09-28T04:24:27.170330+0000","last_undegraded":"2023-09-28T04:24:27.170330+0000","last_fullsized":"2023-09-28T04:24:27.170330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:27.170155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:27.170155+0000","last_clean_scrub_stamp":"2023-09-28T04:24:27.170155+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:10:05.098466+0000","scrub_duration":0.0021985640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958958+0000","last_change":"2023-09-28T04:23:49.794039+0000","last_active":"2023-09-28T04:24:04.958958+0000","last_peered":"2023-09-28T04:24:04.958958+0000","last_clean":"2023-09-28T04:24:04.958958+0000","last_became_active":"2023-09-28T04:23:18.384916+0000","last_became_peered":"2023-09-28T04:23:18.384916+0000","last_unstale":"2023-09-28T04:24:04.958958+0000","last_undegraded":"2023-09-28T04:24:04.958958+0000","last_fullsized":"2023-09-28T04:24:04.958958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:49.793956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:49.793956+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.793956+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:00:36.299231+0000","scrub_duration":0.001933169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958463+0000","last_change":"2023-09-28T04:23:18.386692+0000","last_active":"2023-09-28T04:24:04.958463+0000","last_peered":"2023-09-28T04:24:04.958463+0000","last_clean":"2023-09-28T04:24:04.958463+0000","last_became_active":"2023-09-28T04:23:18.385805+0000","last_became_peered":"2023-09-28T04:23:18.385805+0000","last_unstale":"2023-09-28T04:24:04.958463+0000","last_undegraded":"2023-09-28T04:24:04.958463+0000","last_fullsized":"2023-09-28T04:24:04.958463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:24.343077+0000","last_change":"2023-09-28T04:24:24.343049+0000","last_active":"2023-09-28T04:24:24.343077+0000","last_peered":"2023-09-28T04:24:24.343077+0000","last_clean":"2023-09-28T04:24:24.343077+0000","last_became_active":"2023-09-28T04:23:18.400230+0000","last_became_peered":"2023-09-28T04:23:18.400230+0000","last_unstale":"2023-09-28T04:24:24.343077+0000","last_undegraded":"2023-09-28T04:24:24.343077+0000","last_fullsized":"2023-09-28T04:24:24.343077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:24.342933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:24.342933+0000","last_clean_scrub_stamp":"2023-09-28T04:24:24.342933+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:32.787804+0000","scrub_duration":0.0022771660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:28.138073+0000","last_change":"2023-09-28T04:24:28.138041+0000","last_active":"2023-09-28T04:24:28.138073+0000","last_peered":"2023-09-28T04:24:28.138073+0000","last_clean":"2023-09-28T04:24:28.138073+0000","last_became_active":"2023-09-28T04:23:18.391373+0000","last_became_peered":"2023-09-28T04:23:18.391373+0000","last_unstale":"2023-09-28T04:24:28.138073+0000","last_undegraded":"2023-09-28T04:24:28.138073+0000","last_fullsized":"2023-09-28T04:24:28.138073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:28.137937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:28.137937+0000","last_clean_scrub_stamp":"2023-09-28T04:24:28.137937+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:58:22.600614+0000","scrub_duration":0.00165047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:28.367724+0000","last_change":"2023-09-28T04:24:28.367688+0000","last_active":"2023-09-28T04:24:28.367724+0000","last_peered":"2023-09-28T04:24:28.367724+0000","last_clean":"2023-09-28T04:24:28.367724+0000","last_became_active":"2023-09-28T04:23:18.392723+0000","last_became_peered":"2023-09-28T04:23:18.392723+0000","last_unstale":"2023-09-28T04:24:28.367724+0000","last_undegraded":"2023-09-28T04:24:28.367724+0000","last_fullsized":"2023-09-28T04:24:28.367724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:28.367593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:28.367593+0000","last_clean_scrub_stamp":"2023-09-28T04:24:28.367593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:06:44.432458+0000","scrub_duration":0.0014829719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:22.268140+0000","last_change":"2023-09-28T04:24:22.268112+0000","last_active":"2023-09-28T04:24:22.268140+0000","last_peered":"2023-09-28T04:24:22.268140+0000","last_clean":"2023-09-28T04:24:22.268140+0000","last_became_active":"2023-09-28T04:23:18.402197+0000","last_became_peered":"2023-09-28T04:23:18.402197+0000","last_unstale":"2023-09-28T04:24:22.268140+0000","last_undegraded":"2023-09-28T04:24:22.268140+0000","last_fullsized":"2023-09-28T04:24:22.268140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:22.268022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:22.268022+0000","last_clean_scrub_stamp":"2023-09-28T04:24:22.268022+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:27:15.456540+0000","scrub_duration":0.0018515980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:10.113035+0000","last_change":"2023-09-28T04:24:10.113004+0000","last_active":"2023-09-28T04:24:10.113035+0000","last_peered":"2023-09-28T04:24:10.113035+0000","last_clean":"2023-09-28T04:24:10.113035+0000","last_became_active":"2023-09-28T04:23:18.388936+0000","last_became_peered":"2023-09-28T04:23:18.388936+0000","last_unstale":"2023-09-28T04:24:10.113035+0000","last_undegraded":"2023-09-28T04:24:10.113035+0000","last_fullsized":"2023-09-28T04:24:10.113035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:10.112876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:10.112876+0000","last_clean_scrub_stamp":"2023-09-28T04:24:10.112876+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:08:16.508273+0000","scrub_duration":0.002058888,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961636+0000","last_change":"2023-09-28T04:24:01.069603+0000","last_active":"2023-09-28T04:24:04.961636+0000","last_peered":"2023-09-28T04:24:04.961636+0000","last_clean":"2023-09-28T04:24:04.961636+0000","last_became_active":"2023-09-28T04:23:18.388682+0000","last_became_peered":"2023-09-28T04:23:18.388682+0000","last_unstale":"2023-09-28T04:24:04.961636+0000","last_undegraded":"2023-09-28T04:24:04.961636+0000","last_fullsized":"2023-09-28T04:24:04.961636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:01.069506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:01.069506+0000","last_clean_scrub_stamp":"2023-09-28T04:24:01.069506+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:46.779927+0000","scrub_duration":0.0017421419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960825+0000","last_change":"2023-09-28T04:23:18.391753+0000","last_active":"2023-09-28T04:24:04.960825+0000","last_peered":"2023-09-28T04:24:04.960825+0000","last_clean":"2023-09-28T04:24:04.960825+0000","last_became_active":"2023-09-28T04:23:18.391031+0000","last_became_peered":"2023-09-28T04:23:18.391031+0000","last_unstale":"2023-09-28T04:24:04.960825+0000","last_undegraded":"2023-09-28T04:24:04.960825+0000","last_fullsized":"2023-09-28T04:24:04.960825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958331+0000","last_change":"2023-09-28T04:23:58.912287+0000","last_active":"2023-09-28T04:24:04.958331+0000","last_peered":"2023-09-28T04:24:04.958331+0000","last_clean":"2023-09-28T04:24:04.958331+0000","last_became_active":"2023-09-28T04:23:17.913941+0000","last_became_peered":"2023-09-28T04:23:17.913941+0000","last_unstale":"2023-09-28T04:24:04.958331+0000","last_undegraded":"2023-09-28T04:24:04.958331+0000","last_fullsized":"2023-09-28T04:24:04.958331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:58.912190+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:58.912190+0000","last_clean_scrub_stamp":"2023-09-28T04:23:58.912190+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:08:05.307587+0000","scrub_duration":0.0025180559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:23.324140+0000","last_change":"2023-09-28T04:24:23.324109+0000","last_active":"2023-09-28T04:24:23.324140+0000","last_peered":"2023-09-28T04:24:23.324140+0000","last_clean":"2023-09-28T04:24:23.324140+0000","last_became_active":"2023-09-28T04:23:18.390030+0000","last_became_peered":"2023-09-28T04:23:18.390030+0000","last_unstale":"2023-09-28T04:24:23.324140+0000","last_undegraded":"2023-09-28T04:24:23.324140+0000","last_fullsized":"2023-09-28T04:24:23.324140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:23.323979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:23.323979+0000","last_clean_scrub_stamp":"2023-09-28T04:24:23.323979+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:14:11.391259+0000","scrub_duration":0.0015627830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"21'2","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962534+0000","last_change":"2023-09-28T04:23:53.085718+0000","last_active":"2023-09-28T04:24:04.962534+0000","last_peered":"2023-09-28T04:24:04.962534+0000","last_clean":"2023-09-28T04:24:04.962534+0000","last_became_active":"2023-09-28T04:23:17.913950+0000","last_became_peered":"2023-09-28T04:23:17.913950+0000","last_unstale":"2023-09-28T04:24:04.962534+0000","last_undegraded":"2023-09-28T04:24:04.962534+0000","last_fullsized":"2023-09-28T04:24:04.962534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'2","last_scrub_stamp":"2023-09-28T04:23:53.085638+0000","last_deep_scrub":"21'2","last_deep_scrub_stamp":"2023-09-28T04:23:53.085638+0000","last_clean_scrub_stamp":"2023-09-28T04:23:53.085638+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:37.749049+0000","scrub_duration":0.0019832040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:12.125690+0000","last_change":"2023-09-28T04:24:12.125650+0000","last_active":"2023-09-28T04:24:12.125690+0000","last_peered":"2023-09-28T04:24:12.125690+0000","last_clean":"2023-09-28T04:24:12.125690+0000","last_became_active":"2023-09-28T04:23:18.393106+0000","last_became_peered":"2023-09-28T04:23:18.393106+0000","last_unstale":"2023-09-28T04:24:12.125690+0000","last_undegraded":"2023-09-28T04:24:12.125690+0000","last_fullsized":"2023-09-28T04:24:12.125690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:12.125563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:12.125563+0000","last_clean_scrub_stamp":"2023-09-28T04:24:12.125563+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:23:13.322980+0000","scrub_duration":0.0020565100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"21'1","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957087+0000","last_change":"2023-09-28T04:24:00.077099+0000","last_active":"2023-09-28T04:24:04.957087+0000","last_peered":"2023-09-28T04:24:04.957087+0000","last_clean":"2023-09-28T04:24:04.957087+0000","last_became_active":"2023-09-28T04:23:17.910766+0000","last_became_peered":"2023-09-28T04:23:17.910766+0000","last_unstale":"2023-09-28T04:24:04.957087+0000","last_undegraded":"2023-09-28T04:24:04.957087+0000","last_fullsized":"2023-09-28T04:24:04.957087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'1","last_scrub_stamp":"2023-09-28T04:24:00.076945+0000","last_deep_scrub":"21'1","last_deep_scrub_stamp":"2023-09-28T04:24:00.076945+0000","last_clean_scrub_stamp":"2023-09-28T04:24:00.076945+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:53.222003+0000","scrub_duration":0.0016068569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980295+0000","last_change":"2023-09-28T04:24:03.982527+0000","last_active":"2023-09-28T04:24:04.980295+0000","last_peered":"2023-09-28T04:24:04.980295+0000","last_clean":"2023-09-28T04:24:04.980295+0000","last_became_active":"2023-09-28T04:23:18.387581+0000","last_became_peered":"2023-09-28T04:23:18.387581+0000","last_unstale":"2023-09-28T04:24:04.980295+0000","last_undegraded":"2023-09-28T04:24:04.980295+0000","last_fullsized":"2023-09-28T04:24:04.980295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:03.982444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:03.982444+0000","last_clean_scrub_stamp":"2023-09-28T04:24:03.982444+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:12.421076+0000","scrub_duration":0.001244752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962459+0000","last_change":"2023-09-28T04:23:55.393407+0000","last_active":"2023-09-28T04:24:04.962459+0000","last_peered":"2023-09-28T04:24:04.962459+0000","last_clean":"2023-09-28T04:24:04.962459+0000","last_became_active":"2023-09-28T04:23:17.917596+0000","last_became_peered":"2023-09-28T04:23:17.917596+0000","last_unstale":"2023-09-28T04:24:04.962459+0000","last_undegraded":"2023-09-28T04:24:04.962459+0000","last_fullsized":"2023-09-28T04:24:04.962459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:55.393324+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:55.393324+0000","last_clean_scrub_stamp":"2023-09-28T04:23:55.393324+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:03.831956+0000","scrub_duration":0.0023423250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:11.025863+0000","last_change":"2023-09-28T04:24:11.025839+0000","last_active":"2023-09-28T04:24:11.025863+0000","last_peered":"2023-09-28T04:24:11.025863+0000","last_clean":"2023-09-28T04:24:11.025863+0000","last_became_active":"2023-09-28T04:23:18.391773+0000","last_became_peered":"2023-09-28T04:23:18.391773+0000","last_unstale":"2023-09-28T04:24:11.025863+0000","last_undegraded":"2023-09-28T04:24:11.025863+0000","last_fullsized":"2023-09-28T04:24:11.025863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:11.025769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:11.025769+0000","last_clean_scrub_stamp":"2023-09-28T04:24:11.025769+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:23:12.223186+0000","scrub_duration":0.001351711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"23'3","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:14.559479+0000","last_change":"2023-09-28T04:24:14.559452+0000","last_active":"2023-09-28T04:24:14.559479+0000","last_peered":"2023-09-28T04:24:14.559479+0000","last_clean":"2023-09-28T04:24:14.559479+0000","last_became_active":"2023-09-28T04:23:17.908599+0000","last_became_peered":"2023-09-28T04:23:17.908599+0000","last_unstale":"2023-09-28T04:24:14.559479+0000","last_undegraded":"2023-09-28T04:24:14.559479+0000","last_fullsized":"2023-09-28T04:24:14.559479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-09-28T04:24:14.559362+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-09-28T04:24:14.559362+0000","last_clean_scrub_stamp":"2023-09-28T04:24:14.559362+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:23:15.756779+0000","scrub_duration":0.0027368200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:12.065894+0000","last_change":"2023-09-28T04:24:12.065866+0000","last_active":"2023-09-28T04:24:12.065894+0000","last_peered":"2023-09-28T04:24:12.065894+0000","last_clean":"2023-09-28T04:24:12.065894+0000","last_became_active":"2023-09-28T04:23:18.393631+0000","last_became_peered":"2023-09-28T04:23:18.393631+0000","last_unstale":"2023-09-28T04:24:12.065894+0000","last_undegraded":"2023-09-28T04:24:12.065894+0000","last_fullsized":"2023-09-28T04:24:12.065894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:12.065779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:12.065779+0000","last_clean_scrub_stamp":"2023-09-28T04:24:12.065779+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:25.573571+0000","scrub_duration":0.001651413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'7","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:10.197743+0000","last_change":"2023-09-28T04:24:10.197715+0000","last_active":"2023-09-28T04:24:10.197743+0000","last_peered":"2023-09-28T04:24:10.197743+0000","last_clean":"2023-09-28T04:24:10.197743+0000","last_became_active":"2023-09-28T04:23:17.911361+0000","last_became_peered":"2023-09-28T04:23:17.911361+0000","last_unstale":"2023-09-28T04:24:10.197743+0000","last_undegraded":"2023-09-28T04:24:10.197743+0000","last_fullsized":"2023-09-28T04:24:10.197743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2023-09-28T04:24:10.197625+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2023-09-28T04:24:10.197625+0000","last_clean_scrub_stamp":"2023-09-28T04:24:10.197625+0000","objects_scrubbed":3,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:08:16.593022+0000","scrub_duration":0.0050376570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:15.077710+0000","last_change":"2023-09-28T04:24:15.077679+0000","last_active":"2023-09-28T04:24:15.077710+0000","last_peered":"2023-09-28T04:24:15.077710+0000","last_clean":"2023-09-28T04:24:15.077710+0000","last_became_active":"2023-09-28T04:23:18.387672+0000","last_became_peered":"2023-09-28T04:23:18.387672+0000","last_unstale":"2023-09-28T04:24:15.077710+0000","last_undegraded":"2023-09-28T04:24:15.077710+0000","last_fullsized":"2023-09-28T04:24:15.077710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:15.077589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:15.077589+0000","last_clean_scrub_stamp":"2023-09-28T04:24:15.077589+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:28.585380+0000","scrub_duration":0.0020568090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'13","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958562+0000","last_change":"2023-09-28T04:24:02.967980+0000","last_active":"2023-09-28T04:24:04.958562+0000","last_peered":"2023-09-28T04:24:04.958562+0000","last_clean":"2023-09-28T04:24:04.958562+0000","last_became_active":"2023-09-28T04:23:17.904734+0000","last_became_peered":"2023-09-28T04:23:17.904734+0000","last_unstale":"2023-09-28T04:24:04.958562+0000","last_undegraded":"2023-09-28T04:24:04.958562+0000","last_fullsized":"2023-09-28T04:24:04.958562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'13","last_scrub_stamp":"2023-09-28T04:24:02.967889+0000","last_deep_scrub":"21'13","last_deep_scrub_stamp":"2023-09-28T04:24:02.967889+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.967889+0000","objects_scrubbed":5,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:23:04.165306+0000","scrub_duration":0.0065805229999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958578+0000","last_change":"2023-09-28T04:23:49.989615+0000","last_active":"2023-09-28T04:24:04.958578+0000","last_peered":"2023-09-28T04:24:04.958578+0000","last_clean":"2023-09-28T04:24:04.958578+0000","last_became_active":"2023-09-28T04:23:18.388871+0000","last_became_peered":"2023-09-28T04:23:18.388871+0000","last_unstale":"2023-09-28T04:24:04.958578+0000","last_undegraded":"2023-09-28T04:24:04.958578+0000","last_fullsized":"2023-09-28T04:24:04.958578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:49.989518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:49.989518+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.989518+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:35.699939+0000","scrub_duration":0.0014560160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'9","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979336+0000","last_change":"2023-09-28T04:23:59.951180+0000","last_active":"2023-09-28T04:24:04.979336+0000","last_peered":"2023-09-28T04:24:04.979336+0000","last_clean":"2023-09-28T04:24:04.979336+0000","last_became_active":"2023-09-28T04:23:17.909981+0000","last_became_peered":"2023-09-28T04:23:17.909981+0000","last_unstale":"2023-09-28T04:24:04.979336+0000","last_undegraded":"2023-09-28T04:24:04.979336+0000","last_fullsized":"2023-09-28T04:24:04.979336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'9","last_scrub_stamp":"2023-09-28T04:23:59.951098+0000","last_deep_scrub":"21'9","last_deep_scrub_stamp":"2023-09-28T04:23:59.951098+0000","last_clean_scrub_stamp":"2023-09-28T04:23:59.951098+0000","objects_scrubbed":4,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:08.389729+0000","scrub_duration":0.0082831610000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:20.203944+0000","last_change":"2023-09-28T04:24:20.203914+0000","last_active":"2023-09-28T04:24:20.203944+0000","last_peered":"2023-09-28T04:24:20.203944+0000","last_clean":"2023-09-28T04:24:20.203944+0000","last_became_active":"2023-09-28T04:24:05.961816+0000","last_became_peered":"2023-09-28T04:24:05.961816+0000","last_unstale":"2023-09-28T04:24:20.203944+0000","last_undegraded":"2023-09-28T04:24:20.203944+0000","last_fullsized":"2023-09-28T04:24:20.203944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:20.203803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:20.203803+0000","last_clean_scrub_stamp":"2023-09-28T04:24:20.203803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:56:21.793731+0000","scrub_duration":0.0020937099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961454+0000","last_change":"2023-09-28T04:23:57.340861+0000","last_active":"2023-09-28T04:24:04.961454+0000","last_peered":"2023-09-28T04:24:04.961454+0000","last_clean":"2023-09-28T04:24:04.961454+0000","last_became_active":"2023-09-28T04:23:17.916424+0000","last_became_peered":"2023-09-28T04:23:17.916424+0000","last_unstale":"2023-09-28T04:24:04.961454+0000","last_undegraded":"2023-09-28T04:24:04.961454+0000","last_fullsized":"2023-09-28T04:24:04.961454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:57.340759+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:57.340759+0000","last_clean_scrub_stamp":"2023-09-28T04:23:57.340759+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:43.051180+0000","scrub_duration":0.0023571410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:25.534840+0000","last_change":"2023-09-28T04:24:25.534783+0000","last_active":"2023-09-28T04:24:25.534840+0000","last_peered":"2023-09-28T04:24:25.534840+0000","last_clean":"2023-09-28T04:24:25.534840+0000","last_became_active":"2023-09-28T04:23:18.390613+0000","last_became_peered":"2023-09-28T04:23:18.390613+0000","last_unstale":"2023-09-28T04:24:25.534840+0000","last_undegraded":"2023-09-28T04:24:25.534840+0000","last_fullsized":"2023-09-28T04:24:25.534840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:25.534678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:25.534678+0000","last_clean_scrub_stamp":"2023-09-28T04:24:25.534678+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:03:49.205200+0000","scrub_duration":0.0013638229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979364+0000","last_change":"2023-09-28T04:24:03.053560+0000","last_active":"2023-09-28T04:24:04.979364+0000","last_peered":"2023-09-28T04:24:04.979364+0000","last_clean":"2023-09-28T04:24:04.979364+0000","last_became_active":"2023-09-28T04:23:17.910457+0000","last_became_peered":"2023-09-28T04:23:17.910457+0000","last_unstale":"2023-09-28T04:24:04.979364+0000","last_undegraded":"2023-09-28T04:24:04.979364+0000","last_fullsized":"2023-09-28T04:24:04.979364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:24:03.053473+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:24:03.053473+0000","last_clean_scrub_stamp":"2023-09-28T04:24:03.053473+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:18.309826+0000","scrub_duration":0.0021293890000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961878+0000","last_change":"2023-09-28T04:23:18.402823+0000","last_active":"2023-09-28T04:24:04.961878+0000","last_peered":"2023-09-28T04:24:04.961878+0000","last_clean":"2023-09-28T04:24:04.961878+0000","last_became_active":"2023-09-28T04:23:18.402559+0000","last_became_peered":"2023-09-28T04:23:18.402559+0000","last_unstale":"2023-09-28T04:24:04.961878+0000","last_undegraded":"2023-09-28T04:24:04.961878+0000","last_fullsized":"2023-09-28T04:24:04.961878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'19","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979016+0000","last_change":"2023-09-28T04:23:54.968698+0000","last_active":"2023-09-28T04:24:04.979016+0000","last_peered":"2023-09-28T04:24:04.979016+0000","last_clean":"2023-09-28T04:24:04.979016+0000","last_became_active":"2023-09-28T04:23:17.910650+0000","last_became_peered":"2023-09-28T04:23:17.910650+0000","last_unstale":"2023-09-28T04:24:04.979016+0000","last_undegraded":"2023-09-28T04:24:04.979016+0000","last_fullsized":"2023-09-28T04:24:04.979016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'19","last_scrub_stamp":"2023-09-28T04:23:54.968612+0000","last_deep_scrub":"21'19","last_deep_scrub_stamp":"2023-09-28T04:23:54.968612+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.968612+0000","objects_scrubbed":8,"log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:31:52.914472+0000","scrub_duration":0.0052817860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:19.179438+0000","last_change":"2023-09-28T04:24:19.179405+0000","last_active":"2023-09-28T04:24:19.179438+0000","last_peered":"2023-09-28T04:24:19.179438+0000","last_clean":"2023-09-28T04:24:19.179438+0000","last_became_active":"2023-09-28T04:23:18.394721+0000","last_became_peered":"2023-09-28T04:23:18.394721+0000","last_unstale":"2023-09-28T04:24:19.179438+0000","last_undegraded":"2023-09-28T04:24:19.179438+0000","last_fullsized":"2023-09-28T04:24:19.179438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:19.179316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:19.179316+0000","last_clean_scrub_stamp":"2023-09-28T04:24:19.179316+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:27.624187+0000","scrub_duration":0.0019399389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979548+0000","last_change":"2023-09-28T04:24:02.004448+0000","last_active":"2023-09-28T04:24:04.979548+0000","last_peered":"2023-09-28T04:24:04.979548+0000","last_clean":"2023-09-28T04:24:04.979548+0000","last_became_active":"2023-09-28T04:23:17.907331+0000","last_became_peered":"2023-09-28T04:23:17.907331+0000","last_unstale":"2023-09-28T04:24:04.979548+0000","last_undegraded":"2023-09-28T04:24:04.979548+0000","last_fullsized":"2023-09-28T04:24:04.979548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:24:02.004356+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:24:02.004356+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.004356+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:47.714777+0000","scrub_duration":0.0031667269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960575+0000","last_change":"2023-09-28T04:23:18.390910+0000","last_active":"2023-09-28T04:24:04.960575+0000","last_peered":"2023-09-28T04:24:04.960575+0000","last_clean":"2023-09-28T04:24:04.960575+0000","last_became_active":"2023-09-28T04:23:18.390633+0000","last_became_peered":"2023-09-28T04:23:18.390633+0000","last_unstale":"2023-09-28T04:24:04.960575+0000","last_undegraded":"2023-09-28T04:24:04.960575+0000","last_fullsized":"2023-09-28T04:24:04.960575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'3","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:07.132164+0000","last_change":"2023-09-28T04:24:07.132123+0000","last_active":"2023-09-28T04:24:07.132164+0000","last_peered":"2023-09-28T04:24:07.132164+0000","last_clean":"2023-09-28T04:24:07.132164+0000","last_became_active":"2023-09-28T04:23:17.906036+0000","last_became_peered":"2023-09-28T04:23:17.906036+0000","last_unstale":"2023-09-28T04:24:07.132164+0000","last_undegraded":"2023-09-28T04:24:07.132164+0000","last_fullsized":"2023-09-28T04:24:07.132164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-09-28T04:24:07.132035+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-09-28T04:24:07.132035+0000","last_clean_scrub_stamp":"2023-09-28T04:24:07.132035+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:35:43.666979+0000","scrub_duration":0.0027056010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:22.140407+0000","last_change":"2023-09-28T04:24:22.140373+0000","last_active":"2023-09-28T04:24:22.140407+0000","last_peered":"2023-09-28T04:24:22.140407+0000","last_clean":"2023-09-28T04:24:22.140407+0000","last_became_active":"2023-09-28T04:23:18.385693+0000","last_became_peered":"2023-09-28T04:23:18.385693+0000","last_unstale":"2023-09-28T04:24:22.140407+0000","last_undegraded":"2023-09-28T04:24:22.140407+0000","last_fullsized":"2023-09-28T04:24:22.140407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:22.140271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:22.140271+0000","last_clean_scrub_stamp":"2023-09-28T04:24:22.140271+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:06:38.205135+0000","scrub_duration":0.0018774600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'2","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:05.075483+0000","last_change":"2023-09-28T04:24:05.075438+0000","last_active":"2023-09-28T04:24:05.075483+0000","last_peered":"2023-09-28T04:24:05.075483+0000","last_clean":"2023-09-28T04:24:05.075483+0000","last_became_active":"2023-09-28T04:23:17.908493+0000","last_became_peered":"2023-09-28T04:23:17.908493+0000","last_unstale":"2023-09-28T04:24:05.075483+0000","last_undegraded":"2023-09-28T04:24:05.075483+0000","last_fullsized":"2023-09-28T04:24:05.075483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-28T04:24:05.075329+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-28T04:24:05.075329+0000","last_clean_scrub_stamp":"2023-09-28T04:24:05.075329+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:58.220387+0000","scrub_duration":0.0028904540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980151+0000","last_change":"2023-09-28T04:23:59.965660+0000","last_active":"2023-09-28T04:24:04.980151+0000","last_peered":"2023-09-28T04:24:04.980151+0000","last_clean":"2023-09-28T04:24:04.980151+0000","last_became_active":"2023-09-28T04:23:18.385112+0000","last_became_peered":"2023-09-28T04:23:18.385112+0000","last_unstale":"2023-09-28T04:24:04.980151+0000","last_undegraded":"2023-09-28T04:24:04.980151+0000","last_fullsized":"2023-09-28T04:24:04.980151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:59.965563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:59.965563+0000","last_clean_scrub_stamp":"2023-09-28T04:23:59.965563+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:30.361361+0000","scrub_duration":0.0020436289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960810+0000","last_change":"2023-09-28T04:23:59.641629+0000","last_active":"2023-09-28T04:24:04.960810+0000","last_peered":"2023-09-28T04:24:04.960810+0000","last_clean":"2023-09-28T04:24:04.960810+0000","last_became_active":"2023-09-28T04:23:17.898232+0000","last_became_peered":"2023-09-28T04:23:17.898232+0000","last_unstale":"2023-09-28T04:24:04.960810+0000","last_undegraded":"2023-09-28T04:24:04.960810+0000","last_fullsized":"2023-09-28T04:24:04.960810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:59.641543+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:59.641543+0000","last_clean_scrub_stamp":"2023-09-28T04:23:59.641543+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:45.351964+0000","scrub_duration":0.0027926169999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:13.090090+0000","last_change":"2023-09-28T04:24:13.090059+0000","last_active":"2023-09-28T04:24:13.090090+0000","last_peered":"2023-09-28T04:24:13.090090+0000","last_clean":"2023-09-28T04:24:13.090090+0000","last_became_active":"2023-09-28T04:23:18.391963+0000","last_became_peered":"2023-09-28T04:23:18.391963+0000","last_unstale":"2023-09-28T04:24:13.090090+0000","last_undegraded":"2023-09-28T04:24:13.090090+0000","last_fullsized":"2023-09-28T04:24:13.090090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:13.089951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:13.089951+0000","last_clean_scrub_stamp":"2023-09-28T04:24:13.089951+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:26.597743+0000","scrub_duration":0.001666984,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'4","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957603+0000","last_change":"2023-09-28T04:23:53.004623+0000","last_active":"2023-09-28T04:24:04.957603+0000","last_peered":"2023-09-28T04:24:04.957603+0000","last_clean":"2023-09-28T04:24:04.957603+0000","last_became_active":"2023-09-28T04:23:17.905089+0000","last_became_peered":"2023-09-28T04:23:17.905089+0000","last_unstale":"2023-09-28T04:24:04.957603+0000","last_undegraded":"2023-09-28T04:24:04.957603+0000","last_fullsized":"2023-09-28T04:24:04.957603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4","last_scrub_stamp":"2023-09-28T04:23:53.004535+0000","last_deep_scrub":"21'4","last_deep_scrub_stamp":"2023-09-28T04:23:53.004535+0000","last_clean_scrub_stamp":"2023-09-28T04:23:53.004535+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:50.846583+0000","scrub_duration":0.0020402789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:20.122424+0000","last_change":"2023-09-28T04:24:20.122397+0000","last_active":"2023-09-28T04:24:20.122424+0000","last_peered":"2023-09-28T04:24:20.122424+0000","last_clean":"2023-09-28T04:24:20.122424+0000","last_became_active":"2023-09-28T04:23:18.399839+0000","last_became_peered":"2023-09-28T04:23:18.399839+0000","last_unstale":"2023-09-28T04:24:20.122424+0000","last_undegraded":"2023-09-28T04:24:20.122424+0000","last_fullsized":"2023-09-28T04:24:20.122424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:20.122278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:20.122278+0000","last_clean_scrub_stamp":"2023-09-28T04:24:20.122278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:23:06.937196+0000","scrub_duration":0.0017522569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"21'1","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980153+0000","last_change":"2023-09-28T04:23:55.943781+0000","last_active":"2023-09-28T04:24:04.980153+0000","last_peered":"2023-09-28T04:24:04.980153+0000","last_clean":"2023-09-28T04:24:04.980153+0000","last_became_active":"2023-09-28T04:23:17.912560+0000","last_became_peered":"2023-09-28T04:23:17.912560+0000","last_unstale":"2023-09-28T04:24:04.980153+0000","last_undegraded":"2023-09-28T04:24:04.980153+0000","last_fullsized":"2023-09-28T04:24:04.980153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'1","last_scrub_stamp":"2023-09-28T04:23:55.943684+0000","last_deep_scrub":"21'1","last_deep_scrub_stamp":"2023-09-28T04:23:55.943684+0000","last_clean_scrub_stamp":"2023-09-28T04:23:55.943684+0000","objects_scrubbed":1,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:08:06.990358+0000","scrub_duration":0.001753884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:23.137176+0000","last_change":"2023-09-28T04:24:23.137148+0000","last_active":"2023-09-28T04:24:23.137176+0000","last_peered":"2023-09-28T04:24:23.137176+0000","last_clean":"2023-09-28T04:24:23.137176+0000","last_became_active":"2023-09-28T04:23:18.390268+0000","last_became_peered":"2023-09-28T04:23:18.390268+0000","last_unstale":"2023-09-28T04:24:23.137176+0000","last_undegraded":"2023-09-28T04:24:23.137176+0000","last_fullsized":"2023-09-28T04:24:23.137176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:23.137039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:23.137039+0000","last_clean_scrub_stamp":"2023-09-28T04:24:23.137039+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:10:46.207788+0000","scrub_duration":0.001899111,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"21'5","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958284+0000","last_change":"2023-09-28T04:24:03.964617+0000","last_active":"2023-09-28T04:24:04.958284+0000","last_peered":"2023-09-28T04:24:04.958284+0000","last_clean":"2023-09-28T04:24:04.958284+0000","last_became_active":"2023-09-28T04:23:17.910887+0000","last_became_peered":"2023-09-28T04:23:17.910887+0000","last_unstale":"2023-09-28T04:24:04.958284+0000","last_undegraded":"2023-09-28T04:24:04.958284+0000","last_fullsized":"2023-09-28T04:24:04.958284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'5","last_scrub_stamp":"2023-09-28T04:24:03.964445+0000","last_deep_scrub":"21'5","last_deep_scrub_stamp":"2023-09-28T04:24:03.964445+0000","last_clean_scrub_stamp":"2023-09-28T04:24:03.964445+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:17.472237+0000","scrub_duration":0.0046695920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958754+0000","last_change":"2023-09-28T04:23:51.981578+0000","last_active":"2023-09-28T04:24:04.958754+0000","last_peered":"2023-09-28T04:24:04.958754+0000","last_clean":"2023-09-28T04:24:04.958754+0000","last_became_active":"2023-09-28T04:23:18.387667+0000","last_became_peered":"2023-09-28T04:23:18.387667+0000","last_unstale":"2023-09-28T04:24:04.958754+0000","last_undegraded":"2023-09-28T04:24:04.958754+0000","last_fullsized":"2023-09-28T04:24:04.958754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:51.981479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:51.981479+0000","last_clean_scrub_stamp":"2023-09-28T04:23:51.981479+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:07.237832+0000","scrub_duration":0.0013352010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'3","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:29.326299+0000","last_change":"2023-09-28T04:24:29.326268+0000","last_active":"2023-09-28T04:24:29.326299+0000","last_peered":"2023-09-28T04:24:29.326299+0000","last_clean":"2023-09-28T04:24:29.326299+0000","last_became_active":"2023-09-28T04:23:17.911458+0000","last_became_peered":"2023-09-28T04:23:17.911458+0000","last_unstale":"2023-09-28T04:24:29.326299+0000","last_undegraded":"2023-09-28T04:24:29.326299+0000","last_fullsized":"2023-09-28T04:24:29.326299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-09-28T04:24:29.326184+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-09-28T04:24:29.326184+0000","last_clean_scrub_stamp":"2023-09-28T04:24:29.326184+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:10:52.396932+0000","scrub_duration":0.0031833859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:22.052572+0000","last_change":"2023-09-28T04:24:22.052545+0000","last_active":"2023-09-28T04:24:22.052572+0000","last_peered":"2023-09-28T04:24:22.052572+0000","last_clean":"2023-09-28T04:24:22.052572+0000","last_became_active":"2023-09-28T04:23:18.399957+0000","last_became_peered":"2023-09-28T04:23:18.399957+0000","last_unstale":"2023-09-28T04:24:22.052572+0000","last_undegraded":"2023-09-28T04:24:22.052572+0000","last_fullsized":"2023-09-28T04:24:22.052572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:22.052455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:22.052455+0000","last_clean_scrub_stamp":"2023-09-28T04:24:22.052455+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:30.497326+0000","scrub_duration":0.001379464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961872+0000","last_change":"2023-09-28T04:23:49.012182+0000","last_active":"2023-09-28T04:24:04.961872+0000","last_peered":"2023-09-28T04:24:04.961872+0000","last_clean":"2023-09-28T04:24:04.961872+0000","last_became_active":"2023-09-28T04:23:13.017362+0000","last_became_peered":"2023-09-28T04:23:13.017362+0000","last_unstale":"2023-09-28T04:24:04.961872+0000","last_undegraded":"2023-09-28T04:24:04.961872+0000","last_fullsized":"2023-09-28T04:24:04.961872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:49.012108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:49.012108+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.012108+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:10.816331+0000","scrub_duration":0.001277809,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:09.589826+0000","last_change":"2023-09-28T04:24:09.589779+0000","last_active":"2023-09-28T04:24:09.589826+0000","last_peered":"2023-09-28T04:24:09.589826+0000","last_clean":"2023-09-28T04:24:09.589826+0000","last_became_active":"2023-09-28T04:23:17.898878+0000","last_became_peered":"2023-09-28T04:23:17.898878+0000","last_unstale":"2023-09-28T04:24:09.589826+0000","last_undegraded":"2023-09-28T04:24:09.589826+0000","last_fullsized":"2023-09-28T04:24:09.589826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-09-28T04:24:09.589679+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-09-28T04:24:09.589679+0000","last_clean_scrub_stamp":"2023-09-28T04:24:09.589679+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:08:15.985076+0000","scrub_duration":0.0040891410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:14.068563+0000","last_change":"2023-09-28T04:24:14.068531+0000","last_active":"2023-09-28T04:24:14.068563+0000","last_peered":"2023-09-28T04:24:14.068563+0000","last_clean":"2023-09-28T04:24:14.068563+0000","last_became_active":"2023-09-28T04:23:18.383969+0000","last_became_peered":"2023-09-28T04:23:18.383969+0000","last_unstale":"2023-09-28T04:24:14.068563+0000","last_undegraded":"2023-09-28T04:24:14.068563+0000","last_fullsized":"2023-09-28T04:24:14.068563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:14.068436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:14.068436+0000","last_clean_scrub_stamp":"2023-09-28T04:24:14.068436+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:23:15.265853+0000","scrub_duration":0.0020986770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960700+0000","last_change":"2023-09-28T04:23:56.636147+0000","last_active":"2023-09-28T04:24:04.960700+0000","last_peered":"2023-09-28T04:24:04.960700+0000","last_clean":"2023-09-28T04:24:04.960700+0000","last_became_active":"2023-09-28T04:23:12.603804+0000","last_became_peered":"2023-09-28T04:23:12.603804+0000","last_unstale":"2023-09-28T04:24:04.960700+0000","last_undegraded":"2023-09-28T04:24:04.960700+0000","last_fullsized":"2023-09-28T04:24:04.960700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:56.636037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:56.636037+0000","last_clean_scrub_stamp":"2023-09-28T04:23:56.636037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:54.478085+0000","scrub_duration":0.001916528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'6","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:11.011384+0000","last_change":"2023-09-28T04:24:11.011356+0000","last_active":"2023-09-28T04:24:11.011384+0000","last_peered":"2023-09-28T04:24:11.011384+0000","last_clean":"2023-09-28T04:24:11.011384+0000","last_became_active":"2023-09-28T04:23:17.918740+0000","last_became_peered":"2023-09-28T04:23:17.918740+0000","last_unstale":"2023-09-28T04:24:11.011384+0000","last_undegraded":"2023-09-28T04:24:11.011384+0000","last_fullsized":"2023-09-28T04:24:11.011384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2023-09-28T04:24:11.011268+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2023-09-28T04:24:11.011268+0000","last_clean_scrub_stamp":"2023-09-28T04:24:11.011268+0000","objects_scrubbed":3,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:19.456139+0000","scrub_duration":0.003788774,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961947+0000","last_change":"2023-09-28T04:24:02.073340+0000","last_active":"2023-09-28T04:24:04.961947+0000","last_peered":"2023-09-28T04:24:04.961947+0000","last_clean":"2023-09-28T04:24:04.961947+0000","last_became_active":"2023-09-28T04:23:18.389059+0000","last_became_peered":"2023-09-28T04:23:18.389059+0000","last_unstale":"2023-09-28T04:24:04.961947+0000","last_undegraded":"2023-09-28T04:24:04.961947+0000","last_fullsized":"2023-09-28T04:24:04.961947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:02.073236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:02.073236+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.073236+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:17.329589+0000","scrub_duration":0.001749675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958963+0000","last_change":"2023-09-28T04:23:47.823943+0000","last_active":"2023-09-28T04:24:04.958963+0000","last_peered":"2023-09-28T04:24:04.958963+0000","last_clean":"2023-09-28T04:24:04.958963+0000","last_became_active":"2023-09-28T04:23:12.601652+0000","last_became_peered":"2023-09-28T04:23:12.601652+0000","last_unstale":"2023-09-28T04:24:04.958963+0000","last_undegraded":"2023-09-28T04:24:04.958963+0000","last_fullsized":"2023-09-28T04:24:04.958963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:47.823864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:47.823864+0000","last_clean_scrub_stamp":"2023-09-28T04:23:47.823864+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:46:58.420448+0000","scrub_duration":0.0014653960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962209+0000","last_change":"2023-09-28T04:23:51.025577+0000","last_active":"2023-09-28T04:24:04.962209+0000","last_peered":"2023-09-28T04:24:04.962209+0000","last_clean":"2023-09-28T04:24:04.962209+0000","last_became_active":"2023-09-28T04:23:17.911308+0000","last_became_peered":"2023-09-28T04:23:17.911308+0000","last_unstale":"2023-09-28T04:24:04.962209+0000","last_undegraded":"2023-09-28T04:24:04.962209+0000","last_fullsized":"2023-09-28T04:24:04.962209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:51.025504+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:51.025504+0000","last_clean_scrub_stamp":"2023-09-28T04:23:51.025504+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:47.478493+0000","scrub_duration":0.0017633309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961254+0000","last_change":"2023-09-28T04:24:04.013915+0000","last_active":"2023-09-28T04:24:04.961254+0000","last_peered":"2023-09-28T04:24:04.961254+0000","last_clean":"2023-09-28T04:24:04.961254+0000","last_became_active":"2023-09-28T04:23:18.387945+0000","last_became_peered":"2023-09-28T04:23:18.387945+0000","last_unstale":"2023-09-28T04:24:04.961254+0000","last_undegraded":"2023-09-28T04:24:04.961254+0000","last_fullsized":"2023-09-28T04:24:04.961254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:04.013825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:04.013825+0000","last_clean_scrub_stamp":"2023-09-28T04:24:04.013825+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:57.158883+0000","scrub_duration":0.0018077939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960722+0000","last_change":"2023-09-28T04:23:57.656015+0000","last_active":"2023-09-28T04:24:04.960722+0000","last_peered":"2023-09-28T04:24:04.960722+0000","last_clean":"2023-09-28T04:24:04.960722+0000","last_became_active":"2023-09-28T04:23:12.603930+0000","last_became_peered":"2023-09-28T04:23:12.603930+0000","last_unstale":"2023-09-28T04:24:04.960722+0000","last_undegraded":"2023-09-28T04:24:04.960722+0000","last_fullsized":"2023-09-28T04:24:04.960722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:57.655933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:57.655933+0000","last_clean_scrub_stamp":"2023-09-28T04:23:57.655933+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:06.094564+0000","scrub_duration":0.0020224029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"21'119","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979187+0000","last_change":"2023-09-28T04:23:50.766454+0000","last_active":"2023-09-28T04:24:04.979187+0000","last_peered":"2023-09-28T04:24:04.979187+0000","last_clean":"2023-09-28T04:24:04.979187+0000","last_became_active":"2023-09-28T04:23:11.608249+0000","last_became_peered":"2023-09-28T04:23:11.608249+0000","last_unstale":"2023-09-28T04:24:04.979187+0000","last_undegraded":"2023-09-28T04:24:04.979187+0000","last_fullsized":"2023-09-28T04:24:04.979187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'119","last_scrub_stamp":"2023-09-28T04:23:50.766319+0000","last_deep_scrub":"21'119","last_deep_scrub_stamp":"2023-09-28T04:23:50.766319+0000","last_clean_scrub_stamp":"2023-09-28T04:23:50.766319+0000","objects_scrubbed":2,"log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:08:01.812993+0000","scrub_duration":0.0050644219999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957100+0000","last_change":"2023-09-28T04:23:58.005588+0000","last_active":"2023-09-28T04:24:04.957100+0000","last_peered":"2023-09-28T04:24:04.957100+0000","last_clean":"2023-09-28T04:24:04.957100+0000","last_became_active":"2023-09-28T04:23:17.902341+0000","last_became_peered":"2023-09-28T04:23:17.902341+0000","last_unstale":"2023-09-28T04:24:04.957100+0000","last_undegraded":"2023-09-28T04:24:04.957100+0000","last_fullsized":"2023-09-28T04:24:04.957100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'1","last_scrub_stamp":"2023-09-28T04:23:58.005486+0000","last_deep_scrub":"21'1","last_deep_scrub_stamp":"2023-09-28T04:23:58.005486+0000","last_clean_scrub_stamp":"2023-09-28T04:23:58.005486+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:13.261839+0000","scrub_duration":0.0018512579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980195+0000","last_change":"2023-09-28T04:23:59.007251+0000","last_active":"2023-09-28T04:24:04.980195+0000","last_peered":"2023-09-28T04:24:04.980195+0000","last_clean":"2023-09-28T04:24:04.980195+0000","last_became_active":"2023-09-28T04:23:18.389692+0000","last_became_peered":"2023-09-28T04:23:18.389692+0000","last_unstale":"2023-09-28T04:24:04.980195+0000","last_undegraded":"2023-09-28T04:24:04.980195+0000","last_fullsized":"2023-09-28T04:24:04.980195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:59.007146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:59.007146+0000","last_clean_scrub_stamp":"2023-09-28T04:23:59.007146+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:43.670556+0000","scrub_duration":0.0017131609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979292+0000","last_change":"2023-09-28T04:23:51.802452+0000","last_active":"2023-09-28T04:24:04.979292+0000","last_peered":"2023-09-28T04:24:04.979292+0000","last_clean":"2023-09-28T04:24:04.979292+0000","last_became_active":"2023-09-28T04:23:12.605668+0000","last_became_peered":"2023-09-28T04:23:12.605668+0000","last_unstale":"2023-09-28T04:24:04.979292+0000","last_undegraded":"2023-09-28T04:24:04.979292+0000","last_fullsized":"2023-09-28T04:24:04.979292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:51.802351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:51.802351+0000","last_clean_scrub_stamp":"2023-09-28T04:23:51.802351+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:48.255340+0000","scrub_duration":0.0022909250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"21'4","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961258+0000","last_change":"2023-09-28T04:23:47.343034+0000","last_active":"2023-09-28T04:24:04.961258+0000","last_peered":"2023-09-28T04:24:04.961258+0000","last_clean":"2023-09-28T04:24:04.961258+0000","last_became_active":"2023-09-28T04:23:17.918130+0000","last_became_peered":"2023-09-28T04:23:17.918130+0000","last_unstale":"2023-09-28T04:24:04.961258+0000","last_undegraded":"2023-09-28T04:24:04.961258+0000","last_fullsized":"2023-09-28T04:24:04.961258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4","last_scrub_stamp":"2023-09-28T04:23:47.342937+0000","last_deep_scrub":"21'4","last_deep_scrub_stamp":"2023-09-28T04:23:47.342937+0000","last_clean_scrub_stamp":"2023-09-28T04:23:47.342937+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:43.795926+0000","scrub_duration":0.0023882230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:07.188744+0000","last_change":"2023-09-28T04:24:07.188712+0000","last_active":"2023-09-28T04:24:07.188744+0000","last_peered":"2023-09-28T04:24:07.188744+0000","last_clean":"2023-09-28T04:24:07.188744+0000","last_became_active":"2023-09-28T04:23:18.391709+0000","last_became_peered":"2023-09-28T04:23:18.391709+0000","last_unstale":"2023-09-28T04:24:07.188744+0000","last_undegraded":"2023-09-28T04:24:07.188744+0000","last_fullsized":"2023-09-28T04:24:07.188744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:07.188594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:07.188594+0000","last_clean_scrub_stamp":"2023-09-28T04:24:07.188594+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:08:13.583991+0000","scrub_duration":0.0016524879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979559+0000","last_change":"2023-09-28T04:23:53.836344+0000","last_active":"2023-09-28T04:24:04.979559+0000","last_peered":"2023-09-28T04:24:04.979559+0000","last_clean":"2023-09-28T04:24:04.979559+0000","last_became_active":"2023-09-28T04:23:13.017398+0000","last_became_peered":"2023-09-28T04:23:13.017398+0000","last_unstale":"2023-09-28T04:24:04.979559+0000","last_undegraded":"2023-09-28T04:24:04.979559+0000","last_fullsized":"2023-09-28T04:24:04.979559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:53.836227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:53.836227+0000","last_clean_scrub_stamp":"2023-09-28T04:23:53.836227+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:38.499638+0000","scrub_duration":0.0019584490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961951+0000","last_change":"2023-09-28T04:23:54.055450+0000","last_active":"2023-09-28T04:24:04.961951+0000","last_peered":"2023-09-28T04:24:04.961951+0000","last_clean":"2023-09-28T04:24:04.961951+0000","last_became_active":"2023-09-28T04:23:17.912023+0000","last_became_peered":"2023-09-28T04:23:17.912023+0000","last_unstale":"2023-09-28T04:24:04.961951+0000","last_undegraded":"2023-09-28T04:24:04.961951+0000","last_fullsized":"2023-09-28T04:24:04.961951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:54.055357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:54.055357+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.055357+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:24.451155+0000","scrub_duration":0.0015336760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:20.098615+0000","last_change":"2023-09-28T04:24:20.098581+0000","last_active":"2023-09-28T04:24:20.098615+0000","last_peered":"2023-09-28T04:24:20.098615+0000","last_clean":"2023-09-28T04:24:20.098615+0000","last_became_active":"2023-09-28T04:23:18.396190+0000","last_became_peered":"2023-09-28T04:23:18.396190+0000","last_unstale":"2023-09-28T04:24:20.098615+0000","last_undegraded":"2023-09-28T04:24:20.098615+0000","last_fullsized":"2023-09-28T04:24:20.098615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:20.098470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:20.098470+0000","last_clean_scrub_stamp":"2023-09-28T04:24:20.098470+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:28.543341+0000","scrub_duration":0.0020626680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'5","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957862+0000","last_change":"2023-09-28T04:23:54.007568+0000","last_active":"2023-09-28T04:24:04.957862+0000","last_peered":"2023-09-28T04:24:04.957862+0000","last_clean":"2023-09-28T04:24:04.957862+0000","last_became_active":"2023-09-28T04:23:17.903844+0000","last_became_peered":"2023-09-28T04:23:17.903844+0000","last_unstale":"2023-09-28T04:24:04.957862+0000","last_undegraded":"2023-09-28T04:24:04.957862+0000","last_fullsized":"2023-09-28T04:24:04.957862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'5","last_scrub_stamp":"2023-09-28T04:23:54.007483+0000","last_deep_scrub":"21'5","last_deep_scrub_stamp":"2023-09-28T04:23:54.007483+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.007483+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:02.446114+0000","scrub_duration":0.0036125480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961733+0000","last_change":"2023-09-28T04:23:48.024392+0000","last_active":"2023-09-28T04:24:04.961733+0000","last_peered":"2023-09-28T04:24:04.961733+0000","last_clean":"2023-09-28T04:24:04.961733+0000","last_became_active":"2023-09-28T04:23:12.606143+0000","last_became_peered":"2023-09-28T04:23:12.606143+0000","last_unstale":"2023-09-28T04:24:04.961733+0000","last_undegraded":"2023-09-28T04:24:04.961733+0000","last_fullsized":"2023-09-28T04:24:04.961733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:48.024316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:48.024316+0000","last_clean_scrub_stamp":"2023-09-28T04:23:48.024316+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:49:31.414222+0000","scrub_duration":0.001689442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:06.038793+0000","last_change":"2023-09-28T04:24:06.038793+0000","last_active":"2023-09-28T04:24:06.038793+0000","last_peered":"2023-09-28T04:24:06.038793+0000","last_clean":"2023-09-28T04:24:06.038793+0000","last_became_active":"2023-09-28T04:23:18.392092+0000","last_became_peered":"2023-09-28T04:23:18.392092+0000","last_unstale":"2023-09-28T04:24:06.038793+0000","last_undegraded":"2023-09-28T04:24:06.038793+0000","last_fullsized":"2023-09-28T04:24:06.038793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980247+0000","last_change":"2023-09-28T04:23:50.941989+0000","last_active":"2023-09-28T04:24:04.980247+0000","last_peered":"2023-09-28T04:24:04.980247+0000","last_clean":"2023-09-28T04:24:04.980247+0000","last_became_active":"2023-09-28T04:23:12.605965+0000","last_became_peered":"2023-09-28T04:23:12.605965+0000","last_unstale":"2023-09-28T04:24:04.980247+0000","last_undegraded":"2023-09-28T04:24:04.980247+0000","last_fullsized":"2023-09-28T04:24:04.980247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:50.941893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:50.941893+0000","last_clean_scrub_stamp":"2023-09-28T04:23:50.941893+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:00:20.487845+0000","scrub_duration":0.001623038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962066+0000","last_change":"2023-09-28T04:23:46.366937+0000","last_active":"2023-09-28T04:24:04.962066+0000","last_peered":"2023-09-28T04:24:04.962066+0000","last_clean":"2023-09-28T04:24:04.962066+0000","last_became_active":"2023-09-28T04:23:17.914697+0000","last_became_peered":"2023-09-28T04:23:17.914697+0000","last_unstale":"2023-09-28T04:24:04.962066+0000","last_undegraded":"2023-09-28T04:24:04.962066+0000","last_fullsized":"2023-09-28T04:24:04.962066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:46.366859+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:46.366859+0000","last_clean_scrub_stamp":"2023-09-28T04:23:46.366859+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:07:57.413533+0000","scrub_duration":0.001760176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:14.078864+0000","last_change":"2023-09-28T04:24:14.078836+0000","last_active":"2023-09-28T04:24:14.078864+0000","last_peered":"2023-09-28T04:24:14.078864+0000","last_clean":"2023-09-28T04:24:14.078864+0000","last_became_active":"2023-09-28T04:23:18.386380+0000","last_became_peered":"2023-09-28T04:23:18.386380+0000","last_unstale":"2023-09-28T04:24:14.078864+0000","last_undegraded":"2023-09-28T04:24:14.078864+0000","last_fullsized":"2023-09-28T04:24:14.078864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:14.078736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:14.078736+0000","last_clean_scrub_stamp":"2023-09-28T04:24:14.078736+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:03:37.749258+0000","scrub_duration":0.001519507,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"21'5","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962194+0000","last_change":"2023-09-28T04:23:49.335161+0000","last_active":"2023-09-28T04:24:04.962194+0000","last_peered":"2023-09-28T04:24:04.962194+0000","last_clean":"2023-09-28T04:24:04.962194+0000","last_became_active":"2023-09-28T04:23:17.918116+0000","last_became_peered":"2023-09-28T04:23:17.918116+0000","last_unstale":"2023-09-28T04:24:04.962194+0000","last_undegraded":"2023-09-28T04:24:04.962194+0000","last_fullsized":"2023-09-28T04:24:04.962194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'5","last_scrub_stamp":"2023-09-28T04:23:49.335088+0000","last_deep_scrub":"21'5","last_deep_scrub_stamp":"2023-09-28T04:23:49.335088+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.335088+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:33.998499+0000","scrub_duration":0.002053263,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958898+0000","last_change":"2023-09-28T04:23:50.777493+0000","last_active":"2023-09-28T04:24:04.958898+0000","last_peered":"2023-09-28T04:24:04.958898+0000","last_clean":"2023-09-28T04:24:04.958898+0000","last_became_active":"2023-09-28T04:23:18.384930+0000","last_became_peered":"2023-09-28T04:23:18.384930+0000","last_unstale":"2023-09-28T04:24:04.958898+0000","last_undegraded":"2023-09-28T04:24:04.958898+0000","last_fullsized":"2023-09-28T04:24:04.958898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:50.777427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:50.777427+0000","last_clean_scrub_stamp":"2023-09-28T04:23:50.777427+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:00:20.323379+0000","scrub_duration":0.0012506990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960799+0000","last_change":"2023-09-28T04:24:03.718903+0000","last_active":"2023-09-28T04:24:04.960799+0000","last_peered":"2023-09-28T04:24:04.960799+0000","last_clean":"2023-09-28T04:24:04.960799+0000","last_became_active":"2023-09-28T04:23:17.905667+0000","last_became_peered":"2023-09-28T04:23:17.905667+0000","last_unstale":"2023-09-28T04:24:04.960799+0000","last_undegraded":"2023-09-28T04:24:04.960799+0000","last_fullsized":"2023-09-28T04:24:04.960799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:24:03.718793+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:24:03.718793+0000","last_clean_scrub_stamp":"2023-09-28T04:24:03.718793+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:56.863850+0000","scrub_duration":0.0029125269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958376+0000","last_change":"2023-09-28T04:23:18.400970+0000","last_active":"2023-09-28T04:24:04.958376+0000","last_peered":"2023-09-28T04:24:04.958376+0000","last_clean":"2023-09-28T04:24:04.958376+0000","last_became_active":"2023-09-28T04:23:18.400683+0000","last_became_peered":"2023-09-28T04:23:18.400683+0000","last_unstale":"2023-09-28T04:24:04.958376+0000","last_undegraded":"2023-09-28T04:24:04.958376+0000","last_fullsized":"2023-09-28T04:24:04.958376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'6","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:15.578635+0000","last_change":"2023-09-28T04:24:15.578599+0000","last_active":"2023-09-28T04:24:15.578635+0000","last_peered":"2023-09-28T04:24:15.578635+0000","last_clean":"2023-09-28T04:24:15.578635+0000","last_became_active":"2023-09-28T04:23:17.904895+0000","last_became_peered":"2023-09-28T04:23:17.904895+0000","last_unstale":"2023-09-28T04:24:15.578635+0000","last_undegraded":"2023-09-28T04:24:15.578635+0000","last_fullsized":"2023-09-28T04:24:15.578635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2023-09-28T04:24:15.578513+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2023-09-28T04:24:15.578513+0000","last_clean_scrub_stamp":"2023-09-28T04:24:15.578513+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:29.086305+0000","scrub_duration":0.0035109989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958425+0000","last_change":"2023-09-28T04:23:53.988936+0000","last_active":"2023-09-28T04:24:04.958425+0000","last_peered":"2023-09-28T04:24:04.958425+0000","last_clean":"2023-09-28T04:24:04.958425+0000","last_became_active":"2023-09-28T04:23:18.400410+0000","last_became_peered":"2023-09-28T04:23:18.400410+0000","last_unstale":"2023-09-28T04:24:04.958425+0000","last_undegraded":"2023-09-28T04:24:04.958425+0000","last_fullsized":"2023-09-28T04:24:04.958425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:53.988832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:53.988832+0000","last_clean_scrub_stamp":"2023-09-28T04:23:53.988832+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:47.133890+0000","scrub_duration":0.0018249080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'2","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957853+0000","last_change":"2023-09-28T04:24:02.045496+0000","last_active":"2023-09-28T04:24:04.957853+0000","last_peered":"2023-09-28T04:24:04.957853+0000","last_clean":"2023-09-28T04:24:04.957853+0000","last_became_active":"2023-09-28T04:23:17.905198+0000","last_became_peered":"2023-09-28T04:23:17.905198+0000","last_unstale":"2023-09-28T04:24:04.957853+0000","last_undegraded":"2023-09-28T04:24:04.957853+0000","last_fullsized":"2023-09-28T04:24:04.957853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'2","last_scrub_stamp":"2023-09-28T04:24:02.045403+0000","last_deep_scrub":"21'2","last_deep_scrub_stamp":"2023-09-28T04:24:02.045403+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.045403+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:35:38.580346+0000","scrub_duration":0.0016629049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:21.247572+0000","last_change":"2023-09-28T04:24:21.247525+0000","last_active":"2023-09-28T04:24:21.247572+0000","last_peered":"2023-09-28T04:24:21.247572+0000","last_clean":"2023-09-28T04:24:21.247572+0000","last_became_active":"2023-09-28T04:23:18.392400+0000","last_became_peered":"2023-09-28T04:23:18.392400+0000","last_unstale":"2023-09-28T04:24:21.247572+0000","last_undegraded":"2023-09-28T04:24:21.247572+0000","last_fullsized":"2023-09-28T04:24:21.247572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:21.247418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:21.247418+0000","last_clean_scrub_stamp":"2023-09-28T04:24:21.247418+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:03:44.917940+0000","scrub_duration":0.001595677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'11","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962550+0000","last_change":"2023-09-28T04:24:01.316338+0000","last_active":"2023-09-28T04:24:04.962550+0000","last_peered":"2023-09-28T04:24:04.962550+0000","last_clean":"2023-09-28T04:24:04.962550+0000","last_became_active":"2023-09-28T04:23:17.917266+0000","last_became_peered":"2023-09-28T04:23:17.917266+0000","last_unstale":"2023-09-28T04:24:04.962550+0000","last_undegraded":"2023-09-28T04:24:04.962550+0000","last_fullsized":"2023-09-28T04:24:04.962550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'11","last_scrub_stamp":"2023-09-28T04:24:01.316223+0000","last_deep_scrub":"21'11","last_deep_scrub_stamp":"2023-09-28T04:24:01.316223+0000","last_clean_scrub_stamp":"2023-09-28T04:24:01.316223+0000","objects_scrubbed":4,"log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:54.461281+0000","scrub_duration":0.0043941819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:19.091427+0000","last_change":"2023-09-28T04:24:19.091392+0000","last_active":"2023-09-28T04:24:19.091427+0000","last_peered":"2023-09-28T04:24:19.091427+0000","last_clean":"2023-09-28T04:24:19.091427+0000","last_became_active":"2023-09-28T04:23:18.386051+0000","last_became_peered":"2023-09-28T04:23:18.386051+0000","last_unstale":"2023-09-28T04:24:19.091427+0000","last_undegraded":"2023-09-28T04:24:19.091427+0000","last_fullsized":"2023-09-28T04:24:19.091427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:19.091255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:19.091255+0000","last_clean_scrub_stamp":"2023-09-28T04:24:19.091255+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:58:13.553932+0000","scrub_duration":0.001562742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980037+0000","last_change":"2023-09-28T04:23:56.946309+0000","last_active":"2023-09-28T04:24:04.980037+0000","last_peered":"2023-09-28T04:24:04.980037+0000","last_clean":"2023-09-28T04:24:04.980037+0000","last_became_active":"2023-09-28T04:23:18.389280+0000","last_became_peered":"2023-09-28T04:23:18.389280+0000","last_unstale":"2023-09-28T04:24:04.980037+0000","last_undegraded":"2023-09-28T04:24:04.980037+0000","last_fullsized":"2023-09-28T04:24:04.980037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:56.946199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:56.946199+0000","last_clean_scrub_stamp":"2023-09-28T04:23:56.946199+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:53.399188+0000","scrub_duration":0.001773848,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:25.393406+0000","last_change":"2023-09-28T04:24:25.393360+0000","last_active":"2023-09-28T04:24:25.393406+0000","last_peered":"2023-09-28T04:24:25.393406+0000","last_clean":"2023-09-28T04:24:25.393406+0000","last_became_active":"2023-09-28T04:23:18.390929+0000","last_became_peered":"2023-09-28T04:23:18.390929+0000","last_unstale":"2023-09-28T04:24:25.393406+0000","last_undegraded":"2023-09-28T04:24:25.393406+0000","last_fullsized":"2023-09-28T04:24:25.393406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:25.393275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:25.393275+0000","last_clean_scrub_stamp":"2023-09-28T04:24:25.393275+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:58:19.855952+0000","scrub_duration":0.0014251139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958329+0000","last_change":"2023-09-28T04:23:18.387348+0000","last_active":"2023-09-28T04:24:04.958329+0000","last_peered":"2023-09-28T04:24:04.958329+0000","last_clean":"2023-09-28T04:24:04.958329+0000","last_became_active":"2023-09-28T04:23:18.385870+0000","last_became_peered":"2023-09-28T04:23:18.385870+0000","last_unstale":"2023-09-28T04:24:04.958329+0000","last_undegraded":"2023-09-28T04:24:04.958329+0000","last_fullsized":"2023-09-28T04:24:04.958329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:17.881928+0000","last_clean_scrub_stamp":"2023-09-28T04:23:17.881928+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:26.363453+0000","last_change":"2023-09-28T04:24:26.363407+0000","last_active":"2023-09-28T04:24:26.363453+0000","last_peered":"2023-09-28T04:24:26.363453+0000","last_clean":"2023-09-28T04:24:26.363453+0000","last_became_active":"2023-09-28T04:23:18.392245+0000","last_became_peered":"2023-09-28T04:23:18.392245+0000","last_unstale":"2023-09-28T04:24:26.363453+0000","last_undegraded":"2023-09-28T04:24:26.363453+0000","last_fullsized":"2023-09-28T04:24:26.363453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:26.363303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:26.363303+0000","last_clean_scrub_stamp":"2023-09-28T04:24:26.363303+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:23:13.178221+0000","scrub_duration":0.002114267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:06.038524+0000","last_change":"2023-09-28T04:24:06.038471+0000","last_active":"2023-09-28T04:24:06.038524+0000","last_peered":"2023-09-28T04:24:06.038524+0000","last_clean":"2023-09-28T04:24:06.038524+0000","last_became_active":"2023-09-28T04:23:18.391256+0000","last_became_peered":"2023-09-28T04:23:18.391256+0000","last_unstale":"2023-09-28T04:24:06.038524+0000","last_undegraded":"2023-09-28T04:24:06.038524+0000","last_fullsized":"2023-09-28T04:24:06.038524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:06.038393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:06.038393+0000","last_clean_scrub_stamp":"2023-09-28T04:24:06.038393+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:35:42.573336+0000","scrub_duration":0.0017123869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4966,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14640,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":9932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9112,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362728,"statfs":{"total":96636764160,"available":96627433472,"internally_reserved":0,"allocated":344064,"data_stored":685133,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.72799999999999998}]},{"osd":1,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.622},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8444,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363396,"statfs":{"total":96636764160,"available":96628117504,"internally_reserved":0,"allocated":249856,"data_stored":92031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":7.8159999999999998,"5min":7.8159999999999998,"15min":7.8159999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.9319999999999999,"5min":3.9319999999999999,"15min":3.9319999999999999},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":3.524,"5min":3.524,"15min":3.524},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":4.1870000000000003,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":7.9989999999999997,"5min":7.9989999999999997,"15min":7.9989999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":7.9740000000000002,"5min":7.9740000000000002,"15min":7.9740000000000002},"last":0.626}]},{"osd":4,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":5.8940000000000001,"5min":5.8940000000000001,"15min":5.8940000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":5.4139999999999997,"5min":5.4139999999999997,"15min":5.4139999999999997},"last":0.503}]},{"osd":5,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.8799999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8500,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363340,"statfs":{"total":96636764160,"available":96628060160,"internally_reserved":0,"allocated":241664,"data_stored":91919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":339968,"data_stored":683741,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.63300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8376,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363464,"statfs":{"total":96636764160,"available":96628187136,"internally_reserved":0,"allocated":245760,"data_stored":92009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.622},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.90600000000000003}]},{"osd":6,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.876},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.83299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8516,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363324,"statfs":{"total":96636764160,"available":96628043776,"internally_reserved":0,"allocated":258048,"data_stored":93139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":8.1270000000000007,"5min":8.1270000000000007,"15min":8.1270000000000007},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.0489999999999999,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":0.496}]},{"osd":4,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.9380000000000002,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.88},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":0.86699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8608,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363232,"statfs":{"total":96636764160,"available":96627949568,"internally_reserved":0,"allocated":286720,"data_stored":94839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.504},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.33100000000000002}]},{"osd":6,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.40699999999999997}]},{"osd":7,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8520,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363320,"statfs":{"total":96636764160,"available":96628039680,"internally_reserved":0,"allocated":262144,"data_stored":93209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.443},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.499}]},{"osd":3,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.314},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.36699999999999999}]},{"osd":7,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.39000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T04:24:31.759 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.759 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.759 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.759 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.759 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.759 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.760 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.760 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.760 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.760 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.761 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.761 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.761 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.762 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-09-28T04:23:17.881928+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=17, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=4, tm_min=23, tm_sec=44, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T04:24:31.762 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T04:24:51.763 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T04:24:51.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.962+0000 7f757f7ff700 1 Processor -- start 2023-09-28T04:24:51.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.962+0000 7f757f7ff700 1 -- start start 2023-09-28T04:24:51.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.963+0000 7f757f7ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f75780c0ca0 0x7f7578152370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:51.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.963+0000 7f757f7ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f75780c4310 0x7f75780c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:51.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.963+0000 7f757f7ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75780c3450 con 0x7f757814c6a0 2023-09-28T04:24:51.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.963+0000 7f757f7ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75780bfbb0 con 0x7f75780c4310 2023-09-28T04:24:51.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.963+0000 7f757f7ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757814ca70 con 0x7f75780c0ca0 2023-09-28T04:24:51.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.964+0000 7f757dd9c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f75780c4310 0x7f75780c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:51.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.964+0000 7f757dd9c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f75780c4310 0x7f75780c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51066/0 (socket says 172.21.15.118:51066) 2023-09-28T04:24:51.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.964+0000 7f757dd9c700 1 -- 172.21.15.118:0/3603655325 learned_addr learned my addr 172.21.15.118:0/3603655325 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:51.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.964+0000 7f757cd9a700 1 --2- 172.21.15.118:0/3603655325 >> v2:172.21.15.174:3300/0 conn(0x7f75780c0ca0 0x7f7578152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:51.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.964+0000 7f757dd9c700 1 -- 172.21.15.118:0/3603655325 >> v2:172.21.15.174:3300/0 conn(0x7f75780c0ca0 msgr2=0x7f7578152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:24:51.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.964+0000 7f757dd9c700 1 --2- 172.21.15.118:0/3603655325 >> v2:172.21.15.174:3300/0 conn(0x7f75780c0ca0 0x7f7578152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:51.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.964+0000 7f757dd9c700 1 -- 172.21.15.118:0/3603655325 >> v1:172.21.15.174:6789/0 conn(0x7f757814c6a0 legacy=0x7f75780c0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:51.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.964+0000 7f757dd9c700 1 -- 172.21.15.118:0/3603655325 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75780c2560 con 0x7f75780c4310 2023-09-28T04:24:51.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.964+0000 7f756ffff700 1 -- 172.21.15.118:0/3603655325 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238044458 0 0) 0x7f75780c3450 con 0x7f757814c6a0 2023-09-28T04:24:51.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.964+0000 7f757dd9c700 1 --2- 172.21.15.118:0/3603655325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75780c4310 0x7f75780c4790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f757806d210 tx=0x7f7570009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f798225a6b920dd server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:51.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.964+0000 7f756ffff700 1 -- 172.21.15.118:0/3603655325 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000e070 con 0x7f75780c4310 2023-09-28T04:24:51.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.965+0000 7f756ffff700 1 -- 172.21.15.118:0/3603655325 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757000ba20 con 0x7f75780c4310 2023-09-28T04:24:51.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.965+0000 7f756ffff700 1 -- 172.21.15.118:0/3603655325 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75700092e0 con 0x7f75780c4310 2023-09-28T04:24:51.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.965+0000 7f757f7ff700 1 -- 172.21.15.118:0/3603655325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75780c4310 msgr2=0x7f75780c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:51.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.965+0000 7f757f7ff700 1 --2- 172.21.15.118:0/3603655325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75780c4310 0x7f75780c4790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f757806d210 tx=0x7f7570009840 comp rx=0 tx=0).stop 2023-09-28T04:24:51.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.965+0000 7f757f7ff700 1 -- 172.21.15.118:0/3603655325 shutdown_connections 2023-09-28T04:24:51.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.965+0000 7f757f7ff700 1 --2- 172.21.15.118:0/3603655325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75780c4310 0x7f75780c4790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:51.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.965+0000 7f757f7ff700 1 --2- 172.21.15.118:0/3603655325 >> v2:172.21.15.174:3300/0 conn(0x7f75780c0ca0 0x7f7578152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:51.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.965+0000 7f757f7ff700 1 -- 172.21.15.118:0/3603655325 >> 172.21.15.118:0/3603655325 conn(0x7f7578067630 msgr2=0x7f7578067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:51.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.965+0000 7f757f7ff700 1 -- 172.21.15.118:0/3603655325 shutdown_connections 2023-09-28T04:24:51.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.965+0000 7f757f7ff700 1 -- 172.21.15.118:0/3603655325 wait complete. 2023-09-28T04:24:51.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.967+0000 7f757f7ff700 1 Processor -- start 2023-09-28T04:24:51.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.967+0000 7f757f7ff700 1 -- start start 2023-09-28T04:24:51.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757f7ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75780c0ca0 0x7f7578151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:51.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757f7ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75780c4310 0x7f7578165370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:51.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757f7ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f757814c6a0 0x7f757814a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:51.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757f7ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75781692c0 con 0x7f75780c0ca0 2023-09-28T04:24:51.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757f7ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7578151cc0 con 0x7f757814c6a0 2023-09-28T04:24:51.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757f7ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7578169750 con 0x7f75780c4310 2023-09-28T04:24:51.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757d59b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75780c0ca0 0x7f7578151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:51.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757d59b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75780c0ca0 0x7f7578151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51072/0 (socket says 172.21.15.118:51072) 2023-09-28T04:24:51.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757d59b700 1 -- 172.21.15.118:0/2991101655 learned_addr learned my addr 172.21.15.118:0/2991101655 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:51.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757cd9a700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75780c4310 0x7f7578165370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:51.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757dd9c700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f757814c6a0 0x7f757814a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:51.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757d59b700 1 -- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75780c4310 msgr2=0x7f7578165370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:51.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757d59b700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75780c4310 0x7f7578165370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:51.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757d59b700 1 -- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f757814c6a0 msgr2=0x7f757814a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:51.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757d59b700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f757814c6a0 0x7f757814a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:51.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757d59b700 1 -- 172.21.15.118:0/2991101655 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7570009ae0 con 0x7f75780c0ca0 2023-09-28T04:24:51.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.968+0000 7f757d59b700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75780c0ca0 0x7f7578151370 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f757400c530 tx=0x7f757400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:51.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.969+0000 7f756d7fa700 1 -- 172.21.15.118:0/2991101655 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574011590 con 0x7f75780c0ca0 2023-09-28T04:24:51.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.969+0000 7f756d7fa700 1 -- 172.21.15.118:0/2991101655 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7574011710 con 0x7f75780c0ca0 2023-09-28T04:24:51.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.969+0000 7f757f7ff700 1 -- 172.21.15.118:0/2991101655 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7578153540 con 0x7f75780c0ca0 2023-09-28T04:24:51.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.969+0000 7f756d7fa700 1 -- 172.21.15.118:0/2991101655 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574011ad0 con 0x7f75780c0ca0 2023-09-28T04:24:51.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.969+0000 7f757f7ff700 1 -- 172.21.15.118:0/2991101655 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7578168990 con 0x7f75780c0ca0 2023-09-28T04:24:51.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.970+0000 7f757f7ff700 1 -- 172.21.15.118:0/2991101655 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7578071980 con 0x7f75780c0ca0 2023-09-28T04:24:51.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.971+0000 7f756d7fa700 1 -- 172.21.15.118:0/2991101655 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7574001010 con 0x7f75780c0ca0 2023-09-28T04:24:51.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.971+0000 7f756d7fa700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f755c067330 0x7f755c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:51.974 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.972+0000 7f756d7fa700 1 -- 172.21.15.118:0/2991101655 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f7574083fe0 con 0x7f75780c0ca0 2023-09-28T04:24:51.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.972+0000 7f757cd9a700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f755c067330 0x7f755c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:51.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.972+0000 7f757cd9a700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f755c067330 0x7f755c0697e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f75780c8130 tx=0x7f75680091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:51.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:51.976+0000 7f756d7fa700 1 -- 172.21.15.118:0/2991101655 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7574050e40 con 0x7f75780c0ca0 2023-09-28T04:24:52.034 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T04:24:52.038 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T04:24:52.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.170+0000 7f757f7ff700 1 -- 172.21.15.118:0/2991101655 --> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7578169400 con 0x7f755c067330 2023-09-28T04:24:52.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.180+0000 7f756d7fa700 1 -- 172.21.15.118:0/2991101655 <== mgr.4105 v2:172.21.15.174:6832/119178 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311266 (secure 0 0 0) 0x7f7568011a20 con 0x7f755c067330 2023-09-28T04:24:52.184 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:24:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.184+0000 7f757f7ff700 1 -- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f755c067330 msgr2=0x7f755c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.184+0000 7f757f7ff700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f755c067330 0x7f755c0697e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f75780c8130 tx=0x7f75680091a0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.184+0000 7f757f7ff700 1 -- 172.21.15.118:0/2991101655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75780c0ca0 msgr2=0x7f7578151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.184+0000 7f757f7ff700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75780c0ca0 0x7f7578151370 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f757400c530 tx=0x7f757400c840 comp rx=0 tx=0).stop 2023-09-28T04:24:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.184+0000 7f757f7ff700 1 -- 172.21.15.118:0/2991101655 shutdown_connections 2023-09-28T04:24:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.184+0000 7f757f7ff700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f755c067330 0x7f755c0697e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.184+0000 7f757f7ff700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f757814c6a0 0x7f757814a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.184+0000 7f757f7ff700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75780c0ca0 0x7f7578151370 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.184+0000 7f757f7ff700 1 --2- 172.21.15.118:0/2991101655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75780c4310 0x7f7578165370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.184+0000 7f757f7ff700 1 -- 172.21.15.118:0/2991101655 >> 172.21.15.118:0/2991101655 conn(0x7f7578067630 msgr2=0x7f757814b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:52.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.184+0000 7f757f7ff700 1 -- 172.21.15.118:0/2991101655 shutdown_connections 2023-09-28T04:24:52.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.184+0000 7f757f7ff700 1 -- 172.21.15.118:0/2991101655 wait complete. 2023-09-28T04:24:52.188 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-09-28T04:24:52.202 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-09-28T04:24:50.549200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595334,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":284,"num_write_kb":2451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14640,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":260,"ondisk_log_size":260,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69184,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":66944,"kb_avail":754905536,"statfs":{"total":773094113280,"available":773023268864,"internally_reserved":0,"allocated":2228224,"data_stored":1926020,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68550656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003073"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958623+0000","last_change":"2023-09-28T04:23:57.902240+0000","last_active":"2023-09-28T04:24:04.958623+0000","last_peered":"2023-09-28T04:24:04.958623+0000","last_clean":"2023-09-28T04:24:04.958623+0000","last_became_active":"2023-09-28T04:23:18.400107+0000","last_became_peered":"2023-09-28T04:23:18.400107+0000","last_unstale":"2023-09-28T04:24:04.958623+0000","last_undegraded":"2023-09-28T04:24:04.958623+0000","last_fullsized":"2023-09-28T04:24:04.958623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:57.902154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:57.902154+0000","last_clean_scrub_stamp":"2023-09-28T04:23:57.902154+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:54.355143+0000","scrub_duration":0.001620238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:34.693851+0000","last_change":"2023-09-28T04:24:34.693823+0000","last_active":"2023-09-28T04:24:34.693851+0000","last_peered":"2023-09-28T04:24:34.693851+0000","last_clean":"2023-09-28T04:24:34.693851+0000","last_became_active":"2023-09-28T04:23:18.384789+0000","last_became_peered":"2023-09-28T04:23:18.384789+0000","last_unstale":"2023-09-28T04:24:34.693851+0000","last_undegraded":"2023-09-28T04:24:34.693851+0000","last_fullsized":"2023-09-28T04:24:34.693851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:34.693727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:34.693727+0000","last_clean_scrub_stamp":"2023-09-28T04:24:34.693727+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:10:57.764475+0000","scrub_duration":0.0022385730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:43.127128+0000","last_change":"2023-09-28T04:24:43.127099+0000","last_active":"2023-09-28T04:24:43.127128+0000","last_peered":"2023-09-28T04:24:43.127128+0000","last_clean":"2023-09-28T04:24:43.127128+0000","last_became_active":"2023-09-28T04:23:18.390599+0000","last_became_peered":"2023-09-28T04:23:18.390599+0000","last_unstale":"2023-09-28T04:24:43.127128+0000","last_undegraded":"2023-09-28T04:24:43.127128+0000","last_fullsized":"2023-09-28T04:24:43.127128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:43.126997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:43.126997+0000","last_clean_scrub_stamp":"2023-09-28T04:24:43.126997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:19:49.036112+0000","scrub_duration":0.0020902859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980319+0000","last_change":"2023-09-28T04:24:02.002562+0000","last_active":"2023-09-28T04:24:04.980319+0000","last_peered":"2023-09-28T04:24:04.980319+0000","last_clean":"2023-09-28T04:24:04.980319+0000","last_became_active":"2023-09-28T04:23:18.390607+0000","last_became_peered":"2023-09-28T04:23:18.390607+0000","last_unstale":"2023-09-28T04:24:04.980319+0000","last_undegraded":"2023-09-28T04:24:04.980319+0000","last_fullsized":"2023-09-28T04:24:04.980319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:02.002433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:02.002433+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.002433+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:59.844481+0000","scrub_duration":0.0021539319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:29.144775+0000","last_change":"2023-09-28T04:24:29.144745+0000","last_active":"2023-09-28T04:24:29.144775+0000","last_peered":"2023-09-28T04:24:29.144775+0000","last_clean":"2023-09-28T04:24:29.144775+0000","last_became_active":"2023-09-28T04:24:05.980489+0000","last_became_peered":"2023-09-28T04:24:05.980489+0000","last_unstale":"2023-09-28T04:24:29.144775+0000","last_undegraded":"2023-09-28T04:24:29.144775+0000","last_fullsized":"2023-09-28T04:24:29.144775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:29.144616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:29.144616+0000","last_clean_scrub_stamp":"2023-09-28T04:24:29.144616+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:23:15.959534+0000","scrub_duration":0.0015750880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:46.115136+0000","last_change":"2023-09-28T04:24:46.115109+0000","last_active":"2023-09-28T04:24:46.115136+0000","last_peered":"2023-09-28T04:24:46.115136+0000","last_clean":"2023-09-28T04:24:46.115136+0000","last_became_active":"2023-09-28T04:23:18.390575+0000","last_became_peered":"2023-09-28T04:23:18.390575+0000","last_unstale":"2023-09-28T04:24:46.115136+0000","last_undegraded":"2023-09-28T04:24:46.115136+0000","last_fullsized":"2023-09-28T04:24:46.115136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:46.115013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:46.115013+0000","last_clean_scrub_stamp":"2023-09-28T04:24:46.115013+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:35:54.595556+0000","scrub_duration":0.0019921829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:25.319298+0000","last_change":"2023-09-28T04:24:25.319273+0000","last_active":"2023-09-28T04:24:25.319298+0000","last_peered":"2023-09-28T04:24:25.319298+0000","last_clean":"2023-09-28T04:24:25.319298+0000","last_became_active":"2023-09-28T04:23:18.396038+0000","last_became_peered":"2023-09-28T04:23:18.396038+0000","last_unstale":"2023-09-28T04:24:25.319298+0000","last_undegraded":"2023-09-28T04:24:25.319298+0000","last_fullsized":"2023-09-28T04:24:25.319298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:25.319182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:25.319182+0000","last_clean_scrub_stamp":"2023-09-28T04:24:25.319182+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:56:26.909111+0000","scrub_duration":0.0018734209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:38.734062+0000","last_change":"2023-09-28T04:24:38.734036+0000","last_active":"2023-09-28T04:24:38.734062+0000","last_peered":"2023-09-28T04:24:38.734062+0000","last_clean":"2023-09-28T04:24:38.734062+0000","last_became_active":"2023-09-28T04:23:18.387260+0000","last_became_peered":"2023-09-28T04:23:18.387260+0000","last_unstale":"2023-09-28T04:24:38.734062+0000","last_undegraded":"2023-09-28T04:24:38.734062+0000","last_fullsized":"2023-09-28T04:24:38.734062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:38.733917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:38.733917+0000","last_clean_scrub_stamp":"2023-09-28T04:24:38.733917+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:10:16.662228+0000","scrub_duration":0.001447093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:42.184589+0000","last_change":"2023-09-28T04:24:42.184560+0000","last_active":"2023-09-28T04:24:42.184589+0000","last_peered":"2023-09-28T04:24:42.184589+0000","last_clean":"2023-09-28T04:24:42.184589+0000","last_became_active":"2023-09-28T04:23:18.403565+0000","last_became_peered":"2023-09-28T04:23:18.403565+0000","last_unstale":"2023-09-28T04:24:42.184589+0000","last_undegraded":"2023-09-28T04:24:42.184589+0000","last_fullsized":"2023-09-28T04:24:42.184589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:42.184468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:42.184468+0000","last_clean_scrub_stamp":"2023-09-28T04:24:42.184468+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:44:16.962336+0000","scrub_duration":0.0016807409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:22.579159+0000","last_change":"2023-09-28T04:24:22.579132+0000","last_active":"2023-09-28T04:24:22.579159+0000","last_peered":"2023-09-28T04:24:22.579159+0000","last_clean":"2023-09-28T04:24:22.579159+0000","last_became_active":"2023-09-28T04:23:18.390911+0000","last_became_peered":"2023-09-28T04:23:18.390911+0000","last_unstale":"2023-09-28T04:24:22.579159+0000","last_undegraded":"2023-09-28T04:24:22.579159+0000","last_fullsized":"2023-09-28T04:24:22.579159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:22.579035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:22.579035+0000","last_clean_scrub_stamp":"2023-09-28T04:24:22.579035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:31.023906+0000","scrub_duration":0.0018620100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:38.090865+0000","last_change":"2023-09-28T04:24:38.090826+0000","last_active":"2023-09-28T04:24:38.090865+0000","last_peered":"2023-09-28T04:24:38.090865+0000","last_clean":"2023-09-28T04:24:38.090865+0000","last_became_active":"2023-09-28T04:23:18.393524+0000","last_became_peered":"2023-09-28T04:23:18.393524+0000","last_unstale":"2023-09-28T04:24:38.090865+0000","last_undegraded":"2023-09-28T04:24:38.090865+0000","last_fullsized":"2023-09-28T04:24:38.090865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:38.090652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:38.090652+0000","last_clean_scrub_stamp":"2023-09-28T04:24:38.090652+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:17:24.551164+0000","scrub_duration":0.0023156740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958887+0000","last_change":"2023-09-28T04:23:56.891326+0000","last_active":"2023-09-28T04:24:04.958887+0000","last_peered":"2023-09-28T04:24:04.958887+0000","last_clean":"2023-09-28T04:24:04.958887+0000","last_became_active":"2023-09-28T04:23:18.384986+0000","last_became_peered":"2023-09-28T04:23:18.384986+0000","last_unstale":"2023-09-28T04:24:04.958887+0000","last_undegraded":"2023-09-28T04:24:04.958887+0000","last_fullsized":"2023-09-28T04:24:04.958887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:56.891226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:56.891226+0000","last_clean_scrub_stamp":"2023-09-28T04:23:56.891226+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:08:07.937900+0000","scrub_duration":0.0017418970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958728+0000","last_change":"2023-09-28T04:23:54.890454+0000","last_active":"2023-09-28T04:24:04.958728+0000","last_peered":"2023-09-28T04:24:04.958728+0000","last_clean":"2023-09-28T04:24:04.958728+0000","last_became_active":"2023-09-28T04:23:18.402161+0000","last_became_peered":"2023-09-28T04:23:18.402161+0000","last_unstale":"2023-09-28T04:24:04.958728+0000","last_undegraded":"2023-09-28T04:24:04.958728+0000","last_fullsized":"2023-09-28T04:24:04.958728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:54.890326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:54.890326+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.890326+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:49:38.280232+0000","scrub_duration":0.0015513899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:30.579233+0000","last_change":"2023-09-28T04:24:30.579205+0000","last_active":"2023-09-28T04:24:30.579233+0000","last_peered":"2023-09-28T04:24:30.579233+0000","last_clean":"2023-09-28T04:24:30.579233+0000","last_became_active":"2023-09-28T04:23:18.387471+0000","last_became_peered":"2023-09-28T04:23:18.387471+0000","last_unstale":"2023-09-28T04:24:30.579233+0000","last_undegraded":"2023-09-28T04:24:30.579233+0000","last_fullsized":"2023-09-28T04:24:30.579233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:30.579114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:30.579114+0000","last_clean_scrub_stamp":"2023-09-28T04:24:30.579114+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:58:25.041791+0000","scrub_duration":0.0021686600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:16.223152+0000","last_change":"2023-09-28T04:24:16.223112+0000","last_active":"2023-09-28T04:24:16.223152+0000","last_peered":"2023-09-28T04:24:16.223152+0000","last_clean":"2023-09-28T04:24:16.223152+0000","last_became_active":"2023-09-28T04:23:18.396395+0000","last_became_peered":"2023-09-28T04:23:18.396395+0000","last_unstale":"2023-09-28T04:24:16.223152+0000","last_undegraded":"2023-09-28T04:24:16.223152+0000","last_fullsized":"2023-09-28T04:24:16.223152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:16.223014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:16.223014+0000","last_clean_scrub_stamp":"2023-09-28T04:24:16.223014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:44:44.110757+0000","scrub_duration":0.0022018570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958149+0000","last_change":"2023-09-28T04:23:54.995899+0000","last_active":"2023-09-28T04:24:04.958149+0000","last_peered":"2023-09-28T04:24:04.958149+0000","last_clean":"2023-09-28T04:24:04.958149+0000","last_became_active":"2023-09-28T04:23:18.393683+0000","last_became_peered":"2023-09-28T04:23:18.393683+0000","last_unstale":"2023-09-28T04:24:04.958149+0000","last_undegraded":"2023-09-28T04:24:04.958149+0000","last_fullsized":"2023-09-28T04:24:04.958149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:54.995805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:54.995805+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.995805+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:35:31.530749+0000","scrub_duration":0.0019654,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:23.084535+0000","last_change":"2023-09-28T04:24:23.084502+0000","last_active":"2023-09-28T04:24:23.084535+0000","last_peered":"2023-09-28T04:24:23.084535+0000","last_clean":"2023-09-28T04:24:23.084535+0000","last_became_active":"2023-09-28T04:23:18.402275+0000","last_became_peered":"2023-09-28T04:23:18.402275+0000","last_unstale":"2023-09-28T04:24:23.084535+0000","last_undegraded":"2023-09-28T04:24:23.084535+0000","last_fullsized":"2023-09-28T04:24:23.084535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:23.084416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:23.084416+0000","last_clean_scrub_stamp":"2023-09-28T04:24:23.084416+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:03:46.754938+0000","scrub_duration":0.001654151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:27.170330+0000","last_change":"2023-09-28T04:24:27.170265+0000","last_active":"2023-09-28T04:24:27.170330+0000","last_peered":"2023-09-28T04:24:27.170330+0000","last_clean":"2023-09-28T04:24:27.170330+0000","last_became_active":"2023-09-28T04:23:18.390678+0000","last_became_peered":"2023-09-28T04:23:18.390678+0000","last_unstale":"2023-09-28T04:24:27.170330+0000","last_undegraded":"2023-09-28T04:24:27.170330+0000","last_fullsized":"2023-09-28T04:24:27.170330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:27.170155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:27.170155+0000","last_clean_scrub_stamp":"2023-09-28T04:24:27.170155+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:10:05.098466+0000","scrub_duration":0.0021985640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958958+0000","last_change":"2023-09-28T04:23:49.794039+0000","last_active":"2023-09-28T04:24:04.958958+0000","last_peered":"2023-09-28T04:24:04.958958+0000","last_clean":"2023-09-28T04:24:04.958958+0000","last_became_active":"2023-09-28T04:23:18.384916+0000","last_became_peered":"2023-09-28T04:23:18.384916+0000","last_unstale":"2023-09-28T04:24:04.958958+0000","last_undegraded":"2023-09-28T04:24:04.958958+0000","last_fullsized":"2023-09-28T04:24:04.958958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:49.793956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:49.793956+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.793956+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:00:36.299231+0000","scrub_duration":0.001933169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:32.154291+0000","last_change":"2023-09-28T04:24:32.154262+0000","last_active":"2023-09-28T04:24:32.154291+0000","last_peered":"2023-09-28T04:24:32.154291+0000","last_clean":"2023-09-28T04:24:32.154291+0000","last_became_active":"2023-09-28T04:23:18.385805+0000","last_became_peered":"2023-09-28T04:23:18.385805+0000","last_unstale":"2023-09-28T04:24:32.154291+0000","last_undegraded":"2023-09-28T04:24:32.154291+0000","last_fullsized":"2023-09-28T04:24:32.154291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:32.154159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:32.154159+0000","last_clean_scrub_stamp":"2023-09-28T04:24:32.154159+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:44:06.932028+0000","scrub_duration":0.0014523330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:24.343077+0000","last_change":"2023-09-28T04:24:24.343049+0000","last_active":"2023-09-28T04:24:24.343077+0000","last_peered":"2023-09-28T04:24:24.343077+0000","last_clean":"2023-09-28T04:24:24.343077+0000","last_became_active":"2023-09-28T04:23:18.400230+0000","last_became_peered":"2023-09-28T04:23:18.400230+0000","last_unstale":"2023-09-28T04:24:24.343077+0000","last_undegraded":"2023-09-28T04:24:24.343077+0000","last_fullsized":"2023-09-28T04:24:24.343077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:24.342933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:24.342933+0000","last_clean_scrub_stamp":"2023-09-28T04:24:24.342933+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:32.787804+0000","scrub_duration":0.0022771660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:28.138073+0000","last_change":"2023-09-28T04:24:28.138041+0000","last_active":"2023-09-28T04:24:28.138073+0000","last_peered":"2023-09-28T04:24:28.138073+0000","last_clean":"2023-09-28T04:24:28.138073+0000","last_became_active":"2023-09-28T04:23:18.391373+0000","last_became_peered":"2023-09-28T04:23:18.391373+0000","last_unstale":"2023-09-28T04:24:28.138073+0000","last_undegraded":"2023-09-28T04:24:28.138073+0000","last_fullsized":"2023-09-28T04:24:28.138073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:28.137937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:28.137937+0000","last_clean_scrub_stamp":"2023-09-28T04:24:28.137937+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:58:22.600614+0000","scrub_duration":0.00165047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:28.367724+0000","last_change":"2023-09-28T04:24:28.367688+0000","last_active":"2023-09-28T04:24:28.367724+0000","last_peered":"2023-09-28T04:24:28.367724+0000","last_clean":"2023-09-28T04:24:28.367724+0000","last_became_active":"2023-09-28T04:23:18.392723+0000","last_became_peered":"2023-09-28T04:23:18.392723+0000","last_unstale":"2023-09-28T04:24:28.367724+0000","last_undegraded":"2023-09-28T04:24:28.367724+0000","last_fullsized":"2023-09-28T04:24:28.367724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:28.367593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:28.367593+0000","last_clean_scrub_stamp":"2023-09-28T04:24:28.367593+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:06:44.432458+0000","scrub_duration":0.0014829719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:22.268140+0000","last_change":"2023-09-28T04:24:22.268112+0000","last_active":"2023-09-28T04:24:22.268140+0000","last_peered":"2023-09-28T04:24:22.268140+0000","last_clean":"2023-09-28T04:24:22.268140+0000","last_became_active":"2023-09-28T04:23:18.402197+0000","last_became_peered":"2023-09-28T04:23:18.402197+0000","last_unstale":"2023-09-28T04:24:22.268140+0000","last_undegraded":"2023-09-28T04:24:22.268140+0000","last_fullsized":"2023-09-28T04:24:22.268140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:22.268022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:22.268022+0000","last_clean_scrub_stamp":"2023-09-28T04:24:22.268022+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:27:15.456540+0000","scrub_duration":0.0018515980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:10.113035+0000","last_change":"2023-09-28T04:24:10.113004+0000","last_active":"2023-09-28T04:24:10.113035+0000","last_peered":"2023-09-28T04:24:10.113035+0000","last_clean":"2023-09-28T04:24:10.113035+0000","last_became_active":"2023-09-28T04:23:18.388936+0000","last_became_peered":"2023-09-28T04:23:18.388936+0000","last_unstale":"2023-09-28T04:24:10.113035+0000","last_undegraded":"2023-09-28T04:24:10.113035+0000","last_fullsized":"2023-09-28T04:24:10.113035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:10.112876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:10.112876+0000","last_clean_scrub_stamp":"2023-09-28T04:24:10.112876+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:08:16.508273+0000","scrub_duration":0.002058888,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961636+0000","last_change":"2023-09-28T04:24:01.069603+0000","last_active":"2023-09-28T04:24:04.961636+0000","last_peered":"2023-09-28T04:24:04.961636+0000","last_clean":"2023-09-28T04:24:04.961636+0000","last_became_active":"2023-09-28T04:23:18.388682+0000","last_became_peered":"2023-09-28T04:23:18.388682+0000","last_unstale":"2023-09-28T04:24:04.961636+0000","last_undegraded":"2023-09-28T04:24:04.961636+0000","last_fullsized":"2023-09-28T04:24:04.961636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:01.069506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:01.069506+0000","last_clean_scrub_stamp":"2023-09-28T04:24:01.069506+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:46.779927+0000","scrub_duration":0.0017421419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:33.645304+0000","last_change":"2023-09-28T04:24:33.645278+0000","last_active":"2023-09-28T04:24:33.645304+0000","last_peered":"2023-09-28T04:24:33.645304+0000","last_clean":"2023-09-28T04:24:33.645304+0000","last_became_active":"2023-09-28T04:23:18.391031+0000","last_became_peered":"2023-09-28T04:23:18.391031+0000","last_unstale":"2023-09-28T04:24:33.645304+0000","last_undegraded":"2023-09-28T04:24:33.645304+0000","last_fullsized":"2023-09-28T04:24:33.645304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:33.645184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:33.645184+0000","last_clean_scrub_stamp":"2023-09-28T04:24:33.645184+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:06:49.710049+0000","scrub_duration":0.001521604,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958331+0000","last_change":"2023-09-28T04:23:58.912287+0000","last_active":"2023-09-28T04:24:04.958331+0000","last_peered":"2023-09-28T04:24:04.958331+0000","last_clean":"2023-09-28T04:24:04.958331+0000","last_became_active":"2023-09-28T04:23:17.913941+0000","last_became_peered":"2023-09-28T04:23:17.913941+0000","last_unstale":"2023-09-28T04:24:04.958331+0000","last_undegraded":"2023-09-28T04:24:04.958331+0000","last_fullsized":"2023-09-28T04:24:04.958331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:58.912190+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:58.912190+0000","last_clean_scrub_stamp":"2023-09-28T04:23:58.912190+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:08:05.307587+0000","scrub_duration":0.0025180559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:23.324140+0000","last_change":"2023-09-28T04:24:23.324109+0000","last_active":"2023-09-28T04:24:23.324140+0000","last_peered":"2023-09-28T04:24:23.324140+0000","last_clean":"2023-09-28T04:24:23.324140+0000","last_became_active":"2023-09-28T04:23:18.390030+0000","last_became_peered":"2023-09-28T04:23:18.390030+0000","last_unstale":"2023-09-28T04:24:23.324140+0000","last_undegraded":"2023-09-28T04:24:23.324140+0000","last_fullsized":"2023-09-28T04:24:23.324140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:23.323979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:23.323979+0000","last_clean_scrub_stamp":"2023-09-28T04:24:23.323979+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:14:11.391259+0000","scrub_duration":0.0015627830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"21'2","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962534+0000","last_change":"2023-09-28T04:23:53.085718+0000","last_active":"2023-09-28T04:24:04.962534+0000","last_peered":"2023-09-28T04:24:04.962534+0000","last_clean":"2023-09-28T04:24:04.962534+0000","last_became_active":"2023-09-28T04:23:17.913950+0000","last_became_peered":"2023-09-28T04:23:17.913950+0000","last_unstale":"2023-09-28T04:24:04.962534+0000","last_undegraded":"2023-09-28T04:24:04.962534+0000","last_fullsized":"2023-09-28T04:24:04.962534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'2","last_scrub_stamp":"2023-09-28T04:23:53.085638+0000","last_deep_scrub":"21'2","last_deep_scrub_stamp":"2023-09-28T04:23:53.085638+0000","last_clean_scrub_stamp":"2023-09-28T04:23:53.085638+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:37.749049+0000","scrub_duration":0.0019832040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:12.125690+0000","last_change":"2023-09-28T04:24:12.125650+0000","last_active":"2023-09-28T04:24:12.125690+0000","last_peered":"2023-09-28T04:24:12.125690+0000","last_clean":"2023-09-28T04:24:12.125690+0000","last_became_active":"2023-09-28T04:23:18.393106+0000","last_became_peered":"2023-09-28T04:23:18.393106+0000","last_unstale":"2023-09-28T04:24:12.125690+0000","last_undegraded":"2023-09-28T04:24:12.125690+0000","last_fullsized":"2023-09-28T04:24:12.125690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:12.125563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:12.125563+0000","last_clean_scrub_stamp":"2023-09-28T04:24:12.125563+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:23:13.322980+0000","scrub_duration":0.0020565100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"21'1","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957087+0000","last_change":"2023-09-28T04:24:00.077099+0000","last_active":"2023-09-28T04:24:04.957087+0000","last_peered":"2023-09-28T04:24:04.957087+0000","last_clean":"2023-09-28T04:24:04.957087+0000","last_became_active":"2023-09-28T04:23:17.910766+0000","last_became_peered":"2023-09-28T04:23:17.910766+0000","last_unstale":"2023-09-28T04:24:04.957087+0000","last_undegraded":"2023-09-28T04:24:04.957087+0000","last_fullsized":"2023-09-28T04:24:04.957087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'1","last_scrub_stamp":"2023-09-28T04:24:00.076945+0000","last_deep_scrub":"21'1","last_deep_scrub_stamp":"2023-09-28T04:24:00.076945+0000","last_clean_scrub_stamp":"2023-09-28T04:24:00.076945+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:53.222003+0000","scrub_duration":0.0016068569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980295+0000","last_change":"2023-09-28T04:24:03.982527+0000","last_active":"2023-09-28T04:24:04.980295+0000","last_peered":"2023-09-28T04:24:04.980295+0000","last_clean":"2023-09-28T04:24:04.980295+0000","last_became_active":"2023-09-28T04:23:18.387581+0000","last_became_peered":"2023-09-28T04:23:18.387581+0000","last_unstale":"2023-09-28T04:24:04.980295+0000","last_undegraded":"2023-09-28T04:24:04.980295+0000","last_fullsized":"2023-09-28T04:24:04.980295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:03.982444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:03.982444+0000","last_clean_scrub_stamp":"2023-09-28T04:24:03.982444+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:12.421076+0000","scrub_duration":0.001244752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962459+0000","last_change":"2023-09-28T04:23:55.393407+0000","last_active":"2023-09-28T04:24:04.962459+0000","last_peered":"2023-09-28T04:24:04.962459+0000","last_clean":"2023-09-28T04:24:04.962459+0000","last_became_active":"2023-09-28T04:23:17.917596+0000","last_became_peered":"2023-09-28T04:23:17.917596+0000","last_unstale":"2023-09-28T04:24:04.962459+0000","last_undegraded":"2023-09-28T04:24:04.962459+0000","last_fullsized":"2023-09-28T04:24:04.962459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:55.393324+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:55.393324+0000","last_clean_scrub_stamp":"2023-09-28T04:23:55.393324+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:03.831956+0000","scrub_duration":0.0023423250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:11.025863+0000","last_change":"2023-09-28T04:24:11.025839+0000","last_active":"2023-09-28T04:24:11.025863+0000","last_peered":"2023-09-28T04:24:11.025863+0000","last_clean":"2023-09-28T04:24:11.025863+0000","last_became_active":"2023-09-28T04:23:18.391773+0000","last_became_peered":"2023-09-28T04:23:18.391773+0000","last_unstale":"2023-09-28T04:24:11.025863+0000","last_undegraded":"2023-09-28T04:24:11.025863+0000","last_fullsized":"2023-09-28T04:24:11.025863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:11.025769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:11.025769+0000","last_clean_scrub_stamp":"2023-09-28T04:24:11.025769+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:23:12.223186+0000","scrub_duration":0.001351711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"23'3","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:14.559479+0000","last_change":"2023-09-28T04:24:14.559452+0000","last_active":"2023-09-28T04:24:14.559479+0000","last_peered":"2023-09-28T04:24:14.559479+0000","last_clean":"2023-09-28T04:24:14.559479+0000","last_became_active":"2023-09-28T04:23:17.908599+0000","last_became_peered":"2023-09-28T04:23:17.908599+0000","last_unstale":"2023-09-28T04:24:14.559479+0000","last_undegraded":"2023-09-28T04:24:14.559479+0000","last_fullsized":"2023-09-28T04:24:14.559479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-09-28T04:24:14.559362+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-09-28T04:24:14.559362+0000","last_clean_scrub_stamp":"2023-09-28T04:24:14.559362+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:23:15.756779+0000","scrub_duration":0.0027368200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:12.065894+0000","last_change":"2023-09-28T04:24:12.065866+0000","last_active":"2023-09-28T04:24:12.065894+0000","last_peered":"2023-09-28T04:24:12.065894+0000","last_clean":"2023-09-28T04:24:12.065894+0000","last_became_active":"2023-09-28T04:23:18.393631+0000","last_became_peered":"2023-09-28T04:23:18.393631+0000","last_unstale":"2023-09-28T04:24:12.065894+0000","last_undegraded":"2023-09-28T04:24:12.065894+0000","last_fullsized":"2023-09-28T04:24:12.065894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:12.065779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:12.065779+0000","last_clean_scrub_stamp":"2023-09-28T04:24:12.065779+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:25.573571+0000","scrub_duration":0.001651413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'7","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:10.197743+0000","last_change":"2023-09-28T04:24:10.197715+0000","last_active":"2023-09-28T04:24:10.197743+0000","last_peered":"2023-09-28T04:24:10.197743+0000","last_clean":"2023-09-28T04:24:10.197743+0000","last_became_active":"2023-09-28T04:23:17.911361+0000","last_became_peered":"2023-09-28T04:23:17.911361+0000","last_unstale":"2023-09-28T04:24:10.197743+0000","last_undegraded":"2023-09-28T04:24:10.197743+0000","last_fullsized":"2023-09-28T04:24:10.197743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2023-09-28T04:24:10.197625+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2023-09-28T04:24:10.197625+0000","last_clean_scrub_stamp":"2023-09-28T04:24:10.197625+0000","objects_scrubbed":3,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:08:16.593022+0000","scrub_duration":0.0050376570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:15.077710+0000","last_change":"2023-09-28T04:24:15.077679+0000","last_active":"2023-09-28T04:24:15.077710+0000","last_peered":"2023-09-28T04:24:15.077710+0000","last_clean":"2023-09-28T04:24:15.077710+0000","last_became_active":"2023-09-28T04:23:18.387672+0000","last_became_peered":"2023-09-28T04:23:18.387672+0000","last_unstale":"2023-09-28T04:24:15.077710+0000","last_undegraded":"2023-09-28T04:24:15.077710+0000","last_fullsized":"2023-09-28T04:24:15.077710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:15.077589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:15.077589+0000","last_clean_scrub_stamp":"2023-09-28T04:24:15.077589+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:28.585380+0000","scrub_duration":0.0020568090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'13","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958562+0000","last_change":"2023-09-28T04:24:02.967980+0000","last_active":"2023-09-28T04:24:04.958562+0000","last_peered":"2023-09-28T04:24:04.958562+0000","last_clean":"2023-09-28T04:24:04.958562+0000","last_became_active":"2023-09-28T04:23:17.904734+0000","last_became_peered":"2023-09-28T04:23:17.904734+0000","last_unstale":"2023-09-28T04:24:04.958562+0000","last_undegraded":"2023-09-28T04:24:04.958562+0000","last_fullsized":"2023-09-28T04:24:04.958562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'13","last_scrub_stamp":"2023-09-28T04:24:02.967889+0000","last_deep_scrub":"21'13","last_deep_scrub_stamp":"2023-09-28T04:24:02.967889+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.967889+0000","objects_scrubbed":5,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:23:04.165306+0000","scrub_duration":0.0065805229999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958578+0000","last_change":"2023-09-28T04:23:49.989615+0000","last_active":"2023-09-28T04:24:04.958578+0000","last_peered":"2023-09-28T04:24:04.958578+0000","last_clean":"2023-09-28T04:24:04.958578+0000","last_became_active":"2023-09-28T04:23:18.388871+0000","last_became_peered":"2023-09-28T04:23:18.388871+0000","last_unstale":"2023-09-28T04:24:04.958578+0000","last_undegraded":"2023-09-28T04:24:04.958578+0000","last_fullsized":"2023-09-28T04:24:04.958578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:49.989518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:49.989518+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.989518+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:35.699939+0000","scrub_duration":0.0014560160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"21'9","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979336+0000","last_change":"2023-09-28T04:23:59.951180+0000","last_active":"2023-09-28T04:24:04.979336+0000","last_peered":"2023-09-28T04:24:04.979336+0000","last_clean":"2023-09-28T04:24:04.979336+0000","last_became_active":"2023-09-28T04:23:17.909981+0000","last_became_peered":"2023-09-28T04:23:17.909981+0000","last_unstale":"2023-09-28T04:24:04.979336+0000","last_undegraded":"2023-09-28T04:24:04.979336+0000","last_fullsized":"2023-09-28T04:24:04.979336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'9","last_scrub_stamp":"2023-09-28T04:23:59.951098+0000","last_deep_scrub":"21'9","last_deep_scrub_stamp":"2023-09-28T04:23:59.951098+0000","last_clean_scrub_stamp":"2023-09-28T04:23:59.951098+0000","objects_scrubbed":4,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:08.389729+0000","scrub_duration":0.0082831610000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:20.203944+0000","last_change":"2023-09-28T04:24:20.203914+0000","last_active":"2023-09-28T04:24:20.203944+0000","last_peered":"2023-09-28T04:24:20.203944+0000","last_clean":"2023-09-28T04:24:20.203944+0000","last_became_active":"2023-09-28T04:24:05.961816+0000","last_became_peered":"2023-09-28T04:24:05.961816+0000","last_unstale":"2023-09-28T04:24:20.203944+0000","last_undegraded":"2023-09-28T04:24:20.203944+0000","last_fullsized":"2023-09-28T04:24:20.203944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:20.203803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:20.203803+0000","last_clean_scrub_stamp":"2023-09-28T04:24:20.203803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:56:21.793731+0000","scrub_duration":0.0020937099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961454+0000","last_change":"2023-09-28T04:23:57.340861+0000","last_active":"2023-09-28T04:24:04.961454+0000","last_peered":"2023-09-28T04:24:04.961454+0000","last_clean":"2023-09-28T04:24:04.961454+0000","last_became_active":"2023-09-28T04:23:17.916424+0000","last_became_peered":"2023-09-28T04:23:17.916424+0000","last_unstale":"2023-09-28T04:24:04.961454+0000","last_undegraded":"2023-09-28T04:24:04.961454+0000","last_fullsized":"2023-09-28T04:24:04.961454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:57.340759+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:57.340759+0000","last_clean_scrub_stamp":"2023-09-28T04:23:57.340759+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:43.051180+0000","scrub_duration":0.0023571410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:25.534840+0000","last_change":"2023-09-28T04:24:25.534783+0000","last_active":"2023-09-28T04:24:25.534840+0000","last_peered":"2023-09-28T04:24:25.534840+0000","last_clean":"2023-09-28T04:24:25.534840+0000","last_became_active":"2023-09-28T04:23:18.390613+0000","last_became_peered":"2023-09-28T04:23:18.390613+0000","last_unstale":"2023-09-28T04:24:25.534840+0000","last_undegraded":"2023-09-28T04:24:25.534840+0000","last_fullsized":"2023-09-28T04:24:25.534840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:25.534678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:25.534678+0000","last_clean_scrub_stamp":"2023-09-28T04:24:25.534678+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:03:49.205200+0000","scrub_duration":0.0013638229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979364+0000","last_change":"2023-09-28T04:24:03.053560+0000","last_active":"2023-09-28T04:24:04.979364+0000","last_peered":"2023-09-28T04:24:04.979364+0000","last_clean":"2023-09-28T04:24:04.979364+0000","last_became_active":"2023-09-28T04:23:17.910457+0000","last_became_peered":"2023-09-28T04:23:17.910457+0000","last_unstale":"2023-09-28T04:24:04.979364+0000","last_undegraded":"2023-09-28T04:24:04.979364+0000","last_fullsized":"2023-09-28T04:24:04.979364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:24:03.053473+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:24:03.053473+0000","last_clean_scrub_stamp":"2023-09-28T04:24:03.053473+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:18.309826+0000","scrub_duration":0.0021293890000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:32.127535+0000","last_change":"2023-09-28T04:24:32.127509+0000","last_active":"2023-09-28T04:24:32.127535+0000","last_peered":"2023-09-28T04:24:32.127535+0000","last_clean":"2023-09-28T04:24:32.127535+0000","last_became_active":"2023-09-28T04:23:18.402559+0000","last_became_peered":"2023-09-28T04:23:18.402559+0000","last_unstale":"2023-09-28T04:24:32.127535+0000","last_undegraded":"2023-09-28T04:24:32.127535+0000","last_fullsized":"2023-09-28T04:24:32.127535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:32.127436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:32.127436+0000","last_clean_scrub_stamp":"2023-09-28T04:24:32.127436+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:23:55.335996+0000","scrub_duration":0.001290895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"21'19","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979016+0000","last_change":"2023-09-28T04:23:54.968698+0000","last_active":"2023-09-28T04:24:04.979016+0000","last_peered":"2023-09-28T04:24:04.979016+0000","last_clean":"2023-09-28T04:24:04.979016+0000","last_became_active":"2023-09-28T04:23:17.910650+0000","last_became_peered":"2023-09-28T04:23:17.910650+0000","last_unstale":"2023-09-28T04:24:04.979016+0000","last_undegraded":"2023-09-28T04:24:04.979016+0000","last_fullsized":"2023-09-28T04:24:04.979016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'19","last_scrub_stamp":"2023-09-28T04:23:54.968612+0000","last_deep_scrub":"21'19","last_deep_scrub_stamp":"2023-09-28T04:23:54.968612+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.968612+0000","objects_scrubbed":8,"log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:31:52.914472+0000","scrub_duration":0.0052817860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:19.179438+0000","last_change":"2023-09-28T04:24:19.179405+0000","last_active":"2023-09-28T04:24:19.179438+0000","last_peered":"2023-09-28T04:24:19.179438+0000","last_clean":"2023-09-28T04:24:19.179438+0000","last_became_active":"2023-09-28T04:23:18.394721+0000","last_became_peered":"2023-09-28T04:23:18.394721+0000","last_unstale":"2023-09-28T04:24:19.179438+0000","last_undegraded":"2023-09-28T04:24:19.179438+0000","last_fullsized":"2023-09-28T04:24:19.179438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:19.179316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:19.179316+0000","last_clean_scrub_stamp":"2023-09-28T04:24:19.179316+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:27.624187+0000","scrub_duration":0.0019399389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979548+0000","last_change":"2023-09-28T04:24:02.004448+0000","last_active":"2023-09-28T04:24:04.979548+0000","last_peered":"2023-09-28T04:24:04.979548+0000","last_clean":"2023-09-28T04:24:04.979548+0000","last_became_active":"2023-09-28T04:23:17.907331+0000","last_became_peered":"2023-09-28T04:23:17.907331+0000","last_unstale":"2023-09-28T04:24:04.979548+0000","last_undegraded":"2023-09-28T04:24:04.979548+0000","last_fullsized":"2023-09-28T04:24:04.979548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:24:02.004356+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:24:02.004356+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.004356+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:47.714777+0000","scrub_duration":0.0031667269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:31.625545+0000","last_change":"2023-09-28T04:24:31.625512+0000","last_active":"2023-09-28T04:24:31.625545+0000","last_peered":"2023-09-28T04:24:31.625545+0000","last_clean":"2023-09-28T04:24:31.625545+0000","last_became_active":"2023-09-28T04:23:18.390633+0000","last_became_peered":"2023-09-28T04:23:18.390633+0000","last_unstale":"2023-09-28T04:24:31.625545+0000","last_undegraded":"2023-09-28T04:24:31.625545+0000","last_fullsized":"2023-09-28T04:24:31.625545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:31.625415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:31.625415+0000","last_clean_scrub_stamp":"2023-09-28T04:24:31.625415+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:23:18.440333+0000","scrub_duration":0.001663615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'3","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:07.132164+0000","last_change":"2023-09-28T04:24:07.132123+0000","last_active":"2023-09-28T04:24:07.132164+0000","last_peered":"2023-09-28T04:24:07.132164+0000","last_clean":"2023-09-28T04:24:07.132164+0000","last_became_active":"2023-09-28T04:23:17.906036+0000","last_became_peered":"2023-09-28T04:23:17.906036+0000","last_unstale":"2023-09-28T04:24:07.132164+0000","last_undegraded":"2023-09-28T04:24:07.132164+0000","last_fullsized":"2023-09-28T04:24:07.132164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-09-28T04:24:07.132035+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-09-28T04:24:07.132035+0000","last_clean_scrub_stamp":"2023-09-28T04:24:07.132035+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:35:43.666979+0000","scrub_duration":0.0027056010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:22.140407+0000","last_change":"2023-09-28T04:24:22.140373+0000","last_active":"2023-09-28T04:24:22.140407+0000","last_peered":"2023-09-28T04:24:22.140407+0000","last_clean":"2023-09-28T04:24:22.140407+0000","last_became_active":"2023-09-28T04:23:18.385693+0000","last_became_peered":"2023-09-28T04:23:18.385693+0000","last_unstale":"2023-09-28T04:24:22.140407+0000","last_undegraded":"2023-09-28T04:24:22.140407+0000","last_fullsized":"2023-09-28T04:24:22.140407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:22.140271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:22.140271+0000","last_clean_scrub_stamp":"2023-09-28T04:24:22.140271+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:06:38.205135+0000","scrub_duration":0.0018774600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'2","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:05.075483+0000","last_change":"2023-09-28T04:24:05.075438+0000","last_active":"2023-09-28T04:24:05.075483+0000","last_peered":"2023-09-28T04:24:05.075483+0000","last_clean":"2023-09-28T04:24:05.075483+0000","last_became_active":"2023-09-28T04:23:17.908493+0000","last_became_peered":"2023-09-28T04:23:17.908493+0000","last_unstale":"2023-09-28T04:24:05.075483+0000","last_undegraded":"2023-09-28T04:24:05.075483+0000","last_fullsized":"2023-09-28T04:24:05.075483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2023-09-28T04:24:05.075329+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2023-09-28T04:24:05.075329+0000","last_clean_scrub_stamp":"2023-09-28T04:24:05.075329+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:58.220387+0000","scrub_duration":0.0028904540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980151+0000","last_change":"2023-09-28T04:23:59.965660+0000","last_active":"2023-09-28T04:24:04.980151+0000","last_peered":"2023-09-28T04:24:04.980151+0000","last_clean":"2023-09-28T04:24:04.980151+0000","last_became_active":"2023-09-28T04:23:18.385112+0000","last_became_peered":"2023-09-28T04:23:18.385112+0000","last_unstale":"2023-09-28T04:24:04.980151+0000","last_undegraded":"2023-09-28T04:24:04.980151+0000","last_fullsized":"2023-09-28T04:24:04.980151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:59.965563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:59.965563+0000","last_clean_scrub_stamp":"2023-09-28T04:23:59.965563+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:30.361361+0000","scrub_duration":0.0020436289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960810+0000","last_change":"2023-09-28T04:23:59.641629+0000","last_active":"2023-09-28T04:24:04.960810+0000","last_peered":"2023-09-28T04:24:04.960810+0000","last_clean":"2023-09-28T04:24:04.960810+0000","last_became_active":"2023-09-28T04:23:17.898232+0000","last_became_peered":"2023-09-28T04:23:17.898232+0000","last_unstale":"2023-09-28T04:24:04.960810+0000","last_undegraded":"2023-09-28T04:24:04.960810+0000","last_fullsized":"2023-09-28T04:24:04.960810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:59.641543+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:59.641543+0000","last_clean_scrub_stamp":"2023-09-28T04:23:59.641543+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:30:45.351964+0000","scrub_duration":0.0027926169999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:13.090090+0000","last_change":"2023-09-28T04:24:13.090059+0000","last_active":"2023-09-28T04:24:13.090090+0000","last_peered":"2023-09-28T04:24:13.090090+0000","last_clean":"2023-09-28T04:24:13.090090+0000","last_became_active":"2023-09-28T04:23:18.391963+0000","last_became_peered":"2023-09-28T04:23:18.391963+0000","last_unstale":"2023-09-28T04:24:13.090090+0000","last_undegraded":"2023-09-28T04:24:13.090090+0000","last_fullsized":"2023-09-28T04:24:13.090090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:13.089951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:13.089951+0000","last_clean_scrub_stamp":"2023-09-28T04:24:13.089951+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:26.597743+0000","scrub_duration":0.001666984,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'4","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957603+0000","last_change":"2023-09-28T04:23:53.004623+0000","last_active":"2023-09-28T04:24:04.957603+0000","last_peered":"2023-09-28T04:24:04.957603+0000","last_clean":"2023-09-28T04:24:04.957603+0000","last_became_active":"2023-09-28T04:23:17.905089+0000","last_became_peered":"2023-09-28T04:23:17.905089+0000","last_unstale":"2023-09-28T04:24:04.957603+0000","last_undegraded":"2023-09-28T04:24:04.957603+0000","last_fullsized":"2023-09-28T04:24:04.957603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4","last_scrub_stamp":"2023-09-28T04:23:53.004535+0000","last_deep_scrub":"21'4","last_deep_scrub_stamp":"2023-09-28T04:23:53.004535+0000","last_clean_scrub_stamp":"2023-09-28T04:23:53.004535+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:50.846583+0000","scrub_duration":0.0020402789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:20.122424+0000","last_change":"2023-09-28T04:24:20.122397+0000","last_active":"2023-09-28T04:24:20.122424+0000","last_peered":"2023-09-28T04:24:20.122424+0000","last_clean":"2023-09-28T04:24:20.122424+0000","last_became_active":"2023-09-28T04:23:18.399839+0000","last_became_peered":"2023-09-28T04:23:18.399839+0000","last_unstale":"2023-09-28T04:24:20.122424+0000","last_undegraded":"2023-09-28T04:24:20.122424+0000","last_fullsized":"2023-09-28T04:24:20.122424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:20.122278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:20.122278+0000","last_clean_scrub_stamp":"2023-09-28T04:24:20.122278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:23:06.937196+0000","scrub_duration":0.0017522569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"21'1","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980153+0000","last_change":"2023-09-28T04:23:55.943781+0000","last_active":"2023-09-28T04:24:04.980153+0000","last_peered":"2023-09-28T04:24:04.980153+0000","last_clean":"2023-09-28T04:24:04.980153+0000","last_became_active":"2023-09-28T04:23:17.912560+0000","last_became_peered":"2023-09-28T04:23:17.912560+0000","last_unstale":"2023-09-28T04:24:04.980153+0000","last_undegraded":"2023-09-28T04:24:04.980153+0000","last_fullsized":"2023-09-28T04:24:04.980153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'1","last_scrub_stamp":"2023-09-28T04:23:55.943684+0000","last_deep_scrub":"21'1","last_deep_scrub_stamp":"2023-09-28T04:23:55.943684+0000","last_clean_scrub_stamp":"2023-09-28T04:23:55.943684+0000","objects_scrubbed":1,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:08:06.990358+0000","scrub_duration":0.001753884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:23.137176+0000","last_change":"2023-09-28T04:24:23.137148+0000","last_active":"2023-09-28T04:24:23.137176+0000","last_peered":"2023-09-28T04:24:23.137176+0000","last_clean":"2023-09-28T04:24:23.137176+0000","last_became_active":"2023-09-28T04:23:18.390268+0000","last_became_peered":"2023-09-28T04:23:18.390268+0000","last_unstale":"2023-09-28T04:24:23.137176+0000","last_undegraded":"2023-09-28T04:24:23.137176+0000","last_fullsized":"2023-09-28T04:24:23.137176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:23.137039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:23.137039+0000","last_clean_scrub_stamp":"2023-09-28T04:24:23.137039+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:10:46.207788+0000","scrub_duration":0.001899111,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"21'5","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958284+0000","last_change":"2023-09-28T04:24:03.964617+0000","last_active":"2023-09-28T04:24:04.958284+0000","last_peered":"2023-09-28T04:24:04.958284+0000","last_clean":"2023-09-28T04:24:04.958284+0000","last_became_active":"2023-09-28T04:23:17.910887+0000","last_became_peered":"2023-09-28T04:23:17.910887+0000","last_unstale":"2023-09-28T04:24:04.958284+0000","last_undegraded":"2023-09-28T04:24:04.958284+0000","last_fullsized":"2023-09-28T04:24:04.958284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'5","last_scrub_stamp":"2023-09-28T04:24:03.964445+0000","last_deep_scrub":"21'5","last_deep_scrub_stamp":"2023-09-28T04:24:03.964445+0000","last_clean_scrub_stamp":"2023-09-28T04:24:03.964445+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:17.472237+0000","scrub_duration":0.0046695920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958754+0000","last_change":"2023-09-28T04:23:51.981578+0000","last_active":"2023-09-28T04:24:04.958754+0000","last_peered":"2023-09-28T04:24:04.958754+0000","last_clean":"2023-09-28T04:24:04.958754+0000","last_became_active":"2023-09-28T04:23:18.387667+0000","last_became_peered":"2023-09-28T04:23:18.387667+0000","last_unstale":"2023-09-28T04:24:04.958754+0000","last_undegraded":"2023-09-28T04:24:04.958754+0000","last_fullsized":"2023-09-28T04:24:04.958754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:51.981479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:51.981479+0000","last_clean_scrub_stamp":"2023-09-28T04:23:51.981479+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:07.237832+0000","scrub_duration":0.0013352010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"23'3","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:29.326299+0000","last_change":"2023-09-28T04:24:29.326268+0000","last_active":"2023-09-28T04:24:29.326299+0000","last_peered":"2023-09-28T04:24:29.326299+0000","last_clean":"2023-09-28T04:24:29.326299+0000","last_became_active":"2023-09-28T04:23:17.911458+0000","last_became_peered":"2023-09-28T04:23:17.911458+0000","last_unstale":"2023-09-28T04:24:29.326299+0000","last_undegraded":"2023-09-28T04:24:29.326299+0000","last_fullsized":"2023-09-28T04:24:29.326299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2023-09-28T04:24:29.326184+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2023-09-28T04:24:29.326184+0000","last_clean_scrub_stamp":"2023-09-28T04:24:29.326184+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:10:52.396932+0000","scrub_duration":0.0031833859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:22.052572+0000","last_change":"2023-09-28T04:24:22.052545+0000","last_active":"2023-09-28T04:24:22.052572+0000","last_peered":"2023-09-28T04:24:22.052572+0000","last_clean":"2023-09-28T04:24:22.052572+0000","last_became_active":"2023-09-28T04:23:18.399957+0000","last_became_peered":"2023-09-28T04:23:18.399957+0000","last_unstale":"2023-09-28T04:24:22.052572+0000","last_undegraded":"2023-09-28T04:24:22.052572+0000","last_fullsized":"2023-09-28T04:24:22.052572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:22.052455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:22.052455+0000","last_clean_scrub_stamp":"2023-09-28T04:24:22.052455+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:30.497326+0000","scrub_duration":0.001379464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961872+0000","last_change":"2023-09-28T04:23:49.012182+0000","last_active":"2023-09-28T04:24:04.961872+0000","last_peered":"2023-09-28T04:24:04.961872+0000","last_clean":"2023-09-28T04:24:04.961872+0000","last_became_active":"2023-09-28T04:23:13.017362+0000","last_became_peered":"2023-09-28T04:23:13.017362+0000","last_unstale":"2023-09-28T04:24:04.961872+0000","last_undegraded":"2023-09-28T04:24:04.961872+0000","last_fullsized":"2023-09-28T04:24:04.961872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:49.012108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:49.012108+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.012108+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:24:10.816331+0000","scrub_duration":0.001277809,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:09.589826+0000","last_change":"2023-09-28T04:24:09.589779+0000","last_active":"2023-09-28T04:24:09.589826+0000","last_peered":"2023-09-28T04:24:09.589826+0000","last_clean":"2023-09-28T04:24:09.589826+0000","last_became_active":"2023-09-28T04:23:17.898878+0000","last_became_peered":"2023-09-28T04:23:17.898878+0000","last_unstale":"2023-09-28T04:24:09.589826+0000","last_undegraded":"2023-09-28T04:24:09.589826+0000","last_fullsized":"2023-09-28T04:24:09.589826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-09-28T04:24:09.589679+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-09-28T04:24:09.589679+0000","last_clean_scrub_stamp":"2023-09-28T04:24:09.589679+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:08:15.985076+0000","scrub_duration":0.0040891410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:14.068563+0000","last_change":"2023-09-28T04:24:14.068531+0000","last_active":"2023-09-28T04:24:14.068563+0000","last_peered":"2023-09-28T04:24:14.068563+0000","last_clean":"2023-09-28T04:24:14.068563+0000","last_became_active":"2023-09-28T04:23:18.383969+0000","last_became_peered":"2023-09-28T04:23:18.383969+0000","last_unstale":"2023-09-28T04:24:14.068563+0000","last_undegraded":"2023-09-28T04:24:14.068563+0000","last_fullsized":"2023-09-28T04:24:14.068563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:14.068436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:14.068436+0000","last_clean_scrub_stamp":"2023-09-28T04:24:14.068436+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T13:23:15.265853+0000","scrub_duration":0.0020986770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960700+0000","last_change":"2023-09-28T04:23:56.636147+0000","last_active":"2023-09-28T04:24:04.960700+0000","last_peered":"2023-09-28T04:24:04.960700+0000","last_clean":"2023-09-28T04:24:04.960700+0000","last_became_active":"2023-09-28T04:23:12.603804+0000","last_became_peered":"2023-09-28T04:23:12.603804+0000","last_unstale":"2023-09-28T04:24:04.960700+0000","last_undegraded":"2023-09-28T04:24:04.960700+0000","last_fullsized":"2023-09-28T04:24:04.960700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:56.636037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:56.636037+0000","last_clean_scrub_stamp":"2023-09-28T04:23:56.636037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:54.478085+0000","scrub_duration":0.001916528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'6","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:11.011384+0000","last_change":"2023-09-28T04:24:11.011356+0000","last_active":"2023-09-28T04:24:11.011384+0000","last_peered":"2023-09-28T04:24:11.011384+0000","last_clean":"2023-09-28T04:24:11.011384+0000","last_became_active":"2023-09-28T04:23:17.918740+0000","last_became_peered":"2023-09-28T04:23:17.918740+0000","last_unstale":"2023-09-28T04:24:11.011384+0000","last_undegraded":"2023-09-28T04:24:11.011384+0000","last_fullsized":"2023-09-28T04:24:11.011384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2023-09-28T04:24:11.011268+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2023-09-28T04:24:11.011268+0000","last_clean_scrub_stamp":"2023-09-28T04:24:11.011268+0000","objects_scrubbed":3,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:19.456139+0000","scrub_duration":0.003788774,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961947+0000","last_change":"2023-09-28T04:24:02.073340+0000","last_active":"2023-09-28T04:24:04.961947+0000","last_peered":"2023-09-28T04:24:04.961947+0000","last_clean":"2023-09-28T04:24:04.961947+0000","last_became_active":"2023-09-28T04:23:18.389059+0000","last_became_peered":"2023-09-28T04:23:18.389059+0000","last_unstale":"2023-09-28T04:24:04.961947+0000","last_undegraded":"2023-09-28T04:24:04.961947+0000","last_fullsized":"2023-09-28T04:24:04.961947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:02.073236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:02.073236+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.073236+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:17.329589+0000","scrub_duration":0.001749675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958963+0000","last_change":"2023-09-28T04:23:47.823943+0000","last_active":"2023-09-28T04:24:04.958963+0000","last_peered":"2023-09-28T04:24:04.958963+0000","last_clean":"2023-09-28T04:24:04.958963+0000","last_became_active":"2023-09-28T04:23:12.601652+0000","last_became_peered":"2023-09-28T04:23:12.601652+0000","last_unstale":"2023-09-28T04:24:04.958963+0000","last_undegraded":"2023-09-28T04:24:04.958963+0000","last_fullsized":"2023-09-28T04:24:04.958963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:47.823864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:47.823864+0000","last_clean_scrub_stamp":"2023-09-28T04:23:47.823864+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:46:58.420448+0000","scrub_duration":0.0014653960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962209+0000","last_change":"2023-09-28T04:23:51.025577+0000","last_active":"2023-09-28T04:24:04.962209+0000","last_peered":"2023-09-28T04:24:04.962209+0000","last_clean":"2023-09-28T04:24:04.962209+0000","last_became_active":"2023-09-28T04:23:17.911308+0000","last_became_peered":"2023-09-28T04:23:17.911308+0000","last_unstale":"2023-09-28T04:24:04.962209+0000","last_undegraded":"2023-09-28T04:24:04.962209+0000","last_fullsized":"2023-09-28T04:24:04.962209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:51.025504+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:51.025504+0000","last_clean_scrub_stamp":"2023-09-28T04:23:51.025504+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:47.478493+0000","scrub_duration":0.0017633309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961254+0000","last_change":"2023-09-28T04:24:04.013915+0000","last_active":"2023-09-28T04:24:04.961254+0000","last_peered":"2023-09-28T04:24:04.961254+0000","last_clean":"2023-09-28T04:24:04.961254+0000","last_became_active":"2023-09-28T04:23:18.387945+0000","last_became_peered":"2023-09-28T04:23:18.387945+0000","last_unstale":"2023-09-28T04:24:04.961254+0000","last_undegraded":"2023-09-28T04:24:04.961254+0000","last_fullsized":"2023-09-28T04:24:04.961254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:04.013825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:04.013825+0000","last_clean_scrub_stamp":"2023-09-28T04:24:04.013825+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:57.158883+0000","scrub_duration":0.0018077939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960722+0000","last_change":"2023-09-28T04:23:57.656015+0000","last_active":"2023-09-28T04:24:04.960722+0000","last_peered":"2023-09-28T04:24:04.960722+0000","last_clean":"2023-09-28T04:24:04.960722+0000","last_became_active":"2023-09-28T04:23:12.603930+0000","last_became_peered":"2023-09-28T04:23:12.603930+0000","last_unstale":"2023-09-28T04:24:04.960722+0000","last_undegraded":"2023-09-28T04:24:04.960722+0000","last_fullsized":"2023-09-28T04:24:04.960722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:57.655933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:57.655933+0000","last_clean_scrub_stamp":"2023-09-28T04:23:57.655933+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:06.094564+0000","scrub_duration":0.0020224029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"21'119","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979187+0000","last_change":"2023-09-28T04:23:50.766454+0000","last_active":"2023-09-28T04:24:04.979187+0000","last_peered":"2023-09-28T04:24:04.979187+0000","last_clean":"2023-09-28T04:24:04.979187+0000","last_became_active":"2023-09-28T04:23:11.608249+0000","last_became_peered":"2023-09-28T04:23:11.608249+0000","last_unstale":"2023-09-28T04:24:04.979187+0000","last_undegraded":"2023-09-28T04:24:04.979187+0000","last_fullsized":"2023-09-28T04:24:04.979187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'119","last_scrub_stamp":"2023-09-28T04:23:50.766319+0000","last_deep_scrub":"21'119","last_deep_scrub_stamp":"2023-09-28T04:23:50.766319+0000","last_clean_scrub_stamp":"2023-09-28T04:23:50.766319+0000","objects_scrubbed":2,"log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:08:01.812993+0000","scrub_duration":0.0050644219999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957100+0000","last_change":"2023-09-28T04:23:58.005588+0000","last_active":"2023-09-28T04:24:04.957100+0000","last_peered":"2023-09-28T04:24:04.957100+0000","last_clean":"2023-09-28T04:24:04.957100+0000","last_became_active":"2023-09-28T04:23:17.902341+0000","last_became_peered":"2023-09-28T04:23:17.902341+0000","last_unstale":"2023-09-28T04:24:04.957100+0000","last_undegraded":"2023-09-28T04:24:04.957100+0000","last_fullsized":"2023-09-28T04:24:04.957100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'1","last_scrub_stamp":"2023-09-28T04:23:58.005486+0000","last_deep_scrub":"21'1","last_deep_scrub_stamp":"2023-09-28T04:23:58.005486+0000","last_clean_scrub_stamp":"2023-09-28T04:23:58.005486+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:07:13.261839+0000","scrub_duration":0.0018512579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980195+0000","last_change":"2023-09-28T04:23:59.007251+0000","last_active":"2023-09-28T04:24:04.980195+0000","last_peered":"2023-09-28T04:24:04.980195+0000","last_clean":"2023-09-28T04:24:04.980195+0000","last_became_active":"2023-09-28T04:23:18.389692+0000","last_became_peered":"2023-09-28T04:23:18.389692+0000","last_unstale":"2023-09-28T04:24:04.980195+0000","last_undegraded":"2023-09-28T04:24:04.980195+0000","last_fullsized":"2023-09-28T04:24:04.980195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:59.007146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:59.007146+0000","last_clean_scrub_stamp":"2023-09-28T04:23:59.007146+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:43.670556+0000","scrub_duration":0.0017131609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979292+0000","last_change":"2023-09-28T04:23:51.802452+0000","last_active":"2023-09-28T04:24:04.979292+0000","last_peered":"2023-09-28T04:24:04.979292+0000","last_clean":"2023-09-28T04:24:04.979292+0000","last_became_active":"2023-09-28T04:23:12.605668+0000","last_became_peered":"2023-09-28T04:23:12.605668+0000","last_unstale":"2023-09-28T04:24:04.979292+0000","last_undegraded":"2023-09-28T04:24:04.979292+0000","last_fullsized":"2023-09-28T04:24:04.979292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:51.802351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:51.802351+0000","last_clean_scrub_stamp":"2023-09-28T04:23:51.802351+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:48.255340+0000","scrub_duration":0.0022909250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"21'4","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961258+0000","last_change":"2023-09-28T04:23:47.343034+0000","last_active":"2023-09-28T04:24:04.961258+0000","last_peered":"2023-09-28T04:24:04.961258+0000","last_clean":"2023-09-28T04:24:04.961258+0000","last_became_active":"2023-09-28T04:23:17.918130+0000","last_became_peered":"2023-09-28T04:23:17.918130+0000","last_unstale":"2023-09-28T04:24:04.961258+0000","last_undegraded":"2023-09-28T04:24:04.961258+0000","last_fullsized":"2023-09-28T04:24:04.961258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4","last_scrub_stamp":"2023-09-28T04:23:47.342937+0000","last_deep_scrub":"21'4","last_deep_scrub_stamp":"2023-09-28T04:23:47.342937+0000","last_clean_scrub_stamp":"2023-09-28T04:23:47.342937+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:43.795926+0000","scrub_duration":0.0023882230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:07.188744+0000","last_change":"2023-09-28T04:24:07.188712+0000","last_active":"2023-09-28T04:24:07.188744+0000","last_peered":"2023-09-28T04:24:07.188744+0000","last_clean":"2023-09-28T04:24:07.188744+0000","last_became_active":"2023-09-28T04:23:18.391709+0000","last_became_peered":"2023-09-28T04:23:18.391709+0000","last_unstale":"2023-09-28T04:24:07.188744+0000","last_undegraded":"2023-09-28T04:24:07.188744+0000","last_fullsized":"2023-09-28T04:24:07.188744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:07.188594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:07.188594+0000","last_clean_scrub_stamp":"2023-09-28T04:24:07.188594+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:08:13.583991+0000","scrub_duration":0.0016524879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.979559+0000","last_change":"2023-09-28T04:23:53.836344+0000","last_active":"2023-09-28T04:24:04.979559+0000","last_peered":"2023-09-28T04:24:04.979559+0000","last_clean":"2023-09-28T04:24:04.979559+0000","last_became_active":"2023-09-28T04:23:13.017398+0000","last_became_peered":"2023-09-28T04:23:13.017398+0000","last_unstale":"2023-09-28T04:24:04.979559+0000","last_undegraded":"2023-09-28T04:24:04.979559+0000","last_fullsized":"2023-09-28T04:24:04.979559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:53.836227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:53.836227+0000","last_clean_scrub_stamp":"2023-09-28T04:23:53.836227+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:38.499638+0000","scrub_duration":0.0019584490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961951+0000","last_change":"2023-09-28T04:23:54.055450+0000","last_active":"2023-09-28T04:24:04.961951+0000","last_peered":"2023-09-28T04:24:04.961951+0000","last_clean":"2023-09-28T04:24:04.961951+0000","last_became_active":"2023-09-28T04:23:17.912023+0000","last_became_peered":"2023-09-28T04:23:17.912023+0000","last_unstale":"2023-09-28T04:24:04.961951+0000","last_undegraded":"2023-09-28T04:24:04.961951+0000","last_fullsized":"2023-09-28T04:24:04.961951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:54.055357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:54.055357+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.055357+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:17:24.451155+0000","scrub_duration":0.0015336760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:20.098615+0000","last_change":"2023-09-28T04:24:20.098581+0000","last_active":"2023-09-28T04:24:20.098615+0000","last_peered":"2023-09-28T04:24:20.098615+0000","last_clean":"2023-09-28T04:24:20.098615+0000","last_became_active":"2023-09-28T04:23:18.396190+0000","last_became_peered":"2023-09-28T04:23:18.396190+0000","last_unstale":"2023-09-28T04:24:20.098615+0000","last_undegraded":"2023-09-28T04:24:20.098615+0000","last_fullsized":"2023-09-28T04:24:20.098615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:20.098470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:20.098470+0000","last_clean_scrub_stamp":"2023-09-28T04:24:20.098470+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:28.543341+0000","scrub_duration":0.0020626680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'5","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957862+0000","last_change":"2023-09-28T04:23:54.007568+0000","last_active":"2023-09-28T04:24:04.957862+0000","last_peered":"2023-09-28T04:24:04.957862+0000","last_clean":"2023-09-28T04:24:04.957862+0000","last_became_active":"2023-09-28T04:23:17.903844+0000","last_became_peered":"2023-09-28T04:23:17.903844+0000","last_unstale":"2023-09-28T04:24:04.957862+0000","last_undegraded":"2023-09-28T04:24:04.957862+0000","last_fullsized":"2023-09-28T04:24:04.957862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'5","last_scrub_stamp":"2023-09-28T04:23:54.007483+0000","last_deep_scrub":"21'5","last_deep_scrub_stamp":"2023-09-28T04:23:54.007483+0000","last_clean_scrub_stamp":"2023-09-28T04:23:54.007483+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:34:02.446114+0000","scrub_duration":0.0036125480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.961733+0000","last_change":"2023-09-28T04:23:48.024392+0000","last_active":"2023-09-28T04:24:04.961733+0000","last_peered":"2023-09-28T04:24:04.961733+0000","last_clean":"2023-09-28T04:24:04.961733+0000","last_became_active":"2023-09-28T04:23:12.606143+0000","last_became_peered":"2023-09-28T04:23:12.606143+0000","last_unstale":"2023-09-28T04:24:04.961733+0000","last_undegraded":"2023-09-28T04:24:04.961733+0000","last_fullsized":"2023-09-28T04:24:04.961733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:48.024316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:48.024316+0000","last_clean_scrub_stamp":"2023-09-28T04:23:48.024316+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:49:31.414222+0000","scrub_duration":0.001689442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:38.563365+0000","last_change":"2023-09-28T04:24:38.563306+0000","last_active":"2023-09-28T04:24:38.563365+0000","last_peered":"2023-09-28T04:24:38.563365+0000","last_clean":"2023-09-28T04:24:38.563365+0000","last_became_active":"2023-09-28T04:23:18.392092+0000","last_became_peered":"2023-09-28T04:23:18.392092+0000","last_unstale":"2023-09-28T04:24:38.563365+0000","last_undegraded":"2023-09-28T04:24:38.563365+0000","last_fullsized":"2023-09-28T04:24:38.563365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:38.563205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:38.563205+0000","last_clean_scrub_stamp":"2023-09-28T04:24:38.563205+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T15:44:13.341073+0000","scrub_duration":0.0020900559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980247+0000","last_change":"2023-09-28T04:23:50.941989+0000","last_active":"2023-09-28T04:24:04.980247+0000","last_peered":"2023-09-28T04:24:04.980247+0000","last_clean":"2023-09-28T04:24:04.980247+0000","last_became_active":"2023-09-28T04:23:12.605965+0000","last_became_peered":"2023-09-28T04:23:12.605965+0000","last_unstale":"2023-09-28T04:24:04.980247+0000","last_undegraded":"2023-09-28T04:24:04.980247+0000","last_fullsized":"2023-09-28T04:24:04.980247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:50.941893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:50.941893+0000","last_clean_scrub_stamp":"2023-09-28T04:23:50.941893+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:00:20.487845+0000","scrub_duration":0.001623038,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962066+0000","last_change":"2023-09-28T04:23:46.366937+0000","last_active":"2023-09-28T04:24:04.962066+0000","last_peered":"2023-09-28T04:24:04.962066+0000","last_clean":"2023-09-28T04:24:04.962066+0000","last_became_active":"2023-09-28T04:23:17.914697+0000","last_became_peered":"2023-09-28T04:23:17.914697+0000","last_unstale":"2023-09-28T04:24:04.962066+0000","last_undegraded":"2023-09-28T04:24:04.962066+0000","last_fullsized":"2023-09-28T04:24:04.962066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:23:46.366859+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:23:46.366859+0000","last_clean_scrub_stamp":"2023-09-28T04:23:46.366859+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:07:57.413533+0000","scrub_duration":0.001760176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:14.078864+0000","last_change":"2023-09-28T04:24:14.078836+0000","last_active":"2023-09-28T04:24:14.078864+0000","last_peered":"2023-09-28T04:24:14.078864+0000","last_clean":"2023-09-28T04:24:14.078864+0000","last_became_active":"2023-09-28T04:23:18.386380+0000","last_became_peered":"2023-09-28T04:23:18.386380+0000","last_unstale":"2023-09-28T04:24:14.078864+0000","last_undegraded":"2023-09-28T04:24:14.078864+0000","last_fullsized":"2023-09-28T04:24:14.078864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:14.078736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:14.078736+0000","last_clean_scrub_stamp":"2023-09-28T04:24:14.078736+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:03:37.749258+0000","scrub_duration":0.001519507,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"21'5","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962194+0000","last_change":"2023-09-28T04:23:49.335161+0000","last_active":"2023-09-28T04:24:04.962194+0000","last_peered":"2023-09-28T04:24:04.962194+0000","last_clean":"2023-09-28T04:24:04.962194+0000","last_became_active":"2023-09-28T04:23:17.918116+0000","last_became_peered":"2023-09-28T04:23:17.918116+0000","last_unstale":"2023-09-28T04:24:04.962194+0000","last_undegraded":"2023-09-28T04:24:04.962194+0000","last_fullsized":"2023-09-28T04:24:04.962194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'5","last_scrub_stamp":"2023-09-28T04:23:49.335088+0000","last_deep_scrub":"21'5","last_deep_scrub_stamp":"2023-09-28T04:23:49.335088+0000","last_clean_scrub_stamp":"2023-09-28T04:23:49.335088+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:39:33.998499+0000","scrub_duration":0.002053263,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958898+0000","last_change":"2023-09-28T04:23:50.777493+0000","last_active":"2023-09-28T04:24:04.958898+0000","last_peered":"2023-09-28T04:24:04.958898+0000","last_clean":"2023-09-28T04:24:04.958898+0000","last_became_active":"2023-09-28T04:23:18.384930+0000","last_became_peered":"2023-09-28T04:23:18.384930+0000","last_unstale":"2023-09-28T04:24:04.958898+0000","last_undegraded":"2023-09-28T04:24:04.958898+0000","last_fullsized":"2023-09-28T04:24:04.958898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:50.777427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:50.777427+0000","last_clean_scrub_stamp":"2023-09-28T04:23:50.777427+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:00:20.323379+0000","scrub_duration":0.0012506990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"21'3","reported_seq":26,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.960799+0000","last_change":"2023-09-28T04:24:03.718903+0000","last_active":"2023-09-28T04:24:04.960799+0000","last_peered":"2023-09-28T04:24:04.960799+0000","last_clean":"2023-09-28T04:24:04.960799+0000","last_became_active":"2023-09-28T04:23:17.905667+0000","last_became_peered":"2023-09-28T04:23:17.905667+0000","last_unstale":"2023-09-28T04:24:04.960799+0000","last_undegraded":"2023-09-28T04:24:04.960799+0000","last_fullsized":"2023-09-28T04:24:04.960799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2023-09-28T04:24:03.718793+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2023-09-28T04:24:03.718793+0000","last_clean_scrub_stamp":"2023-09-28T04:24:03.718793+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:56.863850+0000","scrub_duration":0.0029125269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:37.077895+0000","last_change":"2023-09-28T04:24:37.077856+0000","last_active":"2023-09-28T04:24:37.077895+0000","last_peered":"2023-09-28T04:24:37.077895+0000","last_clean":"2023-09-28T04:24:37.077895+0000","last_became_active":"2023-09-28T04:23:18.400683+0000","last_became_peered":"2023-09-28T04:23:18.400683+0000","last_unstale":"2023-09-28T04:24:37.077895+0000","last_undegraded":"2023-09-28T04:24:37.077895+0000","last_fullsized":"2023-09-28T04:24:37.077895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:37.077752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:37.077752+0000","last_clean_scrub_stamp":"2023-09-28T04:24:37.077752+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:37:42.596813+0000","scrub_duration":0.0022428550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'6","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:15.578635+0000","last_change":"2023-09-28T04:24:15.578599+0000","last_active":"2023-09-28T04:24:15.578635+0000","last_peered":"2023-09-28T04:24:15.578635+0000","last_clean":"2023-09-28T04:24:15.578635+0000","last_became_active":"2023-09-28T04:23:17.904895+0000","last_became_peered":"2023-09-28T04:23:17.904895+0000","last_unstale":"2023-09-28T04:24:15.578635+0000","last_undegraded":"2023-09-28T04:24:15.578635+0000","last_fullsized":"2023-09-28T04:24:15.578635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2023-09-28T04:24:15.578513+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2023-09-28T04:24:15.578513+0000","last_clean_scrub_stamp":"2023-09-28T04:24:15.578513+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:29.086305+0000","scrub_duration":0.0035109989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.958425+0000","last_change":"2023-09-28T04:23:53.988936+0000","last_active":"2023-09-28T04:24:04.958425+0000","last_peered":"2023-09-28T04:24:04.958425+0000","last_clean":"2023-09-28T04:24:04.958425+0000","last_became_active":"2023-09-28T04:23:18.400410+0000","last_became_peered":"2023-09-28T04:23:18.400410+0000","last_unstale":"2023-09-28T04:24:04.958425+0000","last_undegraded":"2023-09-28T04:24:04.958425+0000","last_fullsized":"2023-09-28T04:24:04.958425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:53.988832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:53.988832+0000","last_clean_scrub_stamp":"2023-09-28T04:23:53.988832+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:47.133890+0000","scrub_duration":0.0018249080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'2","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.957853+0000","last_change":"2023-09-28T04:24:02.045496+0000","last_active":"2023-09-28T04:24:04.957853+0000","last_peered":"2023-09-28T04:24:04.957853+0000","last_clean":"2023-09-28T04:24:04.957853+0000","last_became_active":"2023-09-28T04:23:17.905198+0000","last_became_peered":"2023-09-28T04:23:17.905198+0000","last_unstale":"2023-09-28T04:24:04.957853+0000","last_undegraded":"2023-09-28T04:24:04.957853+0000","last_fullsized":"2023-09-28T04:24:04.957853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'2","last_scrub_stamp":"2023-09-28T04:24:02.045403+0000","last_deep_scrub":"21'2","last_deep_scrub_stamp":"2023-09-28T04:24:02.045403+0000","last_clean_scrub_stamp":"2023-09-28T04:24:02.045403+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:35:38.580346+0000","scrub_duration":0.0016629049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:21.247572+0000","last_change":"2023-09-28T04:24:21.247525+0000","last_active":"2023-09-28T04:24:21.247572+0000","last_peered":"2023-09-28T04:24:21.247572+0000","last_clean":"2023-09-28T04:24:21.247572+0000","last_became_active":"2023-09-28T04:23:18.392400+0000","last_became_peered":"2023-09-28T04:23:18.392400+0000","last_unstale":"2023-09-28T04:24:21.247572+0000","last_undegraded":"2023-09-28T04:24:21.247572+0000","last_fullsized":"2023-09-28T04:24:21.247572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:21.247418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:21.247418+0000","last_clean_scrub_stamp":"2023-09-28T04:24:21.247418+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:03:44.917940+0000","scrub_duration":0.001595677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"21'11","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.962550+0000","last_change":"2023-09-28T04:24:01.316338+0000","last_active":"2023-09-28T04:24:04.962550+0000","last_peered":"2023-09-28T04:24:04.962550+0000","last_clean":"2023-09-28T04:24:04.962550+0000","last_became_active":"2023-09-28T04:23:17.917266+0000","last_became_peered":"2023-09-28T04:23:17.917266+0000","last_unstale":"2023-09-28T04:24:04.962550+0000","last_undegraded":"2023-09-28T04:24:04.962550+0000","last_fullsized":"2023-09-28T04:24:04.962550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'11","last_scrub_stamp":"2023-09-28T04:24:01.316223+0000","last_deep_scrub":"21'11","last_deep_scrub_stamp":"2023-09-28T04:24:01.316223+0000","last_clean_scrub_stamp":"2023-09-28T04:24:01.316223+0000","objects_scrubbed":4,"log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:09:54.461281+0000","scrub_duration":0.0043941819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:19.091427+0000","last_change":"2023-09-28T04:24:19.091392+0000","last_active":"2023-09-28T04:24:19.091427+0000","last_peered":"2023-09-28T04:24:19.091427+0000","last_clean":"2023-09-28T04:24:19.091427+0000","last_became_active":"2023-09-28T04:23:18.386051+0000","last_became_peered":"2023-09-28T04:23:18.386051+0000","last_unstale":"2023-09-28T04:24:19.091427+0000","last_undegraded":"2023-09-28T04:24:19.091427+0000","last_fullsized":"2023-09-28T04:24:19.091427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:19.091255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:19.091255+0000","last_clean_scrub_stamp":"2023-09-28T04:24:19.091255+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:58:13.553932+0000","scrub_duration":0.001562742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:04.980037+0000","last_change":"2023-09-28T04:23:56.946309+0000","last_active":"2023-09-28T04:24:04.980037+0000","last_peered":"2023-09-28T04:24:04.980037+0000","last_clean":"2023-09-28T04:24:04.980037+0000","last_became_active":"2023-09-28T04:23:18.389280+0000","last_became_peered":"2023-09-28T04:23:18.389280+0000","last_unstale":"2023-09-28T04:24:04.980037+0000","last_undegraded":"2023-09-28T04:24:04.980037+0000","last_fullsized":"2023-09-28T04:24:04.980037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:23:56.946199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:23:56.946199+0000","last_clean_scrub_stamp":"2023-09-28T04:23:56.946199+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:01:53.399188+0000","scrub_duration":0.001773848,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:25.393406+0000","last_change":"2023-09-28T04:24:25.393360+0000","last_active":"2023-09-28T04:24:25.393406+0000","last_peered":"2023-09-28T04:24:25.393406+0000","last_clean":"2023-09-28T04:24:25.393406+0000","last_became_active":"2023-09-28T04:23:18.390929+0000","last_became_peered":"2023-09-28T04:23:18.390929+0000","last_unstale":"2023-09-28T04:24:25.393406+0000","last_undegraded":"2023-09-28T04:24:25.393406+0000","last_fullsized":"2023-09-28T04:24:25.393406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:25.393275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:25.393275+0000","last_clean_scrub_stamp":"2023-09-28T04:24:25.393275+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T14:58:19.855952+0000","scrub_duration":0.0014251139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:39.138253+0000","last_change":"2023-09-28T04:24:39.138223+0000","last_active":"2023-09-28T04:24:39.138253+0000","last_peered":"2023-09-28T04:24:39.138253+0000","last_clean":"2023-09-28T04:24:39.138253+0000","last_became_active":"2023-09-28T04:23:18.385870+0000","last_became_peered":"2023-09-28T04:23:18.385870+0000","last_unstale":"2023-09-28T04:24:39.138253+0000","last_undegraded":"2023-09-28T04:24:39.138253+0000","last_fullsized":"2023-09-28T04:24:39.138253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:39.138119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:39.138119+0000","last_clean_scrub_stamp":"2023-09-28T04:24:39.138119+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T16:16:12.413549+0000","scrub_duration":0.001436068,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T04:24:26.363453+0000","last_change":"2023-09-28T04:24:26.363407+0000","last_active":"2023-09-28T04:24:26.363453+0000","last_peered":"2023-09-28T04:24:26.363453+0000","last_clean":"2023-09-28T04:24:26.363453+0000","last_became_active":"2023-09-28T04:23:18.392245+0000","last_became_peered":"2023-09-28T04:23:18.392245+0000","last_unstale":"2023-09-28T04:24:26.363453+0000","last_undegraded":"2023-09-28T04:24:26.363453+0000","last_fullsized":"2023-09-28T04:24:26.363453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:26.363303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:26.363303+0000","last_clean_scrub_stamp":"2023-09-28T04:24:26.363303+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:23:13.178221+0000","scrub_duration":0.002114267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T04:24:06.038524+0000","last_change":"2023-09-28T04:24:06.038471+0000","last_active":"2023-09-28T04:24:06.038524+0000","last_peered":"2023-09-28T04:24:06.038524+0000","last_clean":"2023-09-28T04:24:06.038524+0000","last_became_active":"2023-09-28T04:23:18.391256+0000","last_became_peered":"2023-09-28T04:23:18.391256+0000","last_unstale":"2023-09-28T04:24:06.038524+0000","last_undegraded":"2023-09-28T04:24:06.038524+0000","last_fullsized":"2023-09-28T04:24:06.038524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T04:24:06.038393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T04:24:06.038393+0000","last_clean_scrub_stamp":"2023-09-28T04:24:06.038393+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:35:42.573336+0000","scrub_duration":0.0017123869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4966,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14640,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":9932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64912,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9112,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362728,"statfs":{"total":96636764160,"available":96627433472,"internally_reserved":0,"allocated":344064,"data_stored":685133,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.747},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.495}]},{"osd":6,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.434}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8444,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363396,"statfs":{"total":96636764160,"available":96628117504,"internally_reserved":0,"allocated":249856,"data_stored":92031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":7.8159999999999998,"5min":7.8159999999999998,"15min":7.8159999999999998},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.9319999999999999,"5min":3.9319999999999999,"15min":3.9319999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":3.524,"5min":3.524,"15min":3.524},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":4.1870000000000003,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":7.9989999999999997,"5min":7.9989999999999997,"15min":7.9989999999999997},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":7.9740000000000002,"5min":7.9740000000000002,"15min":7.9740000000000002},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":5.8940000000000001,"5min":5.8940000000000001,"15min":5.8940000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":5.4139999999999997,"5min":5.4139999999999997,"15min":5.4139999999999997},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.8799999999999999,"5min":3.8799999999999999,"15min":3.8799999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8500,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363340,"statfs":{"total":96636764160,"available":96628060160,"internally_reserved":0,"allocated":241664,"data_stored":91919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.44}]},{"osd":2,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.625},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.755},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Sep 28 04:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":339968,"data_stored":683741,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.436},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.503}]},{"osd":4,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.90600000000000003}]},{"osd":7,"last update":"Thu Sep 28 04:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":0.80400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8376,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363464,"statfs":{"total":96636764160,"available":96628187136,"internally_reserved":0,"allocated":245760,"data_stored":92009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.5}]},{"osd":3,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.374},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.60499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8516,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363324,"statfs":{"total":96636764160,"available":96628043776,"internally_reserved":0,"allocated":258048,"data_stored":93139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":8.1270000000000007,"5min":8.1270000000000007,"15min":8.1270000000000007},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.0489999999999999,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.081,"5min":3.081,"15min":3.081},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.9380000000000002,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.622}]},{"osd":7,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":0.54900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8608,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363232,"statfs":{"total":96636764160,"available":96627949568,"internally_reserved":0,"allocated":286720,"data_stored":94839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.629},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Sep 28 04:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.73099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8520,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363320,"statfs":{"total":96636764160,"available":96628039680,"internally_reserved":0,"allocated":262144,"data_stored":93209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.68300000000000005}]},{"osd":4,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.437},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Sep 28 04:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32456,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T04:24:52.211 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-28T04:24:52.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.425+0000 7f3465fff700 1 Processor -- start 2023-09-28T04:24:52.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.425+0000 7f3465fff700 1 -- start start 2023-09-28T04:24:52.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f3465fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346014fe60 0x7f3460156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:52.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f3465fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f34600c84c0 0x7f3460068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:52.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f3465fff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34600c8030 con 0x7f346014fa90 2023-09-28T04:24:52.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f3465fff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34600c7180 con 0x7f34600c84c0 2023-09-28T04:24:52.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f3465fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34600c7420 con 0x7f346014fe60 2023-09-28T04:24:52.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f345f7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f346014fa90 0x7f34600cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:41266/0 (socket says 172.21.15.118:41266) 2023-09-28T04:24:52.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f345f7fe700 1 -- 172.21.15.118:0/1653709068 learned_addr learned my addr 172.21.15.118:0/1653709068 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:24:52.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f345ffff700 1 --2- 172.21.15.118:0/1653709068 >> v2:172.21.15.118:3300/0 conn(0x7f34600c84c0 0x7f3460068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:52.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f345effd700 1 --2- 172.21.15.118:0/1653709068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346014fe60 0x7f3460156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:52.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f345e7fc700 1 -- 172.21.15.118:0/1653709068 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882694890 0 0) 0x7f34600c8030 con 0x7f346014fa90 2023-09-28T04:24:52.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f345e7fc700 1 -- 172.21.15.118:0/1653709068 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3448003570 con 0x7f346014fa90 2023-09-28T04:24:52.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f345ffff700 1 -- 172.21.15.118:0/1653709068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346014fe60 msgr2=0x7f3460156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:24:52.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f345ffff700 1 --2- 172.21.15.118:0/1653709068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346014fe60 0x7f3460156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f345ffff700 1 -- 172.21.15.118:0/1653709068 >> v1:172.21.15.118:6789/0 conn(0x7f346014fa90 legacy=0x7f34600cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:52.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.427+0000 7f345ffff700 1 -- 172.21.15.118:0/1653709068 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34600c7700 con 0x7f34600c84c0 2023-09-28T04:24:52.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.428+0000 7f345ffff700 1 --2- 172.21.15.118:0/1653709068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34600c84c0 0x7f3460068b90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3458009e60 tx=0x7f3458009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e613fa62baf0adb server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:52.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.428+0000 7f345e7fc700 1 -- 172.21.15.118:0/1653709068 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345800e070 con 0x7f34600c84c0 2023-09-28T04:24:52.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.428+0000 7f345e7fc700 1 -- 172.21.15.118:0/1653709068 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345800bab0 con 0x7f34600c84c0 2023-09-28T04:24:52.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.428+0000 7f345e7fc700 1 -- 172.21.15.118:0/1653709068 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345800be70 con 0x7f34600c84c0 2023-09-28T04:24:52.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.428+0000 7f3465fff700 1 -- 172.21.15.118:0/1653709068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34600c84c0 msgr2=0x7f3460068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:52.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.428+0000 7f3465fff700 1 --2- 172.21.15.118:0/1653709068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34600c84c0 0x7f3460068b90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3458009e60 tx=0x7f3458009780 comp rx=0 tx=0).stop 2023-09-28T04:24:52.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.428+0000 7f3465fff700 1 -- 172.21.15.118:0/1653709068 shutdown_connections 2023-09-28T04:24:52.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.428+0000 7f3465fff700 1 --2- 172.21.15.118:0/1653709068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34600c84c0 0x7f3460068b90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.428+0000 7f3465fff700 1 --2- 172.21.15.118:0/1653709068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346014fe60 0x7f3460156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.428+0000 7f3465fff700 1 -- 172.21.15.118:0/1653709068 >> 172.21.15.118:0/1653709068 conn(0x7f3460063cd0 msgr2=0x7f34600cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:52.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.429+0000 7f3465fff700 1 -- 172.21.15.118:0/1653709068 shutdown_connections 2023-09-28T04:24:52.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.429+0000 7f3465fff700 1 -- 172.21.15.118:0/1653709068 wait complete. 2023-09-28T04:24:52.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.430+0000 7f3465fff700 1 Processor -- start 2023-09-28T04:24:52.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.430+0000 7f3465fff700 1 -- start start 2023-09-28T04:24:52.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.431+0000 7f3465fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34600c84c0 0x7f346015b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:52.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.431+0000 7f3465fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f346014fa90 0x7f34601542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:52.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.431+0000 7f3465fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346014fe60 0x7f3460154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:52.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.431+0000 7f3465fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34600cb560 con 0x7f346014fa90 2023-09-28T04:24:52.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.431+0000 7f3465fff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34600cbb20 con 0x7f34600c84c0 2023-09-28T04:24:52.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.431+0000 7f3465fff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34600bf760 con 0x7f346014fe60 2023-09-28T04:24:52.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.431+0000 7f345effd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f346014fa90 0x7f34601542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:52.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.431+0000 7f345ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346014fe60 0x7f3460154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:52.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.431+0000 7f345effd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f346014fa90 0x7f34601542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51092/0 (socket says 172.21.15.118:51092) 2023-09-28T04:24:52.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.431+0000 7f345effd700 1 -- 172.21.15.118:0/93439982 learned_addr learned my addr 172.21.15.118:0/93439982 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:52.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.431+0000 7f345f7fe700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34600c84c0 0x7f346015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:52.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.432+0000 7f345effd700 1 -- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346014fe60 msgr2=0x7f3460154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:52.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.432+0000 7f345effd700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346014fe60 0x7f3460154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.432+0000 7f345effd700 1 -- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34600c84c0 msgr2=0x7f346015b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:52.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.432+0000 7f345effd700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34600c84c0 0x7f346015b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.432+0000 7f345effd700 1 -- 172.21.15.118:0/93439982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3458009a20 con 0x7f346014fa90 2023-09-28T04:24:52.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.432+0000 7f345ffff700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346014fe60 0x7f3460154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:24:52.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.432+0000 7f345effd700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f346014fa90 0x7f34601542c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f345400e930 tx=0x7f34540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:52.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.432+0000 7f34477fe700 1 -- 172.21.15.118:0/93439982 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454013680 con 0x7f346014fa90 2023-09-28T04:24:52.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.432+0000 7f34477fe700 1 -- 172.21.15.118:0/93439982 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34540137e0 con 0x7f346014fa90 2023-09-28T04:24:52.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.432+0000 7f34477fe700 1 -- 172.21.15.118:0/93439982 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454013b80 con 0x7f346014fa90 2023-09-28T04:24:52.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.432+0000 7f3465fff700 1 -- 172.21.15.118:0/93439982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3460169bd0 con 0x7f346014fa90 2023-09-28T04:24:52.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.432+0000 7f3465fff700 1 -- 172.21.15.118:0/93439982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34600ca200 con 0x7f346014fa90 2023-09-28T04:24:52.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.433+0000 7f3465fff700 1 -- 172.21.15.118:0/93439982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3460071980 con 0x7f346014fa90 2023-09-28T04:24:52.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.434+0000 7f34477fe700 1 -- 172.21.15.118:0/93439982 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f34540123d0 con 0x7f346014fa90 2023-09-28T04:24:52.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.435+0000 7f34477fe700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f344c067330 0x7f344c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:52.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.435+0000 7f34477fe700 1 -- 172.21.15.118:0/93439982 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f3454084ff0 con 0x7f346014fa90 2023-09-28T04:24:52.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.435+0000 7f345f7fe700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f344c067330 0x7f344c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:52.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.436+0000 7f345f7fe700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f344c067330 0x7f344c0697e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3450007fd0 tx=0x7f3450009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:52.439 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.439+0000 7f34477fe700 1 -- 172.21.15.118:0/93439982 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3454051e50 con 0x7f346014fa90 2023-09-28T04:24:52.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.630+0000 7f3465fff700 1 -- 172.21.15.118:0/93439982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f34601532d0 con 0x7f346014fa90 2023-09-28T04:24:52.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.634+0000 7f34477fe700 1 -- 172.21.15.118:0/93439982 <== mon.0 v2:172.21.15.118:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3454051e50 con 0x7f346014fa90 2023-09-28T04:24:52.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.634+0000 7f34477fe700 1 -- 172.21.15.118:0/93439982 <== mon.0 v2:172.21.15.118:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f34540170c0 con 0x7f346014fa90 2023-09-28T04:24:52.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.636+0000 7f3465fff700 1 -- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f344c067330 msgr2=0x7f344c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:52.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.636+0000 7f3465fff700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f344c067330 0x7f344c0697e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3450007fd0 tx=0x7f3450009040 comp rx=0 tx=0).stop 2023-09-28T04:24:52.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.636+0000 7f3465fff700 1 -- 172.21.15.118:0/93439982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f346014fa90 msgr2=0x7f34601542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:52.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.636+0000 7f3465fff700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f346014fa90 0x7f34601542c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f345400e930 tx=0x7f34540091a0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.637+0000 7f3465fff700 1 -- 172.21.15.118:0/93439982 shutdown_connections 2023-09-28T04:24:52.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.637+0000 7f3465fff700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f344c067330 0x7f344c0697e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.637+0000 7f3465fff700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f346014fe60 0x7f3460154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.637+0000 7f3465fff700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34600c84c0 0x7f346015b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.637+0000 7f3465fff700 1 --2- 172.21.15.118:0/93439982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f346014fa90 0x7f34601542c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.637+0000 7f3465fff700 1 -- 172.21.15.118:0/93439982 >> 172.21.15.118:0/93439982 conn(0x7f3460063cd0 msgr2=0x7f346014a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:52.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.637+0000 7f3465fff700 1 -- 172.21.15.118:0/93439982 shutdown_connections 2023-09-28T04:24:52.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.637+0000 7f3465fff700 1 -- 172.21.15.118:0/93439982 wait complete. 2023-09-28T04:24:52.654 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-28T04:24:52.654 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T04:24:52.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.842+0000 7f8c775ff700 1 Processor -- start 2023-09-28T04:24:52.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.842+0000 7f8c775ff700 1 -- start start 2023-09-28T04:24:52.845 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c775ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8c700adf10 0x7f8c701562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:52.845 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c775ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c7014f9f0 0x7f8c700c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:52.845 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c775ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c700c7980 con 0x7f8c70089830 2023-09-28T04:24:52.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c775ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c700cce60 con 0x7f8c7014f9f0 2023-09-28T04:24:52.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c775ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c700c75e0 con 0x7f8c700adf10 2023-09-28T04:24:52.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c75b9c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c7014f9f0 0x7f8c700c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:52.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c74b9a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8c70089830 0x7f8c7014f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:41272/0 (socket says 172.21.15.118:41272) 2023-09-28T04:24:52.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c74b9a700 1 -- 172.21.15.118:0/3540428886 learned_addr learned my addr 172.21.15.118:0/3540428886 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:24:52.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c7539b700 1 --2- 172.21.15.118:0/3540428886 >> v2:172.21.15.174:3300/0 conn(0x7f8c700adf10 0x7f8c701562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:52.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c75b9c700 1 -- 172.21.15.118:0/3540428886 >> v2:172.21.15.174:3300/0 conn(0x7f8c700adf10 msgr2=0x7f8c701562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:24:52.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c75b9c700 1 --2- 172.21.15.118:0/3540428886 >> v2:172.21.15.174:3300/0 conn(0x7f8c700adf10 0x7f8c701562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c75b9c700 1 -- 172.21.15.118:0/3540428886 >> v1:172.21.15.118:6789/0 conn(0x7f8c70089830 legacy=0x7f8c7014f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:52.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c75b9c700 1 -- 172.21.15.118:0/3540428886 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c700ccbc0 con 0x7f8c7014f9f0 2023-09-28T04:24:52.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.844+0000 7f8c67fff700 1 -- 172.21.15.118:0/3540428886 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680049098 0 0) 0x7f8c700c7980 con 0x7f8c70089830 2023-09-28T04:24:52.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.845+0000 7f8c75b9c700 1 --2- 172.21.15.118:0/3540428886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c7014f9f0 0x7f8c700c7e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8c70089d20 tx=0x7f8c68009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93661b3c5b7637ba server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:52.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.845+0000 7f8c67fff700 1 -- 172.21.15.118:0/3540428886 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800e070 con 0x7f8c7014f9f0 2023-09-28T04:24:52.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.845+0000 7f8c67fff700 1 -- 172.21.15.118:0/3540428886 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8c6800bb60 con 0x7f8c7014f9f0 2023-09-28T04:24:52.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.845+0000 7f8c67fff700 1 -- 172.21.15.118:0/3540428886 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68012430 con 0x7f8c7014f9f0 2023-09-28T04:24:52.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.845+0000 7f8c775ff700 1 -- 172.21.15.118:0/3540428886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c7014f9f0 msgr2=0x7f8c700c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:52.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.845+0000 7f8c775ff700 1 --2- 172.21.15.118:0/3540428886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c7014f9f0 0x7f8c700c7e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8c70089d20 tx=0x7f8c68009780 comp rx=0 tx=0).stop 2023-09-28T04:24:52.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.846+0000 7f8c775ff700 1 -- 172.21.15.118:0/3540428886 shutdown_connections 2023-09-28T04:24:52.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.846+0000 7f8c775ff700 1 --2- 172.21.15.118:0/3540428886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c7014f9f0 0x7f8c700c7e10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.846+0000 7f8c775ff700 1 --2- 172.21.15.118:0/3540428886 >> v2:172.21.15.174:3300/0 conn(0x7f8c700adf10 0x7f8c701562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.846+0000 7f8c775ff700 1 -- 172.21.15.118:0/3540428886 >> 172.21.15.118:0/3540428886 conn(0x7f8c70063cc0 msgr2=0x7f8c700cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:52.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.846+0000 7f8c775ff700 1 -- 172.21.15.118:0/3540428886 shutdown_connections 2023-09-28T04:24:52.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.846+0000 7f8c775ff700 1 -- 172.21.15.118:0/3540428886 wait complete. 2023-09-28T04:24:52.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.847+0000 7f8c775ff700 1 Processor -- start 2023-09-28T04:24:52.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.847+0000 7f8c775ff700 1 -- start start 2023-09-28T04:24:52.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.848+0000 7f8c775ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c70089830 0x7f8c700c0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:52.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.848+0000 7f8c775ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c700adf10 0x7f8c700c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:52.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.848+0000 7f8c775ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c7014f9f0 0x7f8c70156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:52.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.848+0000 7f8c775ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c70159340 con 0x7f8c7014f9f0 2023-09-28T04:24:52.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.848+0000 7f8c775ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700c2790 con 0x7f8c70089830 2023-09-28T04:24:52.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.848+0000 7f8c775ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700bf850 con 0x7f8c700adf10 2023-09-28T04:24:52.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.848+0000 7f8c75b9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c7014f9f0 0x7f8c70156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:52.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.848+0000 7f8c75b9c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c7014f9f0 0x7f8c70156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51116/0 (socket says 172.21.15.118:51116) 2023-09-28T04:24:52.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.848+0000 7f8c75b9c700 1 -- 172.21.15.118:0/1819430492 learned_addr learned my addr 172.21.15.118:0/1819430492 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:52.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.848+0000 7f8c7539b700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c70089830 0x7f8c700c0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:52.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.849+0000 7f8c74b9a700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c700adf10 0x7f8c700c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:52.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.849+0000 7f8c75b9c700 1 -- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c700adf10 msgr2=0x7f8c700c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:52.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.849+0000 7f8c75b9c700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c700adf10 0x7f8c700c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.849+0000 7f8c75b9c700 1 -- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c70089830 msgr2=0x7f8c700c0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:52.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.849+0000 7f8c75b9c700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c70089830 0x7f8c700c0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:52.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.849+0000 7f8c75b9c700 1 -- 172.21.15.118:0/1819430492 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c68009a20 con 0x7f8c7014f9f0 2023-09-28T04:24:52.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.849+0000 7f8c74b9a700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c700adf10 0x7f8c700c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T04:24:52.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.849+0000 7f8c75b9c700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c7014f9f0 0x7f8c70156fd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c68013000 tx=0x7f8c68009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:52.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.849+0000 7f8c657fa700 1 -- 172.21.15.118:0/1819430492 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68012e80 con 0x7f8c7014f9f0 2023-09-28T04:24:52.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.849+0000 7f8c657fa700 1 -- 172.21.15.118:0/1819430492 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8c68009420 con 0x7f8c7014f9f0 2023-09-28T04:24:52.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.849+0000 7f8c775ff700 1 -- 172.21.15.118:0/1819430492 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c700bfb30 con 0x7f8c7014f9f0 2023-09-28T04:24:52.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.849+0000 7f8c657fa700 1 -- 172.21.15.118:0/1819430492 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6801d880 con 0x7f8c7014f9f0 2023-09-28T04:24:52.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.849+0000 7f8c775ff700 1 -- 172.21.15.118:0/1819430492 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c701595e0 con 0x7f8c7014f9f0 2023-09-28T04:24:52.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.850+0000 7f8c775ff700 1 -- 172.21.15.118:0/1819430492 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c700c4d00 con 0x7f8c7014f9f0 2023-09-28T04:24:52.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.851+0000 7f8c657fa700 1 -- 172.21.15.118:0/1819430492 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8c68024070 con 0x7f8c7014f9f0 2023-09-28T04:24:52.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.852+0000 7f8c657fa700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8c54067330 0x7f8c540697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:52.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.852+0000 7f8c657fa700 1 -- 172.21.15.118:0/1819430492 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f8c680872f0 con 0x7f8c7014f9f0 2023-09-28T04:24:52.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.852+0000 7f8c7539b700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8c54067330 0x7f8c540697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:52.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.853+0000 7f8c7539b700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8c54067330 0x7f8c540697e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009ca0 tx=0x7f8c6c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:52.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:52.856+0000 7f8c657fa700 1 -- 172.21.15.118:0/1819430492 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8c68054230 con 0x7f8c7014f9f0 2023-09-28T04:24:53.089 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.089+0000 7f8c775ff700 1 -- 172.21.15.118:0/1819430492 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c70071980 con 0x7f8c7014f9f0 2023-09-28T04:24:53.090 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.089+0000 7f8c657fa700 1 -- 172.21.15.118:0/1819430492 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6147 (secure 0 0 0) 0x7f8c68057850 con 0x7f8c7014f9f0 2023-09-28T04:24:53.090 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:24:53.090 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3635601230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3635601230},{"type":"v1","addr":"172.21.15.174:6837","nonce":3635601230}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2662305504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2662305504},{"type":"v1","addr":"172.21.15.174:6839","nonce":2662305504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/524044984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":524044984},{"type":"v1","addr":"172.21.15.118:6833","nonce":524044984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T04:23:18.370081+0000","modified":"2023-09-28T04:23:33.491193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4303,"mds_1":4300,"mds_2":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6836/1739320088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1739320088},{"type":"v1","addr":"172.21.15.174:6836","nonce":1739320088}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4300":{"gid":4300,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6835/2977056141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2977056141},{"type":"v1","addr":"172.21.15.118:6835","nonce":2977056141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4303":{"gid":4303,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6837/233759601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":233759601},{"type":"v1","addr":"172.21.15.118:6837","nonce":233759601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T04:24:53.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.092+0000 7f8c775ff700 1 -- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8c54067330 msgr2=0x7f8c540697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.092+0000 7f8c775ff700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8c54067330 0x7f8c540697e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009ca0 tx=0x7f8c6c008040 comp rx=0 tx=0).stop 2023-09-28T04:24:53.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.092+0000 7f8c775ff700 1 -- 172.21.15.118:0/1819430492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c7014f9f0 msgr2=0x7f8c70156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.092+0000 7f8c775ff700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c7014f9f0 0x7f8c70156fd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c68013000 tx=0x7f8c68009780 comp rx=0 tx=0).stop 2023-09-28T04:24:53.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.092+0000 7f8c775ff700 1 -- 172.21.15.118:0/1819430492 shutdown_connections 2023-09-28T04:24:53.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.092+0000 7f8c775ff700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f8c54067330 0x7f8c540697e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.092+0000 7f8c775ff700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c7014f9f0 0x7f8c70156fd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.094 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.092+0000 7f8c775ff700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c70089830 0x7f8c700c0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.094 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.092+0000 7f8c775ff700 1 --2- 172.21.15.118:0/1819430492 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c700adf10 0x7f8c700c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.094 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.092+0000 7f8c775ff700 1 -- 172.21.15.118:0/1819430492 >> 172.21.15.118:0/1819430492 conn(0x7f8c70063cc0 msgr2=0x7f8c70154420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:53.094 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.092+0000 7f8c775ff700 1 -- 172.21.15.118:0/1819430492 shutdown_connections 2023-09-28T04:24:53.094 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.092+0000 7f8c775ff700 1 -- 172.21.15.118:0/1819430492 wait complete. 2023-09-28T04:24:53.094 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 12 2023-09-28T04:24:53.110 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T04:24:53.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.297+0000 7fca3d9ff700 1 Processor -- start 2023-09-28T04:24:53.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.297+0000 7fca3d9ff700 1 -- start start 2023-09-28T04:24:53.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.298+0000 7fca3d9ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fca3814fa90 0x7fca38156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:53.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.298+0000 7fca3d9ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fca380c84c0 0x7fca38068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:53.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.298+0000 7fca3d9ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca380c8030 con 0x7fca3814fe60 2023-09-28T04:24:53.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.298+0000 7fca3d9ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca380c7180 con 0x7fca3814fa90 2023-09-28T04:24:53.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.298+0000 7fca3d9ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca380c7420 con 0x7fca380c84c0 2023-09-28T04:24:53.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.299+0000 7fca36ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fca3814fa90 0x7fca38156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:53.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.299+0000 7fca367fc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fca3814fe60 0x7fca380cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:41286/0 (socket says 172.21.15.118:41286) 2023-09-28T04:24:53.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.299+0000 7fca367fc700 1 -- 172.21.15.118:0/623991690 learned_addr learned my addr 172.21.15.118:0/623991690 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:24:53.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.299+0000 7fca377fe700 1 --2- 172.21.15.118:0/623991690 >> v2:172.21.15.174:3300/0 conn(0x7fca380c84c0 0x7fca38068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:53.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.299+0000 7fca36ffd700 1 -- 172.21.15.118:0/623991690 >> v2:172.21.15.174:3300/0 conn(0x7fca380c84c0 msgr2=0x7fca38068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:24:53.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.299+0000 7fca36ffd700 1 --2- 172.21.15.118:0/623991690 >> v2:172.21.15.174:3300/0 conn(0x7fca380c84c0 0x7fca38068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.299+0000 7fca36ffd700 1 -- 172.21.15.118:0/623991690 >> v1:172.21.15.118:6789/0 conn(0x7fca3814fe60 legacy=0x7fca380cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.299+0000 7fca36ffd700 1 -- 172.21.15.118:0/623991690 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380c7700 con 0x7fca3814fa90 2023-09-28T04:24:53.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.299+0000 7fca35ffb700 1 -- 172.21.15.118:0/623991690 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539462701 0 0) 0x7fca380c8030 con 0x7fca3814fe60 2023-09-28T04:24:53.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.299+0000 7fca377fe700 1 --2- 172.21.15.118:0/623991690 >> v2:172.21.15.174:3300/0 conn(0x7fca380c84c0 0x7fca38068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T04:24:53.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.299+0000 7fca36ffd700 1 --2- 172.21.15.118:0/623991690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3814fa90 0x7fca38156430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fca380c64b0 tx=0x7fca280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1491b9f08470b97 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:53.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.300+0000 7fca35ffb700 1 -- 172.21.15.118:0/623991690 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800b6b0 con 0x7fca3814fa90 2023-09-28T04:24:53.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.300+0000 7fca35ffb700 1 -- 172.21.15.118:0/623991690 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fca2800b810 con 0x7fca3814fa90 2023-09-28T04:24:53.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.300+0000 7fca35ffb700 1 -- 172.21.15.118:0/623991690 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800bbd0 con 0x7fca3814fa90 2023-09-28T04:24:53.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.300+0000 7fca3d9ff700 1 -- 172.21.15.118:0/623991690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3814fa90 msgr2=0x7fca38156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.300+0000 7fca3d9ff700 1 --2- 172.21.15.118:0/623991690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3814fa90 0x7fca38156430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fca380c64b0 tx=0x7fca280091a0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.300+0000 7fca3d9ff700 1 -- 172.21.15.118:0/623991690 shutdown_connections 2023-09-28T04:24:53.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.300+0000 7fca3d9ff700 1 --2- 172.21.15.118:0/623991690 >> v2:172.21.15.174:3300/0 conn(0x7fca380c84c0 0x7fca38068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.300+0000 7fca3d9ff700 1 --2- 172.21.15.118:0/623991690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3814fa90 0x7fca38156430 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.300+0000 7fca3d9ff700 1 -- 172.21.15.118:0/623991690 >> 172.21.15.118:0/623991690 conn(0x7fca38063cd0 msgr2=0x7fca380cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:53.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.300+0000 7fca3d9ff700 1 -- 172.21.15.118:0/623991690 shutdown_connections 2023-09-28T04:24:53.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.300+0000 7fca3d9ff700 1 -- 172.21.15.118:0/623991690 wait complete. 2023-09-28T04:24:53.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.302+0000 7fca3d9ff700 1 Processor -- start 2023-09-28T04:24:53.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.302+0000 7fca3d9ff700 1 -- start start 2023-09-28T04:24:53.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.303+0000 7fca3d9ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca380c84c0 0x7fca381510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:53.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.303+0000 7fca3d9ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca3814fa90 0x7fca380c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:53.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.303+0000 7fca3d9ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3814fe60 0x7fca380c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:53.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.303+0000 7fca3d9ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca38151e10 con 0x7fca3814fe60 2023-09-28T04:24:53.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.303+0000 7fca3d9ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca380c3240 con 0x7fca3814fa90 2023-09-28T04:24:53.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.303+0000 7fca3d9ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca38150620 con 0x7fca380c84c0 2023-09-28T04:24:53.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.303+0000 7fca377fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3814fe60 0x7fca380c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:53.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.303+0000 7fca377fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3814fe60 0x7fca380c5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51144/0 (socket says 172.21.15.118:51144) 2023-09-28T04:24:53.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.303+0000 7fca377fe700 1 -- 172.21.15.118:0/3656428768 learned_addr learned my addr 172.21.15.118:0/3656428768 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:53.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.303+0000 7fca36ffd700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca380c84c0 0x7fca381510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:53.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.303+0000 7fca367fc700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca3814fa90 0x7fca380c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:53.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.304+0000 7fca377fe700 1 -- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca380c84c0 msgr2=0x7fca381510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.304+0000 7fca377fe700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca380c84c0 0x7fca381510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.304+0000 7fca377fe700 1 -- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca3814fa90 msgr2=0x7fca380c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.304+0000 7fca377fe700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca3814fa90 0x7fca380c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.304+0000 7fca377fe700 1 -- 172.21.15.118:0/3656428768 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca28009420 con 0x7fca3814fe60 2023-09-28T04:24:53.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.304+0000 7fca377fe700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3814fe60 0x7fca380c5eb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fca3000d100 tx=0x7fca300099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:53.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.304+0000 7fca1effd700 1 -- 172.21.15.118:0/3656428768 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3000dc40 con 0x7fca3814fe60 2023-09-28T04:24:53.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.304+0000 7fca1effd700 1 -- 172.21.15.118:0/3656428768 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fca3000f040 con 0x7fca3814fe60 2023-09-28T04:24:53.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.304+0000 7fca3d9ff700 1 -- 172.21.15.118:0/3656428768 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca380c34d0 con 0x7fca3814fe60 2023-09-28T04:24:53.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.304+0000 7fca1effd700 1 -- 172.21.15.118:0/3656428768 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca30015440 con 0x7fca3814fe60 2023-09-28T04:24:53.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.304+0000 7fca3d9ff700 1 -- 172.21.15.118:0/3656428768 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca38150340 con 0x7fca3814fe60 2023-09-28T04:24:53.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.305+0000 7fca3d9ff700 1 -- 172.21.15.118:0/3656428768 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca38070fe0 con 0x7fca3814fe60 2023-09-28T04:24:53.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.306+0000 7fca1effd700 1 -- 172.21.15.118:0/3656428768 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fca3001e3b0 con 0x7fca3814fe60 2023-09-28T04:24:53.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.307+0000 7fca1effd700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fca24067330 0x7fca240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:53.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.307+0000 7fca1effd700 1 -- 172.21.15.118:0/3656428768 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fca300850d0 con 0x7fca3814fe60 2023-09-28T04:24:53.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.307+0000 7fca36ffd700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fca24067330 0x7fca240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:53.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.308+0000 7fca36ffd700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fca24067330 0x7fca240697e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fca280093f0 tx=0x7fca280091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:53.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.311+0000 7fca1effd700 1 -- 172.21.15.118:0/3656428768 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fca38070fe0 con 0x7fca3814fe60 2023-09-28T04:24:53.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.542+0000 7fca3d9ff700 1 -- 172.21.15.118:0/3656428768 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca38070fe0 con 0x7fca3814fe60 2023-09-28T04:24:53.543 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.543+0000 7fca1effd700 1 -- 172.21.15.118:0/3656428768 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6147 (secure 0 0 0) 0x7fca38070fe0 con 0x7fca3814fe60 2023-09-28T04:24:53.543 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:24:53.544 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3635601230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3635601230},{"type":"v1","addr":"172.21.15.174:6837","nonce":3635601230}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2662305504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2662305504},{"type":"v1","addr":"172.21.15.174:6839","nonce":2662305504}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/524044984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":524044984},{"type":"v1","addr":"172.21.15.118:6833","nonce":524044984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T04:23:18.370081+0000","modified":"2023-09-28T04:23:33.491193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4303,"mds_1":4300,"mds_2":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6836/1739320088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1739320088},{"type":"v1","addr":"172.21.15.174:6836","nonce":1739320088}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4300":{"gid":4300,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6835/2977056141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2977056141},{"type":"v1","addr":"172.21.15.118:6835","nonce":2977056141}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4303":{"gid":4303,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6837/233759601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":233759601},{"type":"v1","addr":"172.21.15.118:6837","nonce":233759601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T04:24:53.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.545+0000 7fca3d9ff700 1 -- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fca24067330 msgr2=0x7fca240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.545+0000 7fca3d9ff700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fca24067330 0x7fca240697e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fca280093f0 tx=0x7fca280091a0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.545+0000 7fca3d9ff700 1 -- 172.21.15.118:0/3656428768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3814fe60 msgr2=0x7fca380c5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.545+0000 7fca3d9ff700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3814fe60 0x7fca380c5eb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fca3000d100 tx=0x7fca300099b0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.545+0000 7fca3d9ff700 1 -- 172.21.15.118:0/3656428768 shutdown_connections 2023-09-28T04:24:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.545+0000 7fca3d9ff700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fca24067330 0x7fca240697e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.545+0000 7fca3d9ff700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3814fe60 0x7fca380c5eb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.545+0000 7fca3d9ff700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca380c84c0 0x7fca381510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.545+0000 7fca3d9ff700 1 --2- 172.21.15.118:0/3656428768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca3814fa90 0x7fca380c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.545+0000 7fca3d9ff700 1 -- 172.21.15.118:0/3656428768 >> 172.21.15.118:0/3656428768 conn(0x7fca38063cd0 msgr2=0x7fca3814eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:53.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.545+0000 7fca3d9ff700 1 -- 172.21.15.118:0/3656428768 shutdown_connections 2023-09-28T04:24:53.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.546+0000 7fca3d9ff700 1 -- 172.21.15.118:0/3656428768 wait complete. 2023-09-28T04:24:53.548 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 12 2023-09-28T04:24:53.563 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T04:24:53.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.752+0000 7fb9995ff700 1 Processor -- start 2023-09-28T04:24:53.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.752+0000 7fb9995ff700 1 -- start start 2023-09-28T04:24:53.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.753+0000 7fb9995ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb99406f1c0 0x7fb994152640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:53.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.753+0000 7fb9995ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb99406b490 0x7fb99406b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:53.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.753+0000 7fb9995ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99414c3c0 con 0x7fb9940c31b0 2023-09-28T04:24:53.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.753+0000 7fb9995ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9940c24c0 con 0x7fb99406f1c0 2023-09-28T04:24:53.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.753+0000 7fb9995ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99406c2c0 con 0x7fb99406b490 2023-09-28T04:24:53.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.753+0000 7fb992ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb99406f1c0 0x7fb994152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:53.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.753+0000 7fb992ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb99406f1c0 0x7fb994152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51154/0 (socket says 172.21.15.118:51154) 2023-09-28T04:24:53.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.753+0000 7fb992ffd700 1 -- 172.21.15.118:0/1081477199 learned_addr learned my addr 172.21.15.118:0/1081477199 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:53.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.754+0000 7fb98bfff700 1 --2- 172.21.15.118:0/1081477199 >> v2:172.21.15.174:3300/0 conn(0x7fb99406b490 0x7fb99406b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:53.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.754+0000 7fb992ffd700 1 -- 172.21.15.118:0/1081477199 >> v2:172.21.15.174:3300/0 conn(0x7fb99406b490 msgr2=0x7fb99406b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:24:53.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.754+0000 7fb992ffd700 1 --2- 172.21.15.118:0/1081477199 >> v2:172.21.15.174:3300/0 conn(0x7fb99406b490 0x7fb99406b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.754+0000 7fb992ffd700 1 -- 172.21.15.118:0/1081477199 >> v1:172.21.15.174:6789/0 conn(0x7fb9940c31b0 legacy=0x7fb9940c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.754+0000 7fb992ffd700 1 -- 172.21.15.118:0/1081477199 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9940c4fd0 con 0x7fb99406f1c0 2023-09-28T04:24:53.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.754+0000 7fb992ffd700 1 --2- 172.21.15.118:0/1081477199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb99406f1c0 0x7fb994152640 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb99406d590 tx=0x7fb98400b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb14b0818a56b18 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:53.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.754+0000 7fb9927fc700 1 -- 172.21.15.118:0/1081477199 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98400db10 con 0x7fb99406f1c0 2023-09-28T04:24:53.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.754+0000 7fb9927fc700 1 -- 172.21.15.118:0/1081477199 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb98400dc70 con 0x7fb99406f1c0 2023-09-28T04:24:53.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.754+0000 7fb9927fc700 1 -- 172.21.15.118:0/1081477199 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb984017410 con 0x7fb99406f1c0 2023-09-28T04:24:53.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.755+0000 7fb9995ff700 1 -- 172.21.15.118:0/1081477199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb99406f1c0 msgr2=0x7fb994152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.755+0000 7fb9995ff700 1 --2- 172.21.15.118:0/1081477199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb99406f1c0 0x7fb994152640 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb99406d590 tx=0x7fb98400b4e0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.755+0000 7fb9995ff700 1 -- 172.21.15.118:0/1081477199 shutdown_connections 2023-09-28T04:24:53.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.755+0000 7fb9995ff700 1 --2- 172.21.15.118:0/1081477199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb99406f1c0 0x7fb994152640 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.755+0000 7fb9995ff700 1 --2- 172.21.15.118:0/1081477199 >> v2:172.21.15.174:3300/0 conn(0x7fb99406b490 0x7fb99406b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.755+0000 7fb9995ff700 1 -- 172.21.15.118:0/1081477199 >> 172.21.15.118:0/1081477199 conn(0x7fb994067630 msgr2=0x7fb994067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.755+0000 7fb9995ff700 1 -- 172.21.15.118:0/1081477199 shutdown_connections 2023-09-28T04:24:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.755+0000 7fb9995ff700 1 -- 172.21.15.118:0/1081477199 wait complete. 2023-09-28T04:24:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.756+0000 7fb9995ff700 1 Processor -- start 2023-09-28T04:24:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.757+0000 7fb9995ff700 1 -- start start 2023-09-28T04:24:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.757+0000 7fb9995ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb99406b490 0x7fb994141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.757+0000 7fb9995ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb99406f1c0 0x7fb99415c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb9995ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9940c31b0 0x7fb99415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:53.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb9995ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb994142d20 con 0x7fb9940c31b0 2023-09-28T04:24:53.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb9995ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99414fbd0 con 0x7fb99406f1c0 2023-09-28T04:24:53.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb9995ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9941659b0 con 0x7fb99406b490 2023-09-28T04:24:53.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb992ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb99406b490 0x7fb994141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:53.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb9937fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9940c31b0 0x7fb99415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:53.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb98bfff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb99406f1c0 0x7fb99415c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:53.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb9937fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9940c31b0 0x7fb99415cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51166/0 (socket says 172.21.15.118:51166) 2023-09-28T04:24:53.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb9937fe700 1 -- 172.21.15.118:0/1281036640 learned_addr learned my addr 172.21.15.118:0/1281036640 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:53.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb992ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb99406b490 0x7fb994141ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.118:36862/0 (socket says 172.21.15.118:36862) 2023-09-28T04:24:53.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb9937fe700 1 -- 172.21.15.118:0/1281036640 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb99406b490 msgr2=0x7fb994141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb9937fe700 1 --2- 172.21.15.118:0/1281036640 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb99406b490 0x7fb994141ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb9937fe700 1 -- 172.21.15.118:0/1281036640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb99406f1c0 msgr2=0x7fb99415c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb9937fe700 1 --2- 172.21.15.118:0/1281036640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb99406f1c0 0x7fb99415c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb9937fe700 1 -- 172.21.15.118:0/1281036640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98400b780 con 0x7fb9940c31b0 2023-09-28T04:24:53.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.758+0000 7fb9937fe700 1 --2- 172.21.15.118:0/1281036640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9940c31b0 0x7fb99415cee0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00c8e0 tx=0x7fb98c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:53.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.759+0000 7fb98affd700 1 -- 172.21.15.118:0/1281036640 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c012630 con 0x7fb9940c31b0 2023-09-28T04:24:53.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.759+0000 7fb98affd700 1 -- 172.21.15.118:0/1281036640 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb98c012790 con 0x7fb9940c31b0 2023-09-28T04:24:53.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.759+0000 7fb9995ff700 1 -- 172.21.15.118:0/1281036640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb994142000 con 0x7fb9940c31b0 2023-09-28T04:24:53.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.759+0000 7fb98affd700 1 -- 172.21.15.118:0/1281036640 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c012b70 con 0x7fb9940c31b0 2023-09-28T04:24:53.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.759+0000 7fb9995ff700 1 -- 172.21.15.118:0/1281036640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb994147030 con 0x7fb9940c31b0 2023-09-28T04:24:53.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.760+0000 7fb9995ff700 1 -- 172.21.15.118:0/1281036640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb994071980 con 0x7fb9940c31b0 2023-09-28T04:24:53.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.761+0000 7fb98affd700 1 -- 172.21.15.118:0/1281036640 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb98c01b400 con 0x7fb9940c31b0 2023-09-28T04:24:53.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.761+0000 7fb98affd700 1 --2- 172.21.15.118:0/1281036640 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb974067330 0x7fb9740697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:53.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.762+0000 7fb98affd700 1 -- 172.21.15.118:0/1281036640 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb98c085130 con 0x7fb9940c31b0 2023-09-28T04:24:53.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.762+0000 7fb992ffd700 1 --2- 172.21.15.118:0/1281036640 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb974067330 0x7fb9740697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:53.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.762+0000 7fb992ffd700 1 --2- 172.21.15.118:0/1281036640 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb974067330 0x7fb9740697e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb984019040 tx=0x7fb98400b4e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:53.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.766+0000 7fb98affd700 1 -- 172.21.15.118:0/1281036640 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb98c051fd0 con 0x7fb9940c31b0 2023-09-28T04:24:53.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.961+0000 7fb9995ff700 1 -- 172.21.15.118:0/1281036640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb994165af0 con 0x7fb9940c31b0 2023-09-28T04:24:53.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.962+0000 7fb98affd700 1 -- 172.21.15.118:0/1281036640 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17106 (secure 0 0 0) 0x7fb98c0555f0 con 0x7fb9940c31b0 2023-09-28T04:24:53.963 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-09-28T04:24:53.963 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":23,"fsid":"aedcea83-ad1a-46d9-8a4a-210ffd422a84","created":"2023-09-28T04:22:58.890593+0000","modified":"2023-09-28T04:24:05.954384+0000","last_up_change":"2023-09-28T04:23:09.517312+0000","last_in_change":"2023-09-28T04:23:01.580166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T04:23:10.586895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T04:23:10.697802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T04:23:16.491417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T04:23:17.349188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5f03ec78-88be-455a-b631-23a0f43dcadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6819","nonce":114261},{"type":"v1","addr":"172.21.15.118:6821","nonce":114261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":114261},{"type":"v1","addr":"172.21.15.118:6825","nonce":114261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":114261},{"type":"v1","addr":"172.21.15.118:6831","nonce":114261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6827","nonce":114261},{"type":"v1","addr":"172.21.15.118:6829","nonce":114261}]},"public_addr":"172.21.15.118:6821/114261","cluster_addr":"172.21.15.118:6825/114261","heartbeat_back_addr":"172.21.15.118:6831/114261","heartbeat_front_addr":"172.21.15.118:6829/114261","state":["exists","up"]},{"osd":1,"uuid":"f3f70643-751b-4f1a-a043-b0cca861e209","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":114260},{"type":"v1","addr":"172.21.15.118:6817","nonce":114260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":114260},{"type":"v1","addr":"172.21.15.118:6820","nonce":114260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":114260},{"type":"v1","addr":"172.21.15.118:6828","nonce":114260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":114260},{"type":"v1","addr":"172.21.15.118:6824","nonce":114260}]},"public_addr":"172.21.15.118:6817/114260","cluster_addr":"172.21.15.118:6820/114260","heartbeat_back_addr":"172.21.15.118:6828/114260","heartbeat_front_addr":"172.21.15.118:6824/114260","state":["exists","up"]},{"osd":2,"uuid":"cb071ef8-411c-4647-826f-b032f9c2f3c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":114259},{"type":"v1","addr":"172.21.15.118:6809","nonce":114259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":114259},{"type":"v1","addr":"172.21.15.118:6811","nonce":114259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":114259},{"type":"v1","addr":"172.21.15.118:6815","nonce":114259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":114259},{"type":"v1","addr":"172.21.15.118:6813","nonce":114259}]},"public_addr":"172.21.15.118:6809/114259","cluster_addr":"172.21.15.118:6811/114259","heartbeat_back_addr":"172.21.15.118:6815/114259","heartbeat_front_addr":"172.21.15.118:6813/114259","state":["exists","up"]},{"osd":3,"uuid":"8b4858ee-61f7-4888-b06d-691c0ab2fe37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":114258},{"type":"v1","addr":"172.21.15.118:6801","nonce":114258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":114258},{"type":"v1","addr":"172.21.15.118:6803","nonce":114258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":114258},{"type":"v1","addr":"172.21.15.118:6807","nonce":114258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":114258},{"type":"v1","addr":"172.21.15.118:6805","nonce":114258}]},"public_addr":"172.21.15.118:6801/114258","cluster_addr":"172.21.15.118:6803/114258","heartbeat_back_addr":"172.21.15.118:6807/114258","heartbeat_front_addr":"172.21.15.118:6805/114258","state":["exists","up"]},{"osd":4,"uuid":"5ac654cb-4138-4e61-8a2c-9b18cbec4e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":119880},{"type":"v1","addr":"172.21.15.174:6801","nonce":119880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":119880},{"type":"v1","addr":"172.21.15.174:6803","nonce":119880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":119880},{"type":"v1","addr":"172.21.15.174:6807","nonce":119880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":119880},{"type":"v1","addr":"172.21.15.174:6805","nonce":119880}]},"public_addr":"172.21.15.174:6801/119880","cluster_addr":"172.21.15.174:6803/119880","heartbeat_back_addr":"172.21.15.174:6807/119880","heartbeat_front_addr":"172.21.15.174:6805/119880","state":["exists","up"]},{"osd":5,"uuid":"7aa0eaee-f25c-4ca1-a55f-da714be4aa43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":119908},{"type":"v1","addr":"172.21.15.174:6819","nonce":119908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":119908},{"type":"v1","addr":"172.21.15.174:6823","nonce":119908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":119908},{"type":"v1","addr":"172.21.15.174:6831","nonce":119908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":119908},{"type":"v1","addr":"172.21.15.174:6827","nonce":119908}]},"public_addr":"172.21.15.174:6819/119908","cluster_addr":"172.21.15.174:6823/119908","heartbeat_back_addr":"172.21.15.174:6831/119908","heartbeat_front_addr":"172.21.15.174:6827/119908","state":["exists","up"]},{"osd":6,"uuid":"22e36623-0a40-4e50-a469-30e296d2476e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":119911},{"type":"v1","addr":"172.21.15.174:6818","nonce":119911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":119911},{"type":"v1","addr":"172.21.15.174:6822","nonce":119911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":119911},{"type":"v1","addr":"172.21.15.174:6830","nonce":119911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":119911},{"type":"v1","addr":"172.21.15.174:6826","nonce":119911}]},"public_addr":"172.21.15.174:6818/119911","cluster_addr":"172.21.15.174:6822/119911","heartbeat_back_addr":"172.21.15.174:6830/119911","heartbeat_front_addr":"172.21.15.174:6826/119911","state":["exists","up"]},{"osd":7,"uuid":"747dff1c-1812-404d-829c-c884fee73df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":119881},{"type":"v1","addr":"172.21.15.174:6809","nonce":119881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":119881},{"type":"v1","addr":"172.21.15.174:6811","nonce":119881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":119881},{"type":"v1","addr":"172.21.15.174:6815","nonce":119881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":119881},{"type":"v1","addr":"172.21.15.174:6813","nonce":119881}]},"public_addr":"172.21.15.174:6809/119881","cluster_addr":"172.21.15.174:6811/119881","heartbeat_back_addr":"172.21.15.174:6815/119881","heartbeat_front_addr":"172.21.15.174:6813/119881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:07.142219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.951857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.911133+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.882482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.688096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.764671+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.767264+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T04:23:06.763816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T04:24:53.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.965+0000 7fb9995ff700 1 -- 172.21.15.118:0/1281036640 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb974067330 msgr2=0x7fb9740697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.965+0000 7fb9995ff700 1 --2- 172.21.15.118:0/1281036640 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb974067330 0x7fb9740697e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb984019040 tx=0x7fb98400b4e0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.965+0000 7fb9995ff700 1 -- 172.21.15.118:0/1281036640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9940c31b0 msgr2=0x7fb99415cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.965+0000 7fb9995ff700 1 --2- 172.21.15.118:0/1281036640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9940c31b0 0x7fb99415cee0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00c8e0 tx=0x7fb98c001710 comp rx=0 tx=0).stop 2023-09-28T04:24:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.965+0000 7fb9995ff700 1 -- 172.21.15.118:0/1281036640 shutdown_connections 2023-09-28T04:24:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.965+0000 7fb9995ff700 1 --2- 172.21.15.118:0/1281036640 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fb974067330 0x7fb9740697e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.965+0000 7fb9995ff700 1 --2- 172.21.15.118:0/1281036640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9940c31b0 0x7fb99415cee0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.965+0000 7fb9995ff700 1 --2- 172.21.15.118:0/1281036640 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb99406b490 0x7fb994141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.965+0000 7fb9995ff700 1 --2- 172.21.15.118:0/1281036640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb99406f1c0 0x7fb99415c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:53.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.965+0000 7fb9995ff700 1 -- 172.21.15.118:0/1281036640 >> 172.21.15.118:0/1281036640 conn(0x7fb994067630 msgr2=0x7fb99415b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:53.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.965+0000 7fb9995ff700 1 -- 172.21.15.118:0/1281036640 shutdown_connections 2023-09-28T04:24:53.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:53.965+0000 7fb9995ff700 1 -- 172.21.15.118:0/1281036640 wait complete. 2023-09-28T04:24:53.983 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-28T04:24:54.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.171+0000 7f5810bff700 1 Processor -- start 2023-09-28T04:24:54.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.171+0000 7f5810bff700 1 -- start start 2023-09-28T04:24:54.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.172+0000 7f5810bff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f580c0ae320 0x7f580c156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:54.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.172+0000 7f5810bff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580c0c8030 con 0x7f580c14fe60 2023-09-28T04:24:54.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.173+0000 7f5810bff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580c0c7180 con 0x7f580c14fa90 2023-09-28T04:24:54.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.173+0000 7f5810bff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580c0c7420 con 0x7f580c0ae320 2023-09-28T04:24:54.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.173+0000 7f5801d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f580c14fe60 0x7f580c0adc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:41296/0 (socket says 172.21.15.118:41296) 2023-09-28T04:24:54.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.173+0000 7f5801d9b700 1 -- 172.21.15.118:0/195943659 learned_addr learned my addr 172.21.15.118:0/195943659 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:24:54.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.173+0000 7f580ad9d700 1 --2- 172.21.15.118:0/195943659 >> v2:172.21.15.174:3300/0 conn(0x7f580c0ae320 0x7f580c156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:54.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.173+0000 7f5809d9b700 1 -- 172.21.15.118:0/195943659 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240842239 0 0) 0x7f580c0c8030 con 0x7f580c14fe60 2023-09-28T04:24:54.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.173+0000 7f5809d9b700 1 -- 172.21.15.118:0/195943659 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f8003570 con 0x7f580c14fe60 2023-09-28T04:24:54.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.173+0000 7f580ad9d700 1 -- 172.21.15.118:0/195943659 >> v1:172.21.15.174:6789/0 conn(0x7f580c14fa90 legacy=0x7f580c0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:54.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.173+0000 7f5809d9b700 1 -- 172.21.15.118:0/195943659 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214523874 0 0) 0x7f580c0c7180 con 0x7f580c14fa90 2023-09-28T04:24:54.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.173+0000 7f580ad9d700 1 -- 172.21.15.118:0/195943659 >> v1:172.21.15.118:6789/0 conn(0x7f580c14fe60 legacy=0x7f580c0adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:54.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.173+0000 7f580ad9d700 1 -- 172.21.15.118:0/195943659 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c0c7700 con 0x7f580c0ae320 2023-09-28T04:24:54.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.174+0000 7f580ad9d700 1 --2- 172.21.15.118:0/195943659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f580c0ae320 0x7f580c156430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5804009e60 tx=0x7f5804009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88ebb8c933b49d17 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:54.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.174+0000 7f5809d9b700 1 -- 172.21.15.118:0/195943659 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400e070 con 0x7f580c0ae320 2023-09-28T04:24:54.177 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.174+0000 7f5809d9b700 1 -- 172.21.15.118:0/195943659 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f580400bb60 con 0x7f580c0ae320 2023-09-28T04:24:54.177 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.174+0000 7f5809d9b700 1 -- 172.21.15.118:0/195943659 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400bee0 con 0x7f580c0ae320 2023-09-28T04:24:54.177 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.174+0000 7f5810bff700 1 -- 172.21.15.118:0/195943659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f580c0ae320 msgr2=0x7f580c156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:54.177 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.174+0000 7f5810bff700 1 --2- 172.21.15.118:0/195943659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f580c0ae320 0x7f580c156430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5804009e60 tx=0x7f5804009780 comp rx=0 tx=0).stop 2023-09-28T04:24:54.177 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.175+0000 7f5810bff700 1 -- 172.21.15.118:0/195943659 shutdown_connections 2023-09-28T04:24:54.177 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.175+0000 7f5810bff700 1 --2- 172.21.15.118:0/195943659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f580c0ae320 0x7f580c156430 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:54.177 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.175+0000 7f5810bff700 1 -- 172.21.15.118:0/195943659 >> 172.21.15.118:0/195943659 conn(0x7f580c063cd0 msgr2=0x7f580c0cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:54.178 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.175+0000 7f5810bff700 1 -- 172.21.15.118:0/195943659 shutdown_connections 2023-09-28T04:24:54.178 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.175+0000 7f5810bff700 1 -- 172.21.15.118:0/195943659 wait complete. 2023-09-28T04:24:54.178 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.176+0000 7f5810bff700 1 Processor -- start 2023-09-28T04:24:54.178 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.176+0000 7f5810bff700 1 -- start start 2023-09-28T04:24:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.177+0000 7f5810bff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f580c0ae320 0x7f580c152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.177+0000 7f5810bff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f580c14fa90 0x7f580c0b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.177+0000 7f5810bff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f580c14fe60 0x7f580c148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.177+0000 7f5810bff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c0cbd40 con 0x7f580c0ae320 2023-09-28T04:24:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.177+0000 7f5810bff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c14da20 con 0x7f580c14fe60 2023-09-28T04:24:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.177+0000 7f5810bff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c14a3a0 con 0x7f580c14fa90 2023-09-28T04:24:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.177+0000 7f580a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f580c0ae320 0x7f580c152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:54.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.177+0000 7f580ad9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f580c14fe60 0x7f580c148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.177+0000 7f5801d9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f580c14fa90 0x7f580c0b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.177+0000 7f580a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f580c0ae320 0x7f580c152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51180/0 (socket says 172.21.15.118:51180) 2023-09-28T04:24:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.177+0000 7f580a59c700 1 -- 172.21.15.118:0/26401623 learned_addr learned my addr 172.21.15.118:0/26401623 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.178+0000 7f580ad9d700 1 -- 172.21.15.118:0/26401623 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f580c14fa90 msgr2=0x7f580c0b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.178+0000 7f580ad9d700 1 --2- 172.21.15.118:0/26401623 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f580c14fa90 0x7f580c0b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.178+0000 7f580ad9d700 1 -- 172.21.15.118:0/26401623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f580c0ae320 msgr2=0x7f580c152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:54.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.178+0000 7f580ad9d700 1 --2- 172.21.15.118:0/26401623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f580c0ae320 0x7f580c152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:54.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.178+0000 7f580ad9d700 1 -- 172.21.15.118:0/26401623 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5804009a20 con 0x7f580c14fe60 2023-09-28T04:24:54.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.178+0000 7f580a59c700 1 --2- 172.21.15.118:0/26401623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f580c0ae320 0x7f580c152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:24:54.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.178+0000 7f580ad9d700 1 --2- 172.21.15.118:0/26401623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f580c14fe60 0x7f580c148e30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5804016000 tx=0x7f5804009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:54.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.178+0000 7f5802ffd700 1 -- 172.21.15.118:0/26401623 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804012e10 con 0x7f580c14fe60 2023-09-28T04:24:54.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.178+0000 7f5802ffd700 1 -- 172.21.15.118:0/26401623 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f58040263f0 con 0x7f580c14fe60 2023-09-28T04:24:54.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.178+0000 7f5810bff700 1 -- 172.21.15.118:0/26401623 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580c0cbaa0 con 0x7f580c14fe60 2023-09-28T04:24:54.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.178+0000 7f5802ffd700 1 -- 172.21.15.118:0/26401623 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804026790 con 0x7f580c14fe60 2023-09-28T04:24:54.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.179+0000 7f5810bff700 1 -- 172.21.15.118:0/26401623 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580c1503b0 con 0x7f580c14fe60 2023-09-28T04:24:54.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.180+0000 7f5810bff700 1 -- 172.21.15.118:0/26401623 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580c0c8000 con 0x7f580c14fe60 2023-09-28T04:24:54.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.180+0000 7f5802ffd700 1 -- 172.21.15.118:0/26401623 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f580402e3f0 con 0x7f580c14fe60 2023-09-28T04:24:54.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.181+0000 7f5802ffd700 1 --2- 172.21.15.118:0/26401623 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f57ec067330 0x7f57ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:54.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.181+0000 7f5802ffd700 1 -- 172.21.15.118:0/26401623 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f58040866a0 con 0x7f580c14fe60 2023-09-28T04:24:54.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.181+0000 7f580a59c700 1 --2- 172.21.15.118:0/26401623 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f57ec067330 0x7f57ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:54.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.182+0000 7f580a59c700 1 --2- 172.21.15.118:0/26401623 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f57ec067330 0x7f57ec0697e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0011e0 tx=0x7f57fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:54.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.186+0000 7f5802ffd700 1 -- 172.21.15.118:0/26401623 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5804053540 con 0x7f580c14fe60 2023-09-28T04:24:54.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.424+0000 7f5810bff700 1 -- 172.21.15.118:0/26401623 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f580c071980 con 0x7f580c14fe60 2023-09-28T04:24:54.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.884+0000 7f5802ffd700 1 -- 172.21.15.118:0/26401623 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5804056b60 con 0x7f580c14fe60 2023-09-28T04:24:54.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.887+0000 7f5810bff700 1 -- 172.21.15.118:0/26401623 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f57ec067330 msgr2=0x7f57ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:54.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.887+0000 7f5810bff700 1 --2- 172.21.15.118:0/26401623 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f57ec067330 0x7f57ec0697e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0011e0 tx=0x7f57fc009040 comp rx=0 tx=0).stop 2023-09-28T04:24:54.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.887+0000 7f5810bff700 1 -- 172.21.15.118:0/26401623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f580c14fe60 msgr2=0x7f580c148e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:54.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.887+0000 7f5810bff700 1 --2- 172.21.15.118:0/26401623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f580c14fe60 0x7f580c148e30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5804016000 tx=0x7f5804009780 comp rx=0 tx=0).stop 2023-09-28T04:24:54.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.887+0000 7f5810bff700 1 -- 172.21.15.118:0/26401623 shutdown_connections 2023-09-28T04:24:54.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.887+0000 7f5810bff700 1 --2- 172.21.15.118:0/26401623 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f57ec067330 0x7f57ec0697e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.887+0000 7f5810bff700 1 --2- 172.21.15.118:0/26401623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f580c14fe60 0x7f580c148e30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.887+0000 7f5810bff700 1 --2- 172.21.15.118:0/26401623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f580c0ae320 0x7f580c152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.887+0000 7f5810bff700 1 --2- 172.21.15.118:0/26401623 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f580c14fa90 0x7f580c0b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.887+0000 7f5810bff700 1 -- 172.21.15.118:0/26401623 >> 172.21.15.118:0/26401623 conn(0x7f580c063cd0 msgr2=0x7f580c14dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.887+0000 7f5810bff700 1 -- 172.21.15.118:0/26401623 shutdown_connections 2023-09-28T04:24:54.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:54.887+0000 7f5810bff700 1 -- 172.21.15.118:0/26401623 wait complete. 2023-09-28T04:24:54.890 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-28T04:24:54.891 INFO:tasks.ceph.mds.a.smithi118.stderr: -2593> 2023-09-28T04:23:28.882+0000 7f18cb3f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-28T04:24:54.891 INFO:tasks.ceph.mds.a.smithi118.stderr: -2591> 2023-09-28T04:23:28.882+0000 7f18cb3f1700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-09-28T04:24:54.892 INFO:tasks.ceph.mds.a.smithi118.stderr: -2436> 2023-09-28T04:23:33.882+0000 7f18cb3f1700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-09-28T04:24:54.908 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-28T04:24:54.910 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2023-09-28T04:24:54.931 INFO:tasks.ceph.mds.e.smithi118.stdout:starting mds.e at 2023-09-28T04:24:54.938 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2023-09-28T04:24:55.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.102+0000 7fc2a79ff700 1 Processor -- start 2023-09-28T04:24:55.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.102+0000 7fc2a79ff700 1 -- start start 2023-09-28T04:24:55.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.103+0000 7fc2a79ff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc2a006a740 0x7fc2a014c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:55.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.103+0000 7fc2a79ff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc2a0154be0 0x7fc2a014c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:55.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.103+0000 7fc2a79ff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a0154040 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.103+0000 7fc2a79ff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a00bf540 con 0x7fc2a0154be0 2023-09-28T04:24:55.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.103+0000 7fc2a79ff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a006d6d0 con 0x7fc2a006a740 2023-09-28T04:24:55.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.103+0000 7fc2a5f9c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc2a0154be0 0x7fc2a014c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:55.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.103+0000 7fc2a4f9a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc2a006a740 0x7fc2a014c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:55.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.103+0000 7fc2a579b700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc2a00c0bd0 0x7fc2a01544d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.118:58758/0 (socket says 172.21.15.118:58758) 2023-09-28T04:24:55.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.104+0000 7fc2a579b700 1 -- 172.21.15.118:0/4059753422 learned_addr learned my addr 172.21.15.118:0/4059753422 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:24:55.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.104+0000 7fc2a4f9a700 1 -- 172.21.15.118:0/4059753422 >> v2:172.21.15.118:3300/0 conn(0x7fc2a0154be0 msgr2=0x7fc2a014c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:24:55.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.104+0000 7fc2a4f9a700 1 --2- 172.21.15.118:0/4059753422 >> v2:172.21.15.118:3300/0 conn(0x7fc2a0154be0 0x7fc2a014c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:55.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.104+0000 7fc2a4f9a700 1 -- 172.21.15.118:0/4059753422 >> v1:172.21.15.174:6789/0 conn(0x7fc2a00c0bd0 legacy=0x7fc2a01544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:55.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.104+0000 7fc2a4f9a700 1 -- 172.21.15.118:0/4059753422 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a00c8510 con 0x7fc2a006a740 2023-09-28T04:24:55.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.104+0000 7fc2a5f9c700 1 --2- 172.21.15.118:0/4059753422 >> v2:172.21.15.118:3300/0 conn(0x7fc2a0154be0 0x7fc2a014c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T04:24:55.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.104+0000 7fc297fff700 1 -- 172.21.15.118:0/4059753422 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702827093 0 0) 0x7fc2a0154040 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.104+0000 7fc2a4f9a700 1 --2- 172.21.15.118:0/4059753422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a006a740 0x7fc2a014c000 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00c55e0 tx=0x7fc2900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0724e667f2ce5e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:55.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.104+0000 7fc297fff700 1 -- 172.21.15.118:0/4059753422 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290011630 con 0x7fc2a006a740 2023-09-28T04:24:55.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.104+0000 7fc297fff700 1 -- 172.21.15.118:0/4059753422 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc290011790 con 0x7fc2a006a740 2023-09-28T04:24:55.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.104+0000 7fc297fff700 1 -- 172.21.15.118:0/4059753422 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290011b50 con 0x7fc2a006a740 2023-09-28T04:24:55.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.105+0000 7fc2a79ff700 1 -- 172.21.15.118:0/4059753422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a006a740 msgr2=0x7fc2a014c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:55.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.105+0000 7fc2a79ff700 1 --2- 172.21.15.118:0/4059753422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a006a740 0x7fc2a014c000 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00c55e0 tx=0x7fc2900091a0 comp rx=0 tx=0).stop 2023-09-28T04:24:55.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.105+0000 7fc2a79ff700 1 -- 172.21.15.118:0/4059753422 shutdown_connections 2023-09-28T04:24:55.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.105+0000 7fc2a79ff700 1 --2- 172.21.15.118:0/4059753422 >> v2:172.21.15.118:3300/0 conn(0x7fc2a0154be0 0x7fc2a014c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:55.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.105+0000 7fc2a79ff700 1 --2- 172.21.15.118:0/4059753422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a006a740 0x7fc2a014c000 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:55.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.105+0000 7fc2a79ff700 1 -- 172.21.15.118:0/4059753422 >> 172.21.15.118:0/4059753422 conn(0x7fc2a00680b0 msgr2=0x7fc2a00c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:55.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.105+0000 7fc2a79ff700 1 -- 172.21.15.118:0/4059753422 shutdown_connections 2023-09-28T04:24:55.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.105+0000 7fc2a79ff700 1 -- 172.21.15.118:0/4059753422 wait complete. 2023-09-28T04:24:55.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.107+0000 7fc2a79ff700 1 Processor -- start 2023-09-28T04:24:55.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.107+0000 7fc2a79ff700 1 -- start start 2023-09-28T04:24:55.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.107+0000 7fc2a79ff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a006a740 0x7fc2a0166770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:55.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a79ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2a00c0bd0 0x7fc2a015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:55.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a79ff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2a0154be0 0x7fc2a015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:55.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a79ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a015bad0 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a79ff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00c3fa0 con 0x7fc2a006a740 2023-09-28T04:24:55.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a79ff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00c2760 con 0x7fc2a0154be0 2023-09-28T04:24:55.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a4f9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2a00c0bd0 0x7fc2a015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:55.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a4f9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2a00c0bd0 0x7fc2a015c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51254/0 (socket says 172.21.15.118:51254) 2023-09-28T04:24:55.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a4f9a700 1 -- 172.21.15.118:0/2948524128 learned_addr learned my addr 172.21.15.118:0/2948524128 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:55.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a579b700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a006a740 0x7fc2a0166770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:55.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a5f9c700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2a0154be0 0x7fc2a015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:55.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a4f9a700 1 -- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2a0154be0 msgr2=0x7fc2a015a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:55.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a4f9a700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2a0154be0 0x7fc2a015a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:55.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a4f9a700 1 -- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a006a740 msgr2=0x7fc2a0166770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:55.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a4f9a700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a006a740 0x7fc2a0166770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:55.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.108+0000 7fc2a4f9a700 1 -- 172.21.15.118:0/2948524128 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc298009a20 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.109+0000 7fc2a4f9a700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2a00c0bd0 0x7fc2a015c9d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc290013000 tx=0x7fc2900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:55.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.109+0000 7fc2957fa700 1 -- 172.21.15.118:0/2948524128 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290011900 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.109+0000 7fc2957fa700 1 -- 172.21.15.118:0/2948524128 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc290011a60 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.109+0000 7fc2a79ff700 1 -- 172.21.15.118:0/2948524128 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc290009420 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.109+0000 7fc2957fa700 1 -- 172.21.15.118:0/2948524128 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2900266a0 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.109+0000 7fc2a79ff700 1 -- 172.21.15.118:0/2948524128 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a015bd20 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.110+0000 7fc2a79ff700 1 -- 172.21.15.118:0/2948524128 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a00c7b70 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.114 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.111+0000 7fc2957fa700 1 -- 172.21.15.118:0/2948524128 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc290023030 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.114 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.112+0000 7fc2957fa700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc284067330 0x7fc2840697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:55.115 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.112+0000 7fc2957fa700 1 -- 172.21.15.118:0/2948524128 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6374+0+0 (secure 0 0 0) 0x7fc290086480 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.115 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.112+0000 7fc2a579b700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc284067330 0x7fc2840697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:55.115 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.113+0000 7fc2a579b700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc284067330 0x7fc2840697e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc29c007fd0 tx=0x7fc29c007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:55.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.116+0000 7fc2957fa700 1 -- 172.21.15.118:0/2948524128 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc2900532e0 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.348+0000 7fc2a79ff700 1 -- 172.21.15.118:0/2948524128 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc2a01524c0 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.885+0000 7fc2957fa700 1 -- 172.21.15.118:0/2948524128 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc290056900 con 0x7fc2a00c0bd0 2023-09-28T04:24:55.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.888+0000 7fc2a79ff700 1 -- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc284067330 msgr2=0x7fc2840697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:55.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.888+0000 7fc2a79ff700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc284067330 0x7fc2840697e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc29c007fd0 tx=0x7fc29c007d30 comp rx=0 tx=0).stop 2023-09-28T04:24:55.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.888+0000 7fc2a79ff700 1 -- 172.21.15.118:0/2948524128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2a00c0bd0 msgr2=0x7fc2a015c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:55.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.889+0000 7fc2a79ff700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2a00c0bd0 0x7fc2a015c9d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc290013000 tx=0x7fc2900091a0 comp rx=0 tx=0).stop 2023-09-28T04:24:55.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.889+0000 7fc2a79ff700 1 -- 172.21.15.118:0/2948524128 shutdown_connections 2023-09-28T04:24:55.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.889+0000 7fc2a79ff700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fc284067330 0x7fc2840697e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:55.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.889+0000 7fc2a79ff700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2a0154be0 0x7fc2a015a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:55.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.889+0000 7fc2a79ff700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a006a740 0x7fc2a0166770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.889+0000 7fc2a79ff700 1 --2- 172.21.15.118:0/2948524128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2a00c0bd0 0x7fc2a015c9d0 secure :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc290013000 tx=0x7fc2900091a0 comp rx=0 tx=0).stop 2023-09-28T04:24:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.889+0000 7fc2a79ff700 1 -- 172.21.15.118:0/2948524128 >> 172.21.15.118:0/2948524128 conn(0x7fc2a00680b0 msgr2=0x7fc2a00c45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.890+0000 7fc2a79ff700 1 -- 172.21.15.118:0/2948524128 shutdown_connections 2023-09-28T04:24:55.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:55.890+0000 7fc2a79ff700 1 -- 172.21.15.118:0/2948524128 wait complete. 2023-09-28T04:24:55.910 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-28T04:24:56.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.144+0000 7f5363dff700 1 Processor -- start 2023-09-28T04:24:56.145 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.144+0000 7f5363dff700 1 -- start start 2023-09-28T04:24:56.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.145+0000 7f5363dff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f535c14d8a0 0x7f535c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:56.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.145+0000 7f5363dff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535c1538d0 con 0x7f535c0c1190 2023-09-28T04:24:56.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.145+0000 7f5363dff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535c154470 con 0x7f535c0c2510 2023-09-28T04:24:56.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.145+0000 7f5363dff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535c157aa0 con 0x7f535c14d8a0 2023-09-28T04:24:56.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.146+0000 7f536239c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f535c0c1190 0x7f535c15df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:41320/0 (socket says 172.21.15.118:41320) 2023-09-28T04:24:56.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.146+0000 7f536239c700 1 -- 172.21.15.118:0/267495690 learned_addr learned my addr 172.21.15.118:0/267495690 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-09-28T04:24:56.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.146+0000 7f5361b9b700 1 --2- 172.21.15.118:0/267495690 >> v2:172.21.15.174:3300/0 conn(0x7f535c14d8a0 0x7f535c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:56.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.146+0000 7f5360b99700 1 -- 172.21.15.118:0/267495690 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527270356 0 0) 0x7f535c1538d0 con 0x7f535c0c1190 2023-09-28T04:24:56.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.146+0000 7f5360b99700 1 -- 172.21.15.118:0/267495690 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5348003570 con 0x7f535c0c1190 2023-09-28T04:24:56.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.146+0000 7f5360b99700 1 -- 172.21.15.118:0/267495690 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958361302 0 0) 0x7f535c154470 con 0x7f535c0c2510 2023-09-28T04:24:56.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.146+0000 7f5360b99700 1 -- 172.21.15.118:0/267495690 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f535c1538d0 con 0x7f535c0c2510 2023-09-28T04:24:56.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.146+0000 7f5361b9b700 1 -- 172.21.15.118:0/267495690 >> v1:172.21.15.174:6789/0 conn(0x7f535c0c2510 legacy=0x7f535c153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:56.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.146+0000 7f5361b9b700 1 -- 172.21.15.118:0/267495690 >> v1:172.21.15.118:6789/0 conn(0x7f535c0c1190 legacy=0x7f535c15df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:56.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.146+0000 7f5361b9b700 1 -- 172.21.15.118:0/267495690 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c1535a0 con 0x7f535c14d8a0 2023-09-28T04:24:56.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.147+0000 7f5361b9b700 1 --2- 172.21.15.118:0/267495690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c14d8a0 0x7f535c157560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f53580098e0 tx=0x7f53580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de469c02e242165b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:56.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.147+0000 7f5360b99700 1 -- 172.21.15.118:0/267495690 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358011630 con 0x7f535c14d8a0 2023-09-28T04:24:56.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.147+0000 7f5360b99700 1 -- 172.21.15.118:0/267495690 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5358011790 con 0x7f535c14d8a0 2023-09-28T04:24:56.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.147+0000 7f5360b99700 1 -- 172.21.15.118:0/267495690 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358011b50 con 0x7f535c14d8a0 2023-09-28T04:24:56.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.147+0000 7f5363dff700 1 -- 172.21.15.118:0/267495690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c14d8a0 msgr2=0x7f535c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:56.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.147+0000 7f5363dff700 1 --2- 172.21.15.118:0/267495690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c14d8a0 0x7f535c157560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f53580098e0 tx=0x7f53580091a0 comp rx=0 tx=0).stop 2023-09-28T04:24:56.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.147+0000 7f5363dff700 1 -- 172.21.15.118:0/267495690 shutdown_connections 2023-09-28T04:24:56.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.147+0000 7f5363dff700 1 --2- 172.21.15.118:0/267495690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c14d8a0 0x7f535c157560 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:56.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.147+0000 7f5363dff700 1 -- 172.21.15.118:0/267495690 >> 172.21.15.118:0/267495690 conn(0x7f535c0c7ba0 msgr2=0x7f535c0c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:56.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.147+0000 7f5363dff700 1 -- 172.21.15.118:0/267495690 shutdown_connections 2023-09-28T04:24:56.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.147+0000 7f5363dff700 1 -- 172.21.15.118:0/267495690 wait complete. 2023-09-28T04:24:56.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.149+0000 7f5363dff700 1 Processor -- start 2023-09-28T04:24:56.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.149+0000 7f5363dff700 1 -- start start 2023-09-28T04:24:56.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5363dff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f535c0c1190 0x7f535c155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:56.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5363dff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c0c2510 0x7f535c154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:56.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5363dff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c14d8a0 0x7f535c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:56.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5363dff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c166b50 con 0x7f535c0c1190 2023-09-28T04:24:56.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5363dff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c154800 con 0x7f535c14d8a0 2023-09-28T04:24:56.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5363dff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c14d0c0 con 0x7f535c0c2510 2023-09-28T04:24:56.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5361b9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f535c0c1190 0x7f535c155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:56.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5361b9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f535c0c1190 0x7f535c155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51264/0 (socket says 172.21.15.118:51264) 2023-09-28T04:24:56.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5361b9b700 1 -- 172.21.15.118:0/2684797197 learned_addr learned my addr 172.21.15.118:0/2684797197 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:56.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f536239c700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c14d8a0 0x7f535c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:56.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f536139a700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c0c2510 0x7f535c154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:56.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5361b9b700 1 -- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c0c2510 msgr2=0x7f535c154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:56.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5361b9b700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c0c2510 0x7f535c154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:56.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5361b9b700 1 -- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c14d8a0 msgr2=0x7f535c1551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:56.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5361b9b700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c14d8a0 0x7f535c1551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:56.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.150+0000 7f5361b9b700 1 -- 172.21.15.118:0/2684797197 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5358009420 con 0x7f535c0c1190 2023-09-28T04:24:56.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.151+0000 7f5361b9b700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f535c0c1190 0x7f535c155f00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f535c06ced0 tx=0x7f53580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:56.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.151+0000 7f5351ffb700 1 -- 172.21.15.118:0/2684797197 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535801f070 con 0x7f535c0c1190 2023-09-28T04:24:56.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.151+0000 7f5351ffb700 1 -- 172.21.15.118:0/2684797197 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5358000bc0 con 0x7f535c0c1190 2023-09-28T04:24:56.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.151+0000 7f5363dff700 1 -- 172.21.15.118:0/2684797197 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535c166da0 con 0x7f535c0c1190 2023-09-28T04:24:56.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.151+0000 7f5351ffb700 1 -- 172.21.15.118:0/2684797197 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358025420 con 0x7f535c0c1190 2023-09-28T04:24:56.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.151+0000 7f5363dff700 1 -- 172.21.15.118:0/2684797197 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535c167360 con 0x7f535c0c1190 2023-09-28T04:24:56.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.152+0000 7f5363dff700 1 -- 172.21.15.118:0/2684797197 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535c071980 con 0x7f535c0c1190 2023-09-28T04:24:56.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.153+0000 7f5351ffb700 1 -- 172.21.15.118:0/2684797197 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5358023070 con 0x7f535c0c1190 2023-09-28T04:24:56.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.154+0000 7f5351ffb700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f5340067330 0x7f53400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:56.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.154+0000 7f5351ffb700 1 -- 172.21.15.118:0/2684797197 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6374+0+0 (secure 0 0 0) 0x7f5358085ff0 con 0x7f535c0c1190 2023-09-28T04:24:56.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.154+0000 7f536139a700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f5340067330 0x7f53400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:56.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.155+0000 7f536139a700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f5340067330 0x7f53400697e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f535c14cec0 tx=0x7f534c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:56.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.159+0000 7f5351ffb700 1 -- 172.21.15.118:0/2684797197 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5358052d90 con 0x7f535c0c1190 2023-09-28T04:24:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.350+0000 7f5363dff700 1 -- 172.21.15.118:0/2684797197 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f535c154ae0 con 0x7f535c0c1190 2023-09-28T04:24:56.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.895+0000 7f5351ffb700 1 -- 172.21.15.118:0/2684797197 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f535802a020 con 0x7f535c0c1190 2023-09-28T04:24:56.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.898+0000 7f5363dff700 1 -- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f5340067330 msgr2=0x7f53400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:56.900 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.898+0000 7f5363dff700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f5340067330 0x7f53400697e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f535c14cec0 tx=0x7f534c009040 comp rx=0 tx=0).stop 2023-09-28T04:24:56.900 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.899+0000 7f5363dff700 1 -- 172.21.15.118:0/2684797197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f535c0c1190 msgr2=0x7f535c155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:56.900 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.899+0000 7f5363dff700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f535c0c1190 0x7f535c155f00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f535c06ced0 tx=0x7f53580091a0 comp rx=0 tx=0).stop 2023-09-28T04:24:56.900 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.899+0000 7f5363dff700 1 -- 172.21.15.118:0/2684797197 shutdown_connections 2023-09-28T04:24:56.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.899+0000 7f5363dff700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7f5340067330 0x7f53400697e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:56.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.899+0000 7f5363dff700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f535c14d8a0 0x7f535c1551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:56.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.899+0000 7f5363dff700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f535c0c1190 0x7f535c155f00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:56.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.899+0000 7f5363dff700 1 --2- 172.21.15.118:0/2684797197 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f535c0c2510 0x7f535c154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:56.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.899+0000 7f5363dff700 1 -- 172.21.15.118:0/2684797197 >> 172.21.15.118:0/2684797197 conn(0x7f535c0c7ba0 msgr2=0x7f535c0c45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:56.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.899+0000 7f5363dff700 1 -- 172.21.15.118:0/2684797197 shutdown_connections 2023-09-28T04:24:56.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:56.899+0000 7f5363dff700 1 -- 172.21.15.118:0/2684797197 wait complete. 2023-09-28T04:24:56.903 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2023-09-28T04:24:56.920 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-28T04:24:57.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.120+0000 7fe0adfff700 1 Processor -- start 2023-09-28T04:24:57.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.120+0000 7fe0adfff700 1 -- start start 2023-09-28T04:24:57.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.122+0000 7fe0adfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe0a80af8b0 0x7fe0a81564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:57.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.122+0000 7fe0adfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe0a80c4700 0x7fe0a81572a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:57.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.122+0000 7fe0adfff700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a8068660 con 0x7fe0a80af4e0 2023-09-28T04:24:57.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.122+0000 7fe0adfff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a80697f0 con 0x7fe0a80af8b0 2023-09-28T04:24:57.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.122+0000 7fe0adfff700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a8068900 con 0x7fe0a80c4700 2023-09-28T04:24:57.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.122+0000 7fe0a6ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe0a80af8b0 0x7fe0a81564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:57.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.122+0000 7fe0a6ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe0a80af8b0 0x7fe0a81564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51274/0 (socket says 172.21.15.118:51274) 2023-09-28T04:24:57.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.122+0000 7fe0a6ffd700 1 -- 172.21.15.118:0/1424138779 learned_addr learned my addr 172.21.15.118:0/1424138779 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:57.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.122+0000 7fe0a7fff700 1 --2- 172.21.15.118:0/1424138779 >> v2:172.21.15.174:3300/0 conn(0x7fe0a80c4700 0x7fe0a81572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:57.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.123+0000 7fe0a6ffd700 1 -- 172.21.15.118:0/1424138779 >> v2:172.21.15.174:3300/0 conn(0x7fe0a80c4700 msgr2=0x7fe0a81572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T04:24:57.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.123+0000 7fe0a6ffd700 1 --2- 172.21.15.118:0/1424138779 >> v2:172.21.15.174:3300/0 conn(0x7fe0a80c4700 0x7fe0a81572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:57.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.123+0000 7fe0a6ffd700 1 -- 172.21.15.118:0/1424138779 >> v1:172.21.15.174:6789/0 conn(0x7fe0a80af4e0 legacy=0x7fe0a80c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:57.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.123+0000 7fe0a67fc700 1 -- 172.21.15.118:0/1424138779 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348265419 0 0) 0x7fe0a8068660 con 0x7fe0a80af4e0 2023-09-28T04:24:57.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.123+0000 7fe0a6ffd700 1 -- 172.21.15.118:0/1424138779 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a8068be0 con 0x7fe0a80af8b0 2023-09-28T04:24:57.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.123+0000 7fe0a6ffd700 1 --2- 172.21.15.118:0/1424138779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a80af8b0 0x7fe0a81564c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe0a806fcf0 tx=0x7fe09c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea8a12a67391ff3 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:57.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.123+0000 7fe0a67fc700 1 -- 172.21.15.118:0/1424138779 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c009e70 con 0x7fe0a80af8b0 2023-09-28T04:24:57.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.123+0000 7fe0a67fc700 1 -- 172.21.15.118:0/1424138779 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe09c00b8f0 con 0x7fe0a80af8b0 2023-09-28T04:24:57.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.123+0000 7fe0a67fc700 1 -- 172.21.15.118:0/1424138779 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c00bcb0 con 0x7fe0a80af8b0 2023-09-28T04:24:57.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.124+0000 7fe0adfff700 1 -- 172.21.15.118:0/1424138779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a80af8b0 msgr2=0x7fe0a81564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:57.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.124+0000 7fe0adfff700 1 --2- 172.21.15.118:0/1424138779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a80af8b0 0x7fe0a81564c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe0a806fcf0 tx=0x7fe09c009250 comp rx=0 tx=0).stop 2023-09-28T04:24:57.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.124+0000 7fe0adfff700 1 -- 172.21.15.118:0/1424138779 shutdown_connections 2023-09-28T04:24:57.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.124+0000 7fe0adfff700 1 --2- 172.21.15.118:0/1424138779 >> v2:172.21.15.174:3300/0 conn(0x7fe0a80c4700 0x7fe0a81572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:57.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.124+0000 7fe0adfff700 1 --2- 172.21.15.118:0/1424138779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a80af8b0 0x7fe0a81564c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:57.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.124+0000 7fe0adfff700 1 -- 172.21.15.118:0/1424138779 >> 172.21.15.118:0/1424138779 conn(0x7fe0a8063230 msgr2=0x7fe0a8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:57.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.124+0000 7fe0adfff700 1 -- 172.21.15.118:0/1424138779 shutdown_connections 2023-09-28T04:24:57.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.124+0000 7fe0adfff700 1 -- 172.21.15.118:0/1424138779 wait complete. 2023-09-28T04:24:57.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.125+0000 7fe0adfff700 1 Processor -- start 2023-09-28T04:24:57.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.125+0000 7fe0adfff700 1 -- start start 2023-09-28T04:24:57.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.126+0000 7fe0adfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a80af4e0 0x7fe0a8166800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:57.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.126+0000 7fe0adfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a80af8b0 0x7fe0a8150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:57.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.126+0000 7fe0adfff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0a80c4700 0x7fe0a81519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:57.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.126+0000 7fe0adfff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a81532f0 con 0x7fe0a80af8b0 2023-09-28T04:24:57.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.126+0000 7fe0adfff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80ac8e0 con 0x7fe0a80c4700 2023-09-28T04:24:57.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.126+0000 7fe0adfff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8151530 con 0x7fe0a80af4e0 2023-09-28T04:24:57.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe0a6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a80af8b0 0x7fe0a8150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:57.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe0a6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a80af8b0 0x7fe0a8150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:51278/0 (socket says 172.21.15.118:51278) 2023-09-28T04:24:57.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe0a6ffd700 1 -- 172.21.15.118:0/2959794484 learned_addr learned my addr 172.21.15.118:0/2959794484 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-09-28T04:24:57.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe0a77fe700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a80af4e0 0x7fe0a8166800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:57.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe0a7fff700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0a80c4700 0x7fe0a81519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:57.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe0a6ffd700 1 -- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a80af4e0 msgr2=0x7fe0a8166800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:57.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe0a6ffd700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a80af4e0 0x7fe0a8166800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:57.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe0a6ffd700 1 -- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0a80c4700 msgr2=0x7fe0a81519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:57.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe0a6ffd700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0a80c4700 0x7fe0a81519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:57.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe0a6ffd700 1 -- 172.21.15.118:0/2959794484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0094f0 con 0x7fe0a80af8b0 2023-09-28T04:24:57.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe0a6ffd700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a80af8b0 0x7fe0a8150560 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80c0d70 tx=0x7fe09c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:57.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe08f7fe700 1 -- 172.21.15.118:0/2959794484 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c00bc70 con 0x7fe0a80af8b0 2023-09-28T04:24:57.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe08f7fe700 1 -- 172.21.15.118:0/2959794484 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe09c01a450 con 0x7fe0a80af8b0 2023-09-28T04:24:57.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe08f7fe700 1 -- 172.21.15.118:0/2959794484 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c01a810 con 0x7fe0a80af8b0 2023-09-28T04:24:57.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.127+0000 7fe0adfff700 1 -- 172.21.15.118:0/2959794484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a80ac320 con 0x7fe0a80af8b0 2023-09-28T04:24:57.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.128+0000 7fe0adfff700 1 -- 172.21.15.118:0/2959794484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a8150ee0 con 0x7fe0a80af8b0 2023-09-28T04:24:57.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.129+0000 7fe0adfff700 1 -- 172.21.15.118:0/2959794484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a80713e0 con 0x7fe0a80af8b0 2023-09-28T04:24:57.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.129+0000 7fe08f7fe700 1 -- 172.21.15.118:0/2959794484 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 6) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe09c01ab80 con 0x7fe0a80af8b0 2023-09-28T04:24:57.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.130+0000 7fe08f7fe700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fe094067330 0x7fe0940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T04:24:57.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.130+0000 7fe08f7fe700 1 -- 172.21.15.118:0/2959794484 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5936+0+0 (secure 0 0 0) 0x7fe09c086060 con 0x7fe0a80af8b0 2023-09-28T04:24:57.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.131+0000 7fe0a77fe700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fe094067330 0x7fe0940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T04:24:57.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.131+0000 7fe0a77fe700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fe094067330 0x7fe0940697e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe098003960 tx=0x7fe098007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T04:24:57.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.134+0000 7fe08f7fe700 1 -- 172.21.15.118:0/2959794484 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe09c052fe0 con 0x7fe0a80af8b0 2023-09-28T04:24:57.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.323+0000 7fe0adfff700 1 -- 172.21.15.118:0/2959794484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0a8071980 con 0x7fe0a80af8b0 2023-09-28T04:24:57.898 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.898+0000 7fe08f7fe700 1 -- 172.21.15.118:0/2959794484 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe09c0150d0 con 0x7fe0a80af8b0 2023-09-28T04:24:57.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.902+0000 7fe0adfff700 1 -- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fe094067330 msgr2=0x7fe0940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:57.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.902+0000 7fe0adfff700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fe094067330 0x7fe0940697e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe098003960 tx=0x7fe098007ea0 comp rx=0 tx=0).stop 2023-09-28T04:24:57.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.902+0000 7fe0adfff700 1 -- 172.21.15.118:0/2959794484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a80af8b0 msgr2=0x7fe0a8150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T04:24:57.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.902+0000 7fe0adfff700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a80af8b0 0x7fe0a8150560 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80c0d70 tx=0x7fe09c009250 comp rx=0 tx=0).stop 2023-09-28T04:24:57.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.902+0000 7fe0adfff700 1 -- 172.21.15.118:0/2959794484 shutdown_connections 2023-09-28T04:24:57.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.902+0000 7fe0adfff700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:6832/119178,v1:172.21.15.174:6833/119178] conn(0x7fe094067330 0x7fe0940697e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:57.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.902+0000 7fe0adfff700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0a80c4700 0x7fe0a81519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:57.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.902+0000 7fe0adfff700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe0a80af4e0 0x7fe0a8166800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:57.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.902+0000 7fe0adfff700 1 --2- 172.21.15.118:0/2959794484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0a80af8b0 0x7fe0a8150560 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T04:24:57.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.902+0000 7fe0adfff700 1 -- 172.21.15.118:0/2959794484 >> 172.21.15.118:0/2959794484 conn(0x7fe0a8063230 msgr2=0x7fe0a80c65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T04:24:57.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.902+0000 7fe0adfff700 1 -- 172.21.15.118:0/2959794484 shutdown_connections 2023-09-28T04:24:57.904 INFO:teuthology.orchestra.run.smithi118.stderr:2023-09-28T04:24:57.902+0000 7fe0adfff700 1 -- 172.21.15.118:0/2959794484 wait complete. 2023-09-28T04:24:57.905 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2023-09-28T04:24:57.923 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-28T04:24:57.923 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-28T04:24:57.923 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:57.936 INFO:tasks.ceph.mds.a:Stopped 2023-09-28T04:24:57.937 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-28T04:24:57.937 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:57.989 INFO:tasks.ceph.mds.c:Stopped 2023-09-28T04:24:57.989 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-09-28T04:24:57.989 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.042 INFO:tasks.ceph.mds.e:Stopped 2023-09-28T04:24:58.043 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-28T04:24:58.043 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.053 INFO:tasks.ceph.mds.b:Stopped 2023-09-28T04:24:58.053 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-28T04:24:58.053 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.104 INFO:tasks.ceph.mds.d:Stopped 2023-09-28T04:24:58.104 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-09-28T04:24:58.104 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.154 INFO:tasks.ceph.mds.f:Stopped 2023-09-28T04:24:58.155 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-28T04:24:58.155 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-28T04:24:58.155 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.196 INFO:tasks.ceph.osd.0:Stopped 2023-09-28T04:24:58.197 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-28T04:24:58.197 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.240 INFO:tasks.ceph.osd.1:Stopped 2023-09-28T04:24:58.241 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-28T04:24:58.241 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.273 INFO:tasks.ceph.osd.2:Stopped 2023-09-28T04:24:58.274 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-28T04:24:58.274 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.355 INFO:tasks.ceph.osd.3:Stopped 2023-09-28T04:24:58.355 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-09-28T04:24:58.355 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.385 INFO:tasks.ceph.osd.4:Stopped 2023-09-28T04:24:58.385 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-09-28T04:24:58.385 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.454 INFO:tasks.ceph.osd.5:Stopped 2023-09-28T04:24:58.454 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-09-28T04:24:58.454 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.520 INFO:tasks.ceph.osd.6:Stopped 2023-09-28T04:24:58.520 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-09-28T04:24:58.520 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.592 INFO:tasks.ceph.osd.7:Stopped 2023-09-28T04:24:58.592 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-28T04:24:58.593 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-09-28T04:24:58.593 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.647 INFO:tasks.ceph.mgr.y:Stopped 2023-09-28T04:24:58.647 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-28T04:24:58.647 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.674 INFO:tasks.ceph.mgr.x:Stopped 2023-09-28T04:24:58.674 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-28T04:24:58.674 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-28T04:24:58.674 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.692 INFO:tasks.ceph.mon.a:Stopped 2023-09-28T04:24:58.693 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-28T04:24:58.693 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.725 INFO:tasks.ceph.mon.b:Stopped 2023-09-28T04:24:58.726 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-28T04:24:58.726 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T04:24:58.777 INFO:tasks.ceph.mon.c:Stopped 2023-09-28T04:24:58.777 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-28T04:24:58.778 DEBUG:teuthology.orchestra.run.smithi118:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-09-28T04:24:58.873 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T04:24:58.873 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-28T04:24:59.242 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T04:24:59.243 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-28T04:24:59.420 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T04:24:59.420 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-28T04:24:59.621 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T04:24:59.621 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-28T04:24:59.814 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi174.front.sepia.ceph.com 2023-09-28T04:24:59.815 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-09-28T04:25:00.070 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi174.front.sepia.ceph.com 2023-09-28T04:25:00.070 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-09-28T04:25:00.145 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi174.front.sepia.ceph.com 2023-09-28T04:25:00.145 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-09-28T04:25:00.256 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi174.front.sepia.ceph.com 2023-09-28T04:25:00.256 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-09-28T04:25:00.323 INFO:tasks.ceph:Archiving mon data... 2023-09-28T04:25:00.325 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611/data/mon.a.tgz 2023-09-28T04:25:00.325 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-09-28T04:25:00.373 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.TDxo3KQtg2 2023-09-28T04:25:00.374 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.TDxo3KQtg2 2023-09-28T04:25:00.506 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.TDxo3KQtg2 2023-09-28T04:25:00.623 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.TDxo3KQtg2 is 270KB 2023-09-28T04:25:00.721 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.TDxo3KQtg2 2023-09-28T04:25:00.766 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611/data/mon.b.tgz 2023-09-28T04:25:00.767 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2023-09-28T04:25:00.789 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.Su4N1Wiip0 2023-09-28T04:25:00.789 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Su4N1Wiip0 2023-09-28T04:25:00.934 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.Su4N1Wiip0 2023-09-28T04:25:01.023 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.Su4N1Wiip0 is 364KB 2023-09-28T04:25:01.118 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.Su4N1Wiip0 2023-09-28T04:25:01.136 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611/data/mon.c.tgz 2023-09-28T04:25:01.136 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2023-09-28T04:25:01.193 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.rF8uNxBahR 2023-09-28T04:25:01.194 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.rF8uNxBahR 2023-09-28T04:25:01.325 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.rF8uNxBahR 2023-09-28T04:25:01.412 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.rF8uNxBahR is 364KB 2023-09-28T04:25:01.507 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.rF8uNxBahR 2023-09-28T04:25:01.525 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-28T04:25:01.525 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-28T04:25:01.530 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-28T04:25:01.596 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-28T04:25:01.597 DEBUG:teuthology.orchestra.run.smithi118:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-28T04:25:01.601 DEBUG:teuthology.orchestra.run.smithi174:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-28T04:25:01.659 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-28T04:25:01.682 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-28T04:25:01.697 INFO:tasks.ceph:Archiving crash dumps... 2023-09-28T04:25:01.699 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611/remote/smithi118/crash 2023-09-28T04:25:01.700 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-28T04:25:01.767 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611/remote/smithi174/crash 2023-09-28T04:25:01.768 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-28T04:25:01.795 INFO:tasks.ceph:Shutting down logrotate 2023-09-28T04:25:01.796 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T04:25:01.801 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T04:25:01.900 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-28T04:25:01.970 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-28T04:25:01.997 INFO:tasks.ceph:Compressing logs... 2023-09-28T04:25:01.998 DEBUG:teuthology.orchestra.run.smithi118:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T04:25:02.002 DEBUG:teuthology.orchestra.run.smithi174:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T04:25:04.818 INFO:tasks.ceph:Archiving logs... 2023-09-28T04:25:04.819 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611/remote/smithi118/log 2023-09-28T04:25:04.820 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-28T04:25:05.240 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611/remote/smithi174/log 2023-09-28T04:25:05.241 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-28T04:25:05.537 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-28T04:25:05.545 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-28T04:25:05.545 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-28T04:25:05.550 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-28T04:25:05.667 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-28T04:25:05.675 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-28T04:25:05.675 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T04:25:05.680 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T04:25:05.697 INFO:teuthology.orchestra.run.smithi174.stderr:bash: ntpq: command not found 2023-09-28T04:25:05.702 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T04:25:05.702 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2023-09-28T04:25:05.702 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 7 -550us[ -552us] +/- 80ms 2023-09-28T04:25:05.702 INFO:teuthology.orchestra.run.smithi174.stdout:^* hv02.front.sepia.ceph.com 3 6 377 6 -750us[ -752us] +/- 62ms 2023-09-28T04:25:05.702 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +1305us[+1303us] +/- 68ms 2023-09-28T04:25:05.702 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T04:25:05.719 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-09-28T04:25:05.727 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T04:25:05.728 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-09-28T04:25:05.728 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 7 -546us[ -546us] +/- 80ms 2023-09-28T04:25:05.728 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv02.front.sepia.ceph.com 3 6 377 7 -750us[ -746us] +/- 62ms 2023-09-28T04:25:05.728 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +1308us[+1308us] +/- 68ms 2023-09-28T04:25:05.728 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T04:25:05.729 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-28T04:25:05.738 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-28T04:25:05.738 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-28T04:25:05.747 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-28T04:25:05.932 DEBUG:teuthology.orchestra.run.smithi174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-28T04:25:06.022 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T04:25:06.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T04:25:06.098 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T04:25:06.129 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T04:25:06.130 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-28T04:25:06.139 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-28T04:25:06.147 INFO:teuthology.task.internal:Duration was 955.069394 seconds 2023-09-28T04:25:06.148 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-28T04:25:06.156 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-28T04:25:06.156 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-28T04:25:06.161 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-28T04:25:06.217 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T04:25:06.273 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T04:25:06.739 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-28T04:25:06.739 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2023-09-28T04:25:06.740 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-28T04:25:06.801 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2023-09-28T04:25:06.801 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-28T04:25:06.826 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-28T04:25:06.827 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T04:25:06.831 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T04:25:06.910 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-28T04:25:06.911 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-28T04:25:06.915 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-28T04:25:07.028 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-28T04:25:07.038 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-28T04:25:07.039 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-28T04:25:07.109 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-28T04:25:07.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-28T04:25:07.146 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-28T04:25:07.151 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-28T04:25:07.202 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2023-09-28T04:25:07.214 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2023-09-28T04:25:07.267 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-28T04:25:07.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T04:25:07.312 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-28T04:25:07.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T04:25:07.329 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-28T04:25:07.339 INFO:teuthology.task.internal:Transferring archived files... 2023-09-28T04:25:07.340 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611/remote/smithi118 2023-09-28T04:25:07.340 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-28T04:25:07.431 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611/remote/smithi174 2023-09-28T04:25:07.432 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-28T04:25:07.469 INFO:teuthology.task.internal:Removing archive directory... 2023-09-28T04:25:07.470 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-28T04:25:07.475 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-28T04:25:07.522 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-28T04:25:07.533 INFO:teuthology.task.internal:Not uploading archives. 2023-09-28T04:25:07.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-28T04:25:07.543 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-28T04:25:07.543 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-28T04:25:07.560 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-28T04:25:07.579 INFO:teuthology.orchestra.run.smithi174.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 28 04:25 /home/ubuntu/cephtest 2023-09-28T04:25:07.601 INFO:teuthology.orchestra.run.smithi118.stdout: 524293 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 28 04:25 /home/ubuntu/cephtest 2023-09-28T04:25:07.602 INFO:teuthology.orchestra.run.smithi118.stdout: 656718 4 d--------- 2 ubuntu ubuntu 4096 Sep 28 04:23 /home/ubuntu/cephtest/mnt.0 2023-09-28T04:25:07.602 INFO:teuthology.orchestra.run.smithi118.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2023-09-28T04:25:07.604 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-28T04:25:07.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T04:25:07.605 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi118 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-28T04:25:07.614 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-28T04:25:07.624 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-28T04:25:07.634 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi118 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-28T04:25:07.635 INFO:teuthology.nuke:Checking targets against current locks 2023-09-28T04:25:07.662 DEBUG:teuthology.nuke:shortname: smithi118 2023-09-28T04:25:07.663 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T04:25:07.687 DEBUG:teuthology.nuke:shortname: smithi174 2023-09-28T04:25:07.687 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T04:25:07.690 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 03:58:26.683842', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEgkcbwfR7XZNPUcl8Ib/j/BLssG951PHYcBVnxPvirIsPyF0M5iGVpnESGHanAc2xAfzWwR76bDlWg7y/V7LTE='} 2023-09-28T04:25:07.713 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403611', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 03:58:26.682276', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIPrsYX5ysB2+tp7lWpx+f/U8mR/v1mV6w8mB0mI9ZYLfAI9MaFtRgE0T2pfWfkZ4YY469JtwKN0+4kGu2iMQwg='} 2023-09-28T04:25:07.744 INFO:teuthology.orchestra.console.smithi118:Power off 2023-09-28T04:25:07.744 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T04:25:07.768 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-09-28T04:25:07.768 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T04:25:07.784 INFO:teuthology.orchestra.console.smithi174:Power off 2023-09-28T04:25:07.784 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T04:25:07.793 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-09-28T04:25:07.805 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-09-28T04:25:07.805 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T04:25:07.828 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-09-28T04:25:11.794 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T04:25:11.830 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T04:25:11.905 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-09-28T04:25:11.938 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-09-28T04:25:15.910 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T04:25:15.940 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T04:25:16.020 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-09-28T04:25:16.048 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-09-28T04:25:16.121 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-09-28T04:25:20.052 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T04:25:20.162 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-09-28T04:25:20.263 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-09-28T04:25:20.368 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} duration: 955.0693936347961 failure_reason: '' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=d909527ce834446795527487d6145ede status: fail success: false 2023-09-28T04:25:20.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T04:25:20.446 INFO:teuthology.run:FAIL